{"success":true,"data":{"author":"Google Research (Ku, Anderson, Patel, Ie, Baldridge)","bucketAccessType":"public","bucketListable":true,"bucketName":"rxr-data","bucketPrefix":"","category":"Machine Learning & AI","cloudProvider":"gcp","createdAt":"2026-11-22T01:11:45.473Z","description":"Room-Across-Room (RxR) is a multilingual vision-and-language navigation (VLN) dataset: people describe paths through indoor environments of the Matterport3D building scans, and an agent must follow the spoken-then-transcribed instruction to the goal. RxR is about ten times larger than Room-to-Room (R2R), covers English (en-IN and en-US), Hindi and Telugu, and has longer, more varied paths. The bucket (about 161 GB) holds guide annotations (gzipped JSON Lines with path, scan id, viewpoints, initial heading, instruction text, word-level timestamps from the recording and annotator ids, for train, val_seen, val_unseen and test splits), follower annotations, pose_traces/ per split (NumPy archives recording where each annotator looked in the panorama as they spoke, which grounds each word to pixels and surfaces), text_features/ (precomputed multilingual text encodings), grounded landmark annotations, model-generated instructions and Gibson navigation graphs. The Matterport3D imagery itself is not included and is governed by the Matterport3D Terms of Use. Used for embodied AI agents, instruction following, multilingual grounding and instruction generation. Download with gsutil -m cp -R gs://rxr-data. License: the RxR annotations are released under CC BY 4.0. Cite Ku et al., Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding (EMNLP 2020).","displayTitle":"RxR (Room-Across-Room): Multilingual Vision-and-Language Navigation Instructions in English, Hindi and Telugu with Pose Traces for Matterport3D (Google Research)","fuseMountBrowsable":true,"id":"39c3f2a7-28fb-5d93-8c31-62b61effceaa","license":"CC-BY-4.0","licenseEvidenceUrl":"https://github.com/google-research-datasets/RxR","objectCountEstimate":2,"probeStatus":"ok","region":"us","schemaCard":{"accessHints":[{"language":"python-gcsfs","snippet":"import gcsfs\nfs = gcsfs.GCSFileSystem(token='anon')\nfs.ls('rxr-data/', detail=False)[:10]"},{"language":"python-storage","snippet":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nlist(client.bucket('rxr-data').list_blobs(prefix='', max_results=10))"}],"caveats":["Files are binary — use a domain-specific parser rather than text I/O."],"format":"binary","generatedAt":"2026-11-22T01:11:51.795Z","layout":{"example":"pose_traces/rxr_train/000000_follower_pose_trace.npz","pattern":"{prefix}/{seg1}/{filename}"},"mountPath":"/mnt/gcs-archive/data","sampleHeaders":[{"bytes":"504b03041400000008000000210034c3d67edb040000808f04000800000070616e6f2e6e7079edcfb14ac3501406e0b8fa14dda2d0a16dda348ab39be2d2c1499234c541acb4e2223e852fec0d9c40707450872ff07373ef3de77cc9e7ede6e6eefe247bcbdef36d776c0ff9e524bfda148b7c3ac977fbc3eba17e7ed81fb65d7f715d3f1dbb747e7cac5fbab43f5b14c5727a3e9d7c4c7ef89c2eb32cebb34e99a7ec52da581729654a9352a454a3da2e651b6755f474713f8ff7feac4e598df64ddc17d1cfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9f","encoding":"hex","key":"pose_traces/rxr_train/000000_follower_pose_trace.npz","truncatedAt":512},{"bytes":"504b0304140000000800000021003f4e9fa662040000800404000800000070616e6f2e6e7079edcfb14ac3501406e0b8fa14dda2d0a1696d1ac5d94d71717092244d71102ba9b8884fe10b7b0327101c7551f8023f37f7de73ce977cdedc5ddfde1f656fd97bbeed0e6d9f5fccf2cbbbd5329fcff2ddbe7fedebe7877dbfed868babfae9d0a5f3c363fdd2a5fdc972b12ee7a7f3d9c7ec87cff159966543362945ca2ea58d759952a63429ab946a52dba56ce3ac8a9e2eee8b781fceea94f564dfc4fd2afaf97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3f97c3e9fcfe7f3","encoding":"hex","key":"pose_traces/rxr_train/000000_guide_pose_trace.npz","truncatedAt":512}],"sampleObjects":["pose_traces/rxr_train/000000_follower_pose_trace.npz","pose_traces/rxr_train/000000_guide_pose_trace.npz","pose_traces/rxr_train/000006_follower_pose_trace.npz","pose_traces/rxr_train/000006_guide_pose_trace.npz","pose_traces/rxr_train/000007_follower_pose_trace.npz"],"sourceObjectKey":"pose_traces/rxr_train/000000_follower_pose_trace.npz","starterCell":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nbucket = client.bucket('rxr-data')\nblob = bucket.blob('pose_traces/rxr_train/000000_follower_pose_trace.npz')\nwith blob.open(\"rb\") as fh:\n    print(fh.read(64))","starterSamplePath":"pose_traces/rxr_train/000000_follower_pose_trace.npz","totalObjects":"2 top-level prefixes"},"summary":"Room-Across-Room (RxR) is a multilingual vision-and-language navigation (VLN) dataset: people describe paths through indoor environments of the Matterport3D building scans, and an…","title":"RxR (Room-Across-Room): Multilingual Vision-and-Language Navigation Instructions in English, Hindi and Telugu with Pose Traces for Matterport3D (Google Research)","updatedAt":"2026-11-22T04:05:01.790Z","visibility":"public","websiteUrl":"https://github.com/google-research-datasets/RxR"}}