{"success":true,"data":{"author":"Brightband, in partnership with NOAA","bucketAccessType":"public","bucketListable":true,"bucketName":"nnja-ai","bucketPrefix":"data","category":"Climate & Weather","cloudProvider":"gcp","createdAt":"2026-11-17T14:12:20.482Z","description":"Brightband's reprocessing of the NOAA-NASA Joint Archive (NNJA) of Earth system observations from the original BUFR files into Parquet, so that observation-based AI weather models can read them without BUFR decoders. Version 1 holds about 50 TiB of observations with a JSON data catalog. Measured 2026-11-17 from data/v1/catalog.json: 14 datasets, including AMSU-A, ATMS and MHS Level 1B microwave brightness temperatures (NOAA-15 to -19, METOP, NPP, NOAA-20), CrIS full-spectral radiances (431-channel subset), IASI radiances, Himawari AHI clear-sky radiances, GOES ABI all-sky and clear-sky radiances, SEVIRI all-sky radiances, and conventional ADP surface (SYNOP fixed and mobile land, METAR/SPECI) and upper-air rawinsonde reports. The bucket has data/v1-preview/, data/v1/ and data/v2/; v2 adds atmospheric motion vectors (amv/), GPS radio occultation (gps/), convbufr and prepbufr conventional data, and _sidecars/ metadata. Open with the nnja-ai Python SDK (DataCatalog) or any Parquet reader such as pandas, polars or DuckDB. The data carry the same CC BY 4.0 license as the original NNJA; cite the nnja-ai Zenodo DOI 10.5281/zenodo.14633508 and follow the NNJA citation guidance from NOAA PSL.","displayTitle":"NNJA-AI: AI-Ready Parquet Reprocessing of the NOAA-NASA Joint Archive of Weather Observations (Brightband)","doi":"10.5281/zenodo.14633508","fuseMountBrowsable":true,"id":"6ae11274-0280-5716-9084-09d83e5b01aa","license":"CC-BY-4.0","licenseEvidenceUrl":"https://nnja-ai.readthedocs.io/en/stable/","objectCountEstimate":3,"probeStatus":"ok","referenceUrl":"https://doi.org/10.5281/zenodo.14633508","region":"us","schemaCard":{"accessHints":[{"language":"python-gcsfs","snippet":"import gcsfs\nfs = gcsfs.GCSFileSystem(token='anon')\nfs.ls('nnja-ai/data/', detail=False)[:10]"},{"language":"python-storage","snippet":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nlist(client.bucket('nnja-ai').list_blobs(prefix='data/', max_results=10))"}],"caveats":["Files are binary — use a domain-specific parser rather than text I/O."],"format":"binary","generatedAt":"2026-11-17T14:24:11.048Z","layout":{"example":"data/v1-preview/amsua/1bamua/NC021023/.pmetadata","pattern":"{id}/{seg1}/{seg2}/{seg3}/{seg4}/{filename}"},"mountPath":"/mnt/gcs-archive/data","sampleHeaders":[{"bytes":"{\n    \"name\": \"amsua-1bamua-NC021023\",\n    \"description\": \"AMSU-A Level 1B brightness temperature data from NOA3-15,-16,-17,-18, -19 (ATOVS), METOP-2,-1\",\n    \"tags\": [\n        \"amsu\",\n        \"brightness temperature\",\n        \"satellite\",\n        \"METOP\",\n        \"NOAA\"\n    ],\n    \"parquet_root_path\": \"gs://nnja-ai/data/v1-preview/amsua/1bamua/NC021023\",\n    \"dimensions\": [\n        {\n            \"channel\": {\n                \"units\": null,\n                \"values\": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13","encoding":"utf8","key":"data/v1-preview/amsua/1bamua/NC021023/.pmetadata","truncatedAt":512},{"bytes":"5041523115041590fe3015f087134c15e28f06150012000028b52ffda0881f06009c5506fef24ca12e2810803e07b302ccfcefff7f9f586746ddfdffff8b1fee575555555555554b540d31f717ffff5f10294c2ee12d402fa1cec4ac7bf4601714fe43a66ba0c157162cf85e48975dd3a32bb872c0bfa2b78de0aedd2fe3c6b16ce924559cc3f655ec3912135b687d2b07e45c3749bf0e3128e947a6791e064ee37c2d30f71b5de50117997c1b574e658089187f4219af42a044d3f9e5d537dfd9c5ddd0e13abf37abe2574ffd2596a3d4bd10264e0295a1d83e688843e8692a0140f976ec517538e325076abd5c0c1f4bd06a1cd90acd3b41e12f9e4380f92610de73a7a73010e45f2c4f2be59679acf8e4fd92dc6db5bfe0f88c91d702e43bce98458ff750c193341b83174b4940e3791978281b9e5cf1883cae07a7d7c630d7881fc3eb47b8308eaa4771eb557c6d34852b307d9402aedeaa843f87feb1d40bd5fa2e08a36178ac4e9f8283893c781a945e02aba55ef090818712218ee79ae0d4dfdf34f4462f3de881e7e83cd99f7b81e227b10fc4ce6334e91147ec84fa3f6dfe04800fd782be299963eee8c509fc77f9705b9e46016f717c2669bc478a7621803ffc2f8571270a74b957f065b3f8e85453d6f2e73d1f14ef62e532708fe5882709ea1ca3ace2ec39f8700b9bdce480d7ebd6f0d7060d2ac9916cde9085","encoding":"hex","key":"data/v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-01/gdas.20210101.NC021023.parquet","truncatedAt":512}],"sampleObjects":["data/v1-preview/amsua/1bamua/NC021023/.pmetadata","data/v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-01/gdas.20210101.NC021023.parquet","data/v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-02/gdas.20210102.NC021023.parquet","data/v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-03/gdas.20210103.NC021023.parquet","data/v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-04/gdas.20210104.NC021023.parquet"],"sidecars":[{"bytes":"{\n  \"amsua-1bamua-NC021023\": {\n    \"description\": \"Data from the Advanced Microwave Sounding Unit-A (AMSU-A) instrument.\",\n    \"datasets\": {\n      \"NC021023\": {\n        \"name\": \"amsua-1bamua-NC021023\",\n        \"description\": \"AMSU-A Level 1B brightness temperature data from NOA3-15,-16,-17,-18, -19 (ATOVS), METOP-2,-1\",\n        \"tags\": [\"amsu\", \"brightness temperature\", \"satellite\", \"METOP\", \"NOAA\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/amsua/1bamua/NC021023/.pmetadata\"\n      }\n    }\n  },\n  \"atms-atms-NC021203\": {\n    \"description\": \"Data from the Advanced Technology Microwave Sounder (ATMS) instrument.\",\n    \"datasets\": {\n      \"NC021203\": {\n        \"name\": \"atms-atms-NC021203\",\n        \"description\": \"ATMS Level 1B brightness temperature data from NPP, NOAA-20\",\n        \"tags\": [\"atms\", \"brightness temperature\", \"satellite\", \"NPP\", \"NOAA\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/atms/atms/NC021203/.pmetadata\"\n      }\n    }\n  },\n  \"mhs-1bmhs-NC021027\": {\n    \"description\": \"Data from the Microwave Humidity Sounder (MHS) instrument.\",\n    \"datasets\": {\n      \"NC021027\": {\n        \"name\": \"mhs-1bmhs-NC021027\",\n        \"description\": \"MHS Level 1B brightness temperature data from NOAA-18, -19, METOP-1, -2\",\n        \"tags\": [\"mhs\", \"brightness temperature\", \"satellite\", \"METOP\", \"NOAA\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/mhs/1bmhs/NC021027/.pmetadata\"\n      }\n    }\n  },\n  \"cris-crisf4-NC021206\": {\n    \"description\": \"Data from the Cross-track Infrared Sounder (CrIS) instrument.\",\n    \"datasets\": {\n      \"NC021206\": {\n        \"name\": \"cris-crisf4-NC021206\",\n        \"description\": \"CrIS full spectral radiance (431 channel subset)\",\n        \"tags\": [\"cris\", \"infrared\", \"radiance\", \"satellite\", \"NOAA\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/cris/crisf4/NC021206/.pmetadata\"\n      }\n    }\n  },\n  \"iasi-mtiasi-NC021241\": {\n    \"description\": \"Data from the Infrared Atmospheric Sounding Interferometer (IASI) instrument.\",\n    \"datasets\": {\n      \"NC021241\": {\n        \"name\": \"iasi-mtiasi-NC021241\",\n        \"description\": \"IASI radiance data\",\n        \"tags\": [\"iasi\", \"radiance\", \"satellite\", \"METOP\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/iasi/mtiasi/NC021241/.pmetadata\"\n      }\n    }\n  },\n  \"geo-ahicsr-NC021044\": {\n    \"description\": \"Data from the Himawari Advanced Himawari Imager (AHI) instrument.\",\n    \"datasets\": {\n      \"NC021044\": {\n        \"name\": \"geo-ahicsr-NC021044\",\n        \"description\": \"JMA Himawari Clear-Sky Radiance (CSR) data\",\n        \"tags\": [\"ahi\", \"radiance\", \"satellite\", \"himawari\", \"geostationary\", \"brightness temperature\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/geo/ahicsr/NC021044/.pmetadata\"\n      }\n    }\n  },\n  \"geo-gsrasr-NC021045\": {\n    \"description\": \"Data from the GOES-R Advanced Baseline Imager (ABI) - All Sky Radiances.\",\n    \"datasets\": {\n      \"NC021045\": {\n        \"name\": \"geo-gsrasr-NC021045\",\n        \"description\": \"GOES All-Sky Radiance data\",\n        \"tags\": [\"goes\", \"radiance\", \"satellite\", \"abi\", \"all sky radiance\", \"brightness temperature\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/geo/gsrasr/NC021045/.pmetadata\"\n      }\n    }\n  },\n  \"geo-gsrcsr-NC021046\": {\n    \"description\": \"Data from the GOES-R Advanced Baseline Imager (ABI) - Clear Sky Radiances.\",\n    \"datasets\": {\n      \"NC021046\": {\n        \"name\": \"geo-gsrcsr-NC021046\",\n        \"description\": \"GOES Clear Sky Radiance data\",\n        \"tags\": [\"goes\", \"radiance\", \"satellite\", \"abi\", \"clear sky radiance\", \"brightness temperature\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/geo/gsrcsr/NC021046/.pmetadata\"\n      }\n    }\n  },\n  \"seviri-sevasr-NC021042\": {\n    \"description\": \"Data from the Spinning Enhanced Visible and InfraRed Imager (SEVIRI) - All Sky Radiances.\",\n    \"datasets\": {\n      \"NC021042\": {\n        \"name\": \"seviri-sevasr-NC021042\",\n        \"description\": \"SEVIRI All-Sky Radiance data\",\n        \"tags\": [\"seviri\", \"radiance\", \"satellite\", \"msg\", \"all sky radiance\", \"brightness temperature\"],\n        \"json\": \"gs://nnja-ai/data/v1-preview/seviri/sevasr/NC021042/.pmetada","encoding":"utf8","key":"data/v1-preview/catalog.json","name":"catalog.json","size":6536,"truncated":true}],"sourceObjectKey":"data/v1-preview/amsua/1bamua/NC021023/.pmetadata","starterCell":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nbucket = client.bucket('nnja-ai')\nblob = bucket.blob('data/v1-preview/amsua/1bamua/NC021023/.pmetadata')\nwith blob.open(\"rb\") as fh:\n    print(fh.read(64))","starterSamplePath":"v1-preview/amsua/1bamua/NC021023/OBS_DATE=2021-01-01/gdas.20210101.NC021023.parquet","totalObjects":"3 top-level prefixes"},"summary":"Brightband's reprocessing of the NOAA-NASA Joint Archive (NNJA) of Earth system observations from the original BUFR files into Parquet, so that observation-based AI weather models…","title":"NNJA-AI: AI-Ready Parquet Reprocessing of the NOAA-NASA Joint Archive of Weather Observations (Brightband)","updatedAt":"2026-11-17T20:13:31.963Z","visibility":"public","websiteUrl":"https://github.com/brightbandtech/nnja-ai"}}