{"success":true,"data":{"author":"NOAA MADIS; converted by Google Research (WeatherBench 2)","bucketAccessType":"public","bucketListable":true,"bucketName":"weatherbench2","bucketPrefix":"datasets/metar","category":"Climate & Weather","cloudProvider":"gcp","createdAt":"2026-11-14T14:15:25.898Z","description":"Global METAR and SPECI weather station reports from the NOAA Meteorological Assimilation Data Ingest System (MADIS), downloaded from the MADIS FTP server in NetCDF and converted by the WeatherBench 2 team to Parquet for verifying forecasts against point observations rather than reanalysis. Each row is one report with station name, location name, latitude, longitude, elevation, observation, nominal and receipt times, report type, visibility, present weather, sea level pressure, temperature, dewpoint, wind direction, speed and gust, altimeter, 24-hour min and max temperature, 1, 3, 6 and 24-hour precipitation, 3-hour pressure change and snow cover, with MADIS data-descriptor (DD) quality flags. The same data is laid out four ways, Hive-partitioned by year and month: by nominal time per month, per day and per hour, and by observation time per hour from 2001-07-01 to 2024-01-01. Measured 2026-11-14: the monthly layout holds 270 Parquet files totalling 26.8 GB. Read with pandas.read_parquet or pyarrow.dataset. The WeatherBench 2 LICENSE file states CC BY 4.0 and notes MADIS METAR data is publicly accessible without restrictions; cite NOAA MADIS and Rasp et al. 2024.","displayTitle":"MADIS METAR Surface Station Observations 2001-2023 (WeatherBench 2, Parquet)","doi":"10.1029/2023MS004019","fuseMountBrowsable":true,"id":"0982537f-0952-5ee7-8fee-fc3376d42243","license":"CC-BY-4.0","licenseEvidenceUrl":"https://storage.googleapis.com/weatherbench2/datasets/metar/LICENSE","objectCountEstimate":4,"probeStatus":"ok","referenceUrl":"https://doi.org/10.1029/2023MS004019","region":"us","schemaCard":{"accessHints":[{"language":"python-gcsfs","snippet":"import gcsfs\nfs = gcsfs.GCSFileSystem(token='anon')\nfs.ls('weatherbench2/datasets/metar/', detail=False)[:10]"},{"language":"python-storage","snippet":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nlist(client.bucket('weatherbench2').list_blobs(prefix='datasets/metar/', max_results=10))"}],"caveats":["Files are binary — use a domain-specific parser rather than text I/O."],"format":"binary","generatedAt":"2026-11-14T14:15:29.209Z","layout":{"example":"datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","pattern":"{prefix}/{seg1}/{seg2}/{seg3}/{seg4}/{seg5}/{filename}"},"mountPath":"/mnt/gcs-archive/data","sampleHeaders":[{"bytes":"5041523115041590f20115f696014c15a21e150012000088791c040000004b4d574b0508084a594f05080833445501080c5041524c090804534901080c4b4f4d4801080850414c05300c50415350091004445401080c4b4a444e0508085033380508083942420508083448560508083837510508084e514101080850415805480c4b4c41580110084b4d5905700c4b53414405100443520560084b5049096008494c4705180441430910083132430510044645092804464f0558084b4a4f092004414909d004415609600842415a0530044247096008444157051008454253050804484409300448550940044c472508084b4d5009c0084f5852052800532900084b534d093008564e5905180850574d050804494b09d8044f4c0d18005009f804534c09300441442548084b434109580843424605380443460d10004b0d08005309380446462918084849450528044d452958004d0da8044d570950044f522910044f5209280453480938045441299804455229c8004a2d400442440920044c47293804503529b8044356296808503539057004534d2940044d4b0958044548093004534e292800560d500445572920044443092004434f097800540db0044f5209e804594e096004434c09400448542980044341293804434929a004454c29d80441420978044a4609200450560920044249093800494d30005249b8084b48","encoding":"hex","key":"datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","truncatedAt":512},{"bytes":"50415231150415c8f10115fa95014c159a1e1500120000e4781c040000004b484c580508084f4d4805080841534505080842564f050808485952050804535705100c50415154051004494305080c50414b5501100c5041584b0108044b4309200c5041444c01100850415709400850333801100c4b4a444e0508083837510508084351560508044c4109880453410920085341440518044d5905480c4b45484101100c504156570108084d4d4705180c4d4d53500910005005680c4d4d5a430910004905300c4d4d4d4d0910005a05c0084d4d450d30004c0d10005005700850414c098804505705300c4b4552490138084b31320550044b4109f00c4b494c47051804415609b004424709a80444410598084b444e09480448440560084b48552528084b4c472528084b4d500920044f522968044f5805b8084b534c294004534d093808564e5905680446570980004609b80c4b4d51420518044f4c092004415805e80c4b42415a0518044346096004434905d8084b434b091008444e530520044553099004484e09780449432548084b4d574900044f4d09500850504605300453480920004a2d0004344209a80443522548084b434c09c80450490958044349291004434c09100448540d784d08044f520958045244291000434d7804454b09b004424b2948044c470d880056095004594e2978044341098004414c290804","encoding":"hex","key":"datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=10/2001-10-10.parquet","truncatedAt":512}],"sampleObjects":["datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=10/2001-10-10.parquet","datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=11/2001-10-11.parquet","datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=12/2001-10-12.parquet","datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=13/2001-10-13.parquet"],"sidecars":[{"bytes":"Licence: Creative Commons Attribution 4.0 International (CC BY 4.0)\nhttps://creativecommons.org/licenses/by/4.0/\n\nData has been obtained from NOAA MADIS: https://madis.ncep.noaa.gov/index.shtml.\nMETAR data is publicly accessible without restrictions:\nhttps://madis.ncep.noaa.gov/madis_metar.shtml.\n\n=======================================================================\n\nAttribution 4.0 International\n\n=======================================================================\n\nCreative Commons Corporation (\"Creative Commons\") is not a law firm and\ndoes not provide legal services or legal advice. Distribution of\nCreative Commons public licenses does not create a lawyer-client or\nother relationship. Creative Commons makes its licenses and related\ninformation available on an \"as-is\" basis. Creative Commons gives no\nwarranties regarding its licenses, any material licensed under their\nterms and conditions, or any related information. Creative Commons\ndisclaims all liability for damages resulting from their use to the\nfullest extent possible.\n\nUsing Creative Commons Public Licenses\n\nCreative Commons public licenses provide a standard set of terms and\nconditions that creators and other rights holders may use to share\noriginal works of authorship and other material subject to copyright\nand certain other rights specified in the public license below. The\nfollowing considerations are for informational purposes only, are not\nexhaustive, and do not form part of our licenses.\n\n     Considerations for licensors: Our public licenses are\n     intended for use by those authorized to give the public\n     permission to use material in ways otherwise restricted by\n     copyright and certain other rights. Our licenses are\n     irrevocable. Licensors should read and understand the terms\n     and conditions of the license they choose before applying it.\n     Licensors should also secure all rights necessary before\n     applying our licenses so that the public can reuse the\n     material as expected. Licensors should clearly mark any\n     material not subject to the license. This includes other CC-\n     licensed material, or material used under an exception or\n     limitation to copyright. More considerations for licensors:\n\twiki.creativecommons.org/Considerations_for_licensors\n\n     Considerations for the public: By using one of our public\n     licenses, a licensor grants the public permission to use the\n     licensed material under specified terms and conditions. If\n     the licensor's permission is not necessary for any reason--for\n     example, because of any applicable exception or limitation to\n     copyright--then that use is not regulated by the license. Our\n     licenses grant only permissions under copyright and certain\n     other rights that a licensor has authority to grant. Use of\n     the licensed material may still be restricted for other\n     reasons, including because others have copyright or other\n     rights in the material. A licensor may make special requests,\n     such as asking that all changes be marked or described.\n     Although not required by our licenses, you are encouraged to\n     respect those requests where reasonable. More_considerations\n     for the public:\n\twiki.creativecommons.org/Considerations_for_licensees\n\n=======================================================================\n\nCreative Commons Attribution 4.0 International Public License\n\nBy exercising the Licensed Rights (defined below), You accept and agree\nto be bound by the terms and conditions of this Creative Commons\nAttribution 4.0 International Public License (\"Public License\"). To the\nextent this Public License may be interpreted as a contract, You are\ngranted the Licensed Rights in consideration of Your acceptance of\nthese terms and conditions, and the Licensor grants You such rights in\nconsideration of benefits the Licensor receives from making the\nLicensed Material available under these terms and conditions.\n\n\nSection 1 -- Definitions.\n\n  a. Adapted Material means material subject to Copyright and Similar\n     Rights that is derived from or based up","encoding":"utf8","key":"datasets/metar/LICENSE","name":"LICENSE","size":19021,"truncated":true}],"sourceObjectKey":"datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","starterCell":"import os\nimport pyarrow.parquet as pq\npf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet'))\nprint(pf.metadata)\ndf = pf.read_row_group(0).to_pandas()\ndf.head()","starterSamplePath":"metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","totalObjects":"4 top-level prefixes","verifiedRead":{"attempts":[{"family":"parquet","ok":true,"path":"metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","seconds":0.85}],"bytes":923412,"facts":[],"family":"parquet","image":"531775725781.dkr.ecr.us-east-1.amazonaws.com/scigantic-notebook-geospatial:latest","library":"pyarrow","path":"metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet","replacedStarterCell":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nbucket = client.bucket('weatherbench2')\nblob = bucket.blob('datasets/metar/metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet')\nwith blob.open(\"rb\") as fh:\n    print(fh.read(64))","rssDeltaMb":41.5,"seconds":0.85,"snippet":"import os\nimport pyarrow.parquet as pq\npf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'metar-timeNominal-by-day/year=2001/month=10/day=1/2001-10-01.parquet'))\nprint(pf.metadata)\ndf = pf.read_row_group(0).to_pandas()\ndf.head()","starterCell":{"error":"ModuleNotFoundError: No module named 'google.cloud'","ok":false,"seconds":0},"summary":"Parquet 53,323 rows, 44 columns, 1 row groups; columns ['stationName:string', 'locationName:string', 'latitude:float', 'longitude:float', 'elevation:float', 'timeObs:timestamp[ns]', 'timeNominal:timestamp[ns]', 'timeReceived:timestamp[ns]', 'reportType:string', 'autoStationType:string']","verifiedAt":"2026-11-15T06:16:25.740Z"}},"summary":"Global METAR and SPECI weather station reports from the NOAA Meteorological Assimilation Data Ingest System (MADIS), downloaded from the MADIS FTP server in NetCDF and converted…","title":"MADIS METAR Surface Station Observations 2001-2023 (WeatherBench 2, Parquet)","updatedAt":"2026-11-15T06:16:25.741Z","visibility":"public","websiteUrl":"https://weatherbench2.readthedocs.io/en/latest/data-guide.html"}}