{"success":true,"data":{"author":"Open Climate Fix; source data British Crown copyright Met Office","bucketAccessType":"public","bucketName":"openclimatefix/met-office-uk-deterministic-solar","bucketPrefix":"","category":"Climate & Weather","cloudProvider":"huggingface","createdAt":"2026-11-14T14:15:16.183Z","description":"Subset of the Met Office UK Deterministic numerical weather prediction model (published on the AWS Open Data registry), converted by Open Climate Fix from NetCDF to Zarr for machine learning on solar PV and renewable energy forecasting. Variables include downward shortwave, longwave and UV radiation flux at the surface, screen-level (2 m) temperature, high, medium, low and total cloud amount, snow depth water equivalent, surface roughness, and 10 m wind speed and direction, with accumulated radiation channels listed separately. Each .zarr.zip archive holds one forecast initialisation time (for example 2023-01-01-00.zarr.zip). The listing (measured 2026-11-14) shows data/2023, data/2024 and data/2025 folders; the repository uses about 2.5 TB. Open an archive with xarray and zarr through a zip store, or with fsspec for remote reads. Useful for PV nowcasting, solar irradiance forecasting and weather feature engineering for UK energy models. Open Climate Fix releases it under CC-BY-4.0; the source is Crown copyright Met Office under the UK Open Government Licence v3, and the card gives the required Met Office attribution.","displayTitle":"Met Office UK Deterministic NWP Subset for Solar Forecasting (Zarr)","id":"5c0da727-3c32-58b6-938a-be06594a2e1c","license":"CC-BY-4.0","licenseEvidenceUrl":"https://huggingface.co/datasets/openclimatefix/met-office-uk-deterministic-solar","objectCountEstimate":18960,"probeStatus":"ok","referenceUrl":"https://registry.opendata.aws/met-office-uk-deterministic/","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"openclimatefix/met-office-uk-deterministic-solar\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"openclimatefix/met-office-uk-deterministic-solar\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=openclimatefix, license:cc-by-4.0, size_categories:10K<n<100K, downloads=33290"],"format":"mixed","generatedAt":"2026-11-14T14:15:24.262Z","layout":{"example":"data/2023/01/01/2023-01-01-00.zarr.zip","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"504b03041400000000009596315a1db677ff1800000018000000070000002e7a67726f75707b0a20202020227a6172725f666f726d6174223a20320a7d504b03041400000000009596315aba28c31fc7010000c701000041000000323032333031303154303030305a2d5054303030304830304d2d636c6f75645f616d6f756e745f6f665f686967685f636c6f75642e7a6172722f2e7a61747472737b0a2020202022436f6e76656e74696f6e73223a202243462d312e372c20554b4d4f2d312e30222c0a2020202022686973746f7279223a2022323032332d30312d30315430313a31313a33365a3a205374614745204465636f75706c6572222c0a2020202022696e737469747574696f6e223a20224d6574204f6666696365222c0a20202020226d6f73675f5f666f7265636173745f72756e5f6475726174696f6e223a20225054353448222c0a20202020226d6f73675f5f677269645f646f6d61696e223a2022756b5f657874656e646564222c0a20202020226d6f73675f5f677269645f74797065223a20227374616e64617264222c0a20202020226d6f73675f5f677269645f76657273696f6e223a2022312e372e30222c0a20202020226d6f73675f5f6d6f64656c5f636f6e66696775726174696f6e223a2022756b5f646574222c0a2020202022736f75726365223a20224d6574204f666669636520556e69","encoding":"hex","key":"data/2023/01/01/2023-01-01-00.zarr.zip","truncatedAt":512}],"sampleObjects":["data/2023/01/01/2023-01-01-00.zarr.zip","data/2023/01/01/2023-01-01-01.zarr.zip","data/2023/01/01/2023-01-01-02.zarr.zip","data/2023/01/01/2023-01-01-03.zarr.zip","data/2023/01/01/2023-01-01-04.zarr.zip"],"sidecars":[{"bytes":"---\ndatasets:\n- met-office-uk-deterministic-zarr\ntags:\n- weather\n- nwp\n- met-office\n- deterministic\n- zarr\n- climate\n- solar\nlicense: cc-by-4.0\nannotations_creators:\n- expert-generated\nlanguage_creators:\n- other\nmultilinguality:\n- monolingual\nsize_categories:\n- 10K<n<100K\nsource_datasets:\n- original\ntask_categories:\n- time-series-forecasting\ntask_ids:\n- multivariate-time-series-forecasting\nconfigs:\n- config_name: met-office-uk-deterministic-zarr\n  name: met-office-uk-deterministic-zarr\n  splits: []\n  description: This dataset contains uploaded Zarr files as zip archives.\n\n---\n\n![CC-BY-4.0](https://img.shields.io/badge/license-CC--BY--4.0-blue)\n\n# Met Office UK Deterministic Dataset (Zarr Format)\n\n## Description\nThis dataset is a **subset** of the [Met Office UK Deterministic Dataset](https://registry.opendata.aws/met-office-uk-deterministic/), converted from the original **NetCDF format** into **Zarr format** for modern data analysis. The Zarr files are packaged as **.zarr.zip archives** for efficient storage and transfer.\n\nThe subset focuses on specific variables and configurations, which are detailed below. Researchers and developers can use this subset for applications in climate science, weather forecasting, and renewable energy modeling.\n\n## Usage\nThis dataset is provided under the **Creative Commons Attribution 4.0 International License (CC-BY-4.0)**. When using this dataset, you must provide proper attribution to the Met Office as outlined below.\n\n## Attribution\nThis dataset is derived from the [Met Office UK Deterministic Dataset](https://registry.opendata.aws/met-office-uk-deterministic/), which is British Crown copyright and provided by the Met Office under the terms of the [UK Open Government License (OGL)](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/).\n\n- **Original Source**: [Met Office UK Deterministic Dataset on AWS](https://registry.opendata.aws/met-office-uk-deterministic/)\n- **Copyright**: British Crown copyright © Met Office\n\n## Details\n### Zarr Format and Zip Archives\n- **Format**: The dataset files are in Zarr format, a modern storage format optimized for analytics and machine learning workflows.\n- **Packaging**: Zarr files are stored as `.zarr.zip` archives. Each archive corresponds to a specific time interval, such as `2023-01-01-00.zarr.zip`.\n\n### Subset Attributes\nThis dataset includes a subset of numerical weather prediction (NWP) variables, categorized as follows:\n\n#### Accumulated Channels:\n- **radiation_flux_in_shortwave_total_downward_at_surface**: Downward shortwave radiation flux at the surface (W/m²)\n- **radiation_flux_in_longwave_downward_at_surface**: Downward longwave radiation flux at the surface (W/m²)\n- **surface_roughness**: Surface roughness (m) (if available, otherwise null or computed)\n- **radiation_flux_in_uv_downward_at_surface**: Downward UV radiation flux at the surface (W/m²)\n\n#### General NWP Channels:\n- **temperature_at_screen_level**: 2-meter temperature (°C)\n- **radiation_flux_in_shortwave_total_downward_at_surface**: Downward shortwave radiation flux at the surface (W/m²)\n- **radiation_flux_in_longwave_downward_at_surface**: Downward longwave radiation flux at the surface (W/m²)\n- **cloud_amount_of_high_cloud**: High cloud cover (fraction or %)\n- **cloud_amount_of_medium_cloud**: Medium cloud cover (fraction or %)\n- **cloud_amount_of_low_cloud**: Low cloud cover (fraction or %)\n- **cloud_amount_of_total_cloud**: Total cloud cover (fraction or %)\n- **snow_depth_water_equivalent**: Snow depth equivalent water content (mm)\n- **surface_roughness**: Surface roughness (m) (if available, otherwise null or computed)\n- **radiation_flux_in_uv_downward_at_surface**: Downward UV radiation flux at the surface (W/m²)\n- **wind_speed_at_10m**: 10-meter wind speed (m/s)\n- **wind_direction_at_10m**: 10-meter wind direction (degrees)\n\nThis dataset provides essential meteorological variables for applications in weather prediction, climate modeling, and solar energy forecasting.\n","encoding":"utf8","key":"README.md","name":"README.md","size":4022,"truncated":false}],"sourceObjectKey":"data/2023/01/01/2023-01-01-00.zarr.zip","starterCell":"from huggingface_hub import hf_hub_download\npath = hf_hub_download(repo_id=\"openclimatefix/met-office-uk-deterministic-solar\", filename=\"data/2023/01/01/2023-01-01-00.zarr.zip\", repo_type=\"dataset\")\nprint(path)","starterSamplePath":"data/2023/01/01/2023-01-01-00.zarr.zip","totalObjects":18960},"summary":"Subset of the Met Office UK Deterministic numerical weather prediction model (published on the AWS Open Data registry), converted by Open Climate Fix from NetCDF to Zarr for…","title":"Met Office UK Deterministic NWP Subset for Solar Forecasting (Zarr)","updatedAt":"2026-11-14T17:42:17.501Z","visibility":"public","websiteUrl":"https://huggingface.co/datasets/openclimatefix/met-office-uk-deterministic-solar"}}