{"success":true,"data":{"author":"NASA-IBM AI4Science (Surya / SuryaBench team); Jinsu Hong, Kang Yang, Berkay Aydin (Georgia State University)","bucketAccessType":"public","bucketName":"nasa-ibm-ai4science/surya-bench-ar-segmentation","bucketPrefix":"","category":"Astronomy & Space","cloudProvider":"huggingface","createdAt":"2026-11-16T02:38:29.680Z","description":"Hourly binary segmentation masks of solar active regions (ARs) and polarity inversion lines (PILs) derived from SDO Helioseismic and Magnetic Imager (HMI) line-of-sight magnetograms, released by Hong, Yang and Aydin (Georgia State University) as the segmentation task of SuryaBench, the benchmark suite for the NASA-IBM Surya heliophysics foundation model. Each HDF5 file holds a (2, 4096, 4096) full-disk array with two keys: intersection, the binary map of strong-gradient PILs, and union_with_intersect, the map of active regions that contain those PILs. There are 128,352 hourly instances from 13 May 2010 to 31 December 2024, about 53 kB each and 1.2 GB in total. Splits follow the shared SuryaBench calendar: train.csv (15 February to 31 December of 2010 to 2019), validation.csv (15 to 31 January), leaky_validation.csv (1 to 14 January and 1 to 14 February) and test.csv (all of 2020 to 2024), each indexing timestamps and file paths so masks can be paired with the Surya core SDO stack (s3://nasa-surya-bench). Intended for magnetogram segmentation, flare-precursor feature extraction and AR tracking. Read with h5py. CC-BY-4.0 as stated in the card.","displayTitle":"SuryaBench ARPIL: Hourly SDO/HMI Binary Maps of Active Regions and Polarity Inversion Lines (2010-2024)","id":"fd2824bd-24c8-53e5-a2c1-a6b58bc858b9","license":"CC-BY-4.0","licenseEvidenceUrl":"https://huggingface.co/datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation","objectCountEstimate":7,"probeStatus":"ok","referenceUrl":"https://github.com/NASA-IMPACT/Surya","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"nasa-ibm-ai4science/surya-bench-ar-segmentation\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"nasa-ibm-ai4science/surya-bench-ar-segmentation\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=nasa-ibm-ai4science, license:cc-by-4.0, size_categories:100K<n<1M, format:csv, downloads=302"],"format":"mixed","generatedAt":"2026-11-16T02:38:34.903Z","layout":{"example":"leaky_validation.csv","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"timestamp,file_path,present\n2011-01-01 00:00:00,data/2011/01/20110101_0000.h5,1.0\n2011-01-01 01:00:00,data/2011/01/20110101_0100.h5,1.0\n2011-01-01 02:00:00,data/2011/01/20110101_0200.h5,1.0\n2011-01-01 03:00:00,data/2011/01/20110101_0300.h5,1.0\n2011-01-01 04:00:00,data/2011/01/20110101_0400.h5,1.0\n2011-01-01 05:00:00,data/2011/01/20110101_0500.h5,1.0\n2011-01-01 06:00:00,data/2011/01/20110101_0600.h5,1.0\n2011-01-01 07:00:00,data/2011/01/20110101_0700.h5,1.0\n2011-01-01 08:00:00,data/2011/01/20110101_0800.h5,1.","encoding":"utf8","key":"leaky_validation.csv","truncatedAt":512}],"sampleObjects":["data.tar.gz","leaky_validation.csv","test.csv","train.csv","validation.csv"],"sidecars":[{"bytes":"---\nlicense: cc-by-4.0\ntags:\n- solar-physics\n- solar-active-regions\n- segmentation\n- polarity-inversion-lines\n- space-weather\npretty_name: ARPIL\nconfigs:\n- config_name: default\n  default: true\n  data_files:\n  - split: train\n    path: train.csv\n  - split: validation\n    path: validation.csv\n  - split: test\n    path: test.csv\n  - split: leaky_validation\n    path: leaky_validation.csv\n---\n---\n\n# A Dataset of Binary Maps of Active Regions with Polarity Inversion Lines\n\n## Dataset Summary\n\nThis dataset provides hourly binary segmentation maps (4096×4096 resolution) derived from Solar Dynamics Observatory (SDO) / Helioseismic and Magnetic Imager (HMI) line-of-sight magnetograms. The maps highlight regions containing Active Regions (ARs) and Polarity Inversion Lines (PILs). The dataset spans observations from May 13, 2010 to December 31, 2024 and is intended for image segmentation tasks using full-disk 4096×4096 magnetogram rasters as input.\n\n## Supported Tasks and Applications\n- `segmentation`: Binary segmentation of solar magnetograms to identify ARs with strong PILs.\n\n## Dataset Structure\n\n### Data Files\n\n- `train.csv`: Instances from Feb 15 to Dec 31 of each year between 2010–2019, day index `[45:]`\n- `validation.csv`: Instances from Jan 15 to Jan 31 of each year between 2010–2019, day index `[14:31]`\n- `test.csv`: All instances from each year between 2020–2024, day index `[:]`\n- `leaky_validation.csv`: Instances from Jan 1 to 14 and Feb 1-14 of each year between 2010–2019, day indices `[0:14]` and `[31:45]`\n\n### Features\n\nEach .h5 file contains two keys:\n- `intersection`: Binary map of polarity inversion lines (PILs)\n- `union_with_intersect`: Binary map of active regions that contain PILs\n\n## Dataset Details\n\n| Field | Description |\n|------------------------|---------------------------------------------|\n| **Temporal Coverage** | May 13, 2010 – Dec 31, 2024 |\n| **Data Format** | HDF5 (.h5) |\n| **Data Shape** | [2, 4096, 4096] per file |\n| **Total Instances** | Total 128,352 instances |\n| **Cadence** | 1 hour |\n| **Size per File** | ~ 53kB |\n| **Total Dataset Size** | ~ 1.2GB |\n\n## License\nThis dataset is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) License.\n\n## Authors\n- Jinsu Hong, [jhong36@gsu.edu](mailto:jhong36@gsu.edu)\n- Kang Yang, [kyang30@gsu.edu](mailto:kyang30@gsu.edu)\n- Berkay Aydin, [baydin2@gsu.edu](mailto:baydin2@gsu.edu)","encoding":"utf8","key":"README.md","name":"README.md","size":2419,"truncated":false}],"sourceObjectKey":"leaky_validation.csv","starterCell":"import pandas as pd\ndf = pd.read_csv(\"hf://datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation/leaky_validation.csv\")\ndf.head()","starterSamplePath":"leaky_validation.csv","totalObjects":7},"summary":"Hourly binary segmentation masks of solar active regions (ARs) and polarity inversion lines (PILs) derived from SDO Helioseismic and Magnetic Imager (HMI) line-of-sight…","title":"SuryaBench ARPIL: Hourly SDO/HMI Binary Maps of Active Regions and Polarity Inversion Lines (2010-2024)","updatedAt":"2026-11-16T16:56:46.516Z","visibility":"public","websiteUrl":"https://huggingface.co/datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation"}}