{"success":true,"data":{"author":"Polymathic AI (The Well); Blakesley Burkhart, Flatiron Institute CCA and Rutgers University","bucketAccessType":"public","bucketName":"polymathic-ai/MHD_64","bucketPrefix":"","category":"Physics","cloudProvider":"huggingface","createdAt":"2026-11-14T01:01:19.836Z","description":"3D isothermal magnetohydrodynamic (MHD) turbulence without self-gravity, as in the diffuse interstellar medium, spanning subsonic to supersonic and sub-Alfvenic to super-Alfvenic regimes; MHD turbulence matters for the solar wind, galaxy formation and ISM dynamics. Run at 256 cubed with a Fortran MPI code, then anti-aliased with an ideal low-pass filter and downsampled to 64 by 64 by 64; each trajectory has 100 time steps on a periodic box. Fields are density, velocity and magnetic field. The datasheet lists 100 trajectories: 10 initial conditions times 10 combinations of sonic Mach number (0.5 to 7) and Alfvenic Mach number (0.7 or 2). Listing data/ (measured 2026-11-13) shows train/ (10 files, 60.8 GB, one per Mach number pair), valid/ and test/ (10 files, 7.3 GB each), plus an old_and_problematic_data/ folder at the root; about 159 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.","displayTitle":"The Well: Compressible MHD Turbulence (64 Cubed)","id":"c1009c88-5035-5659-aeb0-34bb64cf9190","license":"CC-BY-4.0","licenseEvidenceUrl":"https://arxiv.org/html/2412.00568","objectCountEstimate":39,"probeStatus":"ok","referenceUrl":"https://arxiv.org/abs/2412.00568","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"polymathic-ai/MHD_64\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"polymathic-ai/MHD_64\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=polymathic-ai, downloads=2441"],"format":"mixed","generatedAt":"2026-11-14T01:01:25.862Z","layout":{"example":"data/test/MHD_Ma_0.7_Ms_0.5.hdf5","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"894844460d0a1a0a000000000008080004001000000000000000000000000000ffffffffffffffffd094c02b00000000ffffffffffffffff0000000000000000600000000000000001000000000000008800000000000000a80200000000000001000c000100000018000000000000001000100000000000200300000000000030020000000000005452454500000100ffffffffffffffffffffffffffffffff00000000000000007818000000000000500000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","encoding":"hex","key":"data/test/MHD_Ma_0.7_Ms_0.5.hdf5","truncatedAt":512}],"sampleObjects":["MHD_64.yaml","data/stats.yaml","data/test/MHD_Ma_0.7_Ms_0.5.hdf5","data/test/MHD_Ma_0.7_Ms_0.7.hdf5","data/test/MHD_Ma_0.7_Ms_1.5.hdf5"],"sidecars":[{"bytes":"# Magnetohydrodynamics (MHD) compressible turbulence\n\n**NOTE:** This dataset is available in two different resolutions $256^3$ for `MHD_256` and $64^3$ for `MHD_64`. The data was first generated at $256^3$ and then downsampled to $64^3$ after anti-aliasing with an ideal low-pass filter. The data is available in both resolutions.\n\n**One line description of the data:** This is an MHD fluid flows in the compressible limit (subsonic, supersonic, sub-Alfvenic, super-Alfvenic).\n\n**Longer description of the data:** An essential component of the solar wind, galaxy formation, and of interstellar medium (ISM) dynamics is magnetohydrodynamic (MHD) turbulence. This dataset consists of isothermal MHD simulations without self-gravity (such as found in the diffuse ISM) initially generated with resolution $256^3$ and then downsampled to $64^3$ after anti-aliasing with an ideal low-pass filter. This dataset is the downsampled version.\n\n**Associated paper**: [Paper](https://iopscience.iop.org/article/10.3847/1538-4357/abc484/pdf)\n\n**Domain expert**: [Blakesley Burkhart](https://www.bburkhart.com/), CCA, Flatiron Institute & Rutgers University.\n\n**Code or software used to generate the data**: Fortran + MPI.\n\n**Equation**:\n\n$$\n\\begin{align*}\n\\frac{\\partial \\rho}{\\partial t} + \\nabla \\cdot (\\rho \\mathbf{v}) &= 0 \\\\\n\\frac{\\partial \\rho \\mathbf{v}}{\\partial t} + \\nabla \\cdot (\\rho \\mathbf{v} \\mathbf{v} - \\mathbf{B} \\mathbf{B}) + \\nabla p &= 0 \\\\\n\\frac{\\partial \\mathbf{B}}{\\partial t} - \\nabla \\times (\\mathbf{v} \\times \\mathbf{B}) &= 0\n\\end{align*}\n$$\n\nwhere $\\rho$ is the density, $\\mathbf{v}$ is the velocity, $\\mathbf{B}$ is the magnetic field, $\\mathbf{I}$ the identity matrix and $p$ is the gas pressure.\n\n![Gif](https://users.flatironinstitute.org/~polymathic/data/the_well/datasets/MHD_64/gif/density_unnormalized.gif)\n\n| Dataset    | FNO | TFNO  | Unet | CNextU-net\n|:-:|:-:|:-:|:-:|:-:|\n| `MHD_64`  | 0.3605 | 3561 |0.1798|$\\mathbf{0.1633}$|\n\nTable: VRMSE metrics on test sets (lower is better). Best results are shown in bold. VRMSE is scaled such that predicting the mean value of the target field results in a score of 1.\n\n## About the data\n\n**Dimension of discretized data:** 100 timesteps of 64 $\\times$ 64 $\\times$ 64 cubes.\n\n**Fields available in the data:** Density (scalar field), velocity (vector field), magnetic field (vector field).\n\n**Number of trajectories:** 10 Initial conditions x 10 combination of parameters = 100 trajectories.\n\n**Estimated size of the ensemble of all simulations:** 71.6 GB.\n\n**Grid type:** uniform grid, cartesian coordinates.\n\n**Initial conditions:** uniform IC.\n\n**Boundary conditions:** periodic boundary conditions.\n\n**Data are stored separated by ($\\Delta t$):** 0.01 (arbitrary units).\n\n**Total time range ($t\\_{min}$ to $t\\_{max}$):** $t\\_{min} = 0$, $t\\_{max} = 1$.\n\n**Spatial domain size ($L_x$, $L_y$, $L_z$):** dimensionless so 64 pixels.\n\n**Set of coefficients or non-dimensional parameters evaluated:** all combinations of $\\mathcal{M}_s=${0.5, 0.7, 1.5, 2.0 7.0} and $\\mathcal{M}_A =${0.7, 2.0}.\n\n**Approximate time and hardware used to generate the data:** Downsampled from `MHD_256` after applying ideal low-pass filter.\n\n## What is interesting and challenging about the data:\n\n**What phenomena of physical interest are catpured in the data:** MHD fluid flows in the compressible limit (sub and super sonic, sub and super Alfvenic).\n\n**How to evaluate a new simulator operating in this space:** Check metrics such as Power spectrum, two-points correlation function.\n\nPlease cite the associated paper if you use this data in your research:\n\n```\n@article{burkhart2020catalogue,\n  title={The catalogue for astrophysical turbulence simulations (cats)},\n  author={Burkhart, B and Appel, SM and Bialy, S and Cho, J and Christensen, AJ and Collins, D and Federrath, Christoph and Fielding, DB and Finkbeiner, D and Hill, AS and others},\n  journal={The Astrophysical Journal},\n  volume={905},\n  number={1},\n  pages={14},\n  year={2020},\n  publisher={IOP Publishing}\n}\n```\n","encoding":"utf8","key":"README.md","name":"README.md","size":4029,"truncated":false}],"sourceObjectKey":"data/test/MHD_Ma_0.7_Ms_0.5.hdf5","starterCell":"from huggingface_hub import hf_hub_download\npath = hf_hub_download(repo_id=\"polymathic-ai/MHD_64\", filename=\"data/test/MHD_Ma_0.7_Ms_0.5.hdf5\", repo_type=\"dataset\")\nprint(path)","starterSamplePath":"data/test/MHD_Ma_0.7_Ms_0.5.hdf5","totalObjects":39},"summary":"3D isothermal magnetohydrodynamic (MHD) turbulence without self-gravity, as in the diffuse interstellar medium, spanning subsonic to supersonic and sub-Alfvenic to super-Alfvenic…","title":"The Well: Compressible MHD Turbulence (64 Cubed)","updatedAt":"2026-11-14T02:35:53.603Z","visibility":"public","websiteUrl":"https://polymathic-ai.org/the_well/"}}