{"success":true,"data":{"author":"Polymathic AI (The Well); Keiya Hirashima, University of Tokyo and Flatiron Institute CCA","bucketAccessType":"public","bucketName":"polymathic-ai/turbulence_gravity_cooling","bucketPrefix":"","category":"Physics","cloudProvider":"huggingface","createdAt":"2026-11-14T01:01:19.115Z","description":"3D simulations of a turbulent, self-gravitating fluid modelling the interstellar medium (ISM) of galaxies at different evolutionary stages, where dense filaments form that go on to make stars. The hydrodynamics with gravity and radiative heating and cooling is solved with ASURA-FDPS smoothed particle hydrodynamics (SPH) and gridded to 64 by 64 by 64 cubes over 50 time steps, spanning one free-fall time. Fields are pressure, density, temperature and velocity. The datasheet lists 2,700 trajectories: 27 parameter sets (initial temperature 10, 100 or 1000 K; hydrogen number density 44.5, 4.45 or 0.445 per cc; metallicity Z0, 0.1 Z0 or 0) times 100 runs, with open boundaries. Listing data/ (measured 2026-11-13) shows train/ (27 files, 680 GB, one 25.2 GB file per parameter set), valid/ and test/ (27 files, 85.8 GB each); about 852 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.","displayTitle":"The Well: Turbulence with Gravity and Radiative Cooling in the Interstellar Medium","id":"bc47f4d1-24b2-5a50-98f1-de02ca8f1b6c","license":"CC-BY-4.0","licenseEvidenceUrl":"https://arxiv.org/html/2412.00568","objectCountEstimate":90,"probeStatus":"ok","referenceUrl":"https://arxiv.org/abs/2412.00568","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"polymathic-ai/turbulence_gravity_cooling\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"polymathic-ai/turbulence_gravity_cooling\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=polymathic-ai, license:cc-by-4.0, downloads=1619"],"format":"mixed","generatedAt":"2026-11-14T01:01:20.576Z","layout":{"example":"data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"894844460d0a1a0a0208080000000000000000003000000000000000000080bd00000000680000000000000014a17d68010001000100000028000000000000001700200014000000010100010000000000000000008000000000000000ffffffffffffffff00000001000a000100000018000000000000001000100000000000280300000000000080020000000000005452454500000100ffffffffffffffffffffffffffffffff0000000000000000680800000000000058000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","encoding":"hex","key":"data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5","truncatedAt":512}],"sampleObjects":["data/stats.yaml","data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5","data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_100.hdf5","data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_1000.hdf5","data/test/turbulence_gravity_cooling_rho0_0.445_Z_0_T0_10.hdf5"],"sidecars":[{"bytes":"---\nlanguage:\n- en\nlicense: cc-by-4.0\ntags:\n- physics\n\ntask_categories:\n- time-series-forecasting\n- other\ntask_ids:\n- multivariate-time-series-forecasting\n---\n\nThis Dataset is part of [The Well Collection](https://huggingface.co/papers/2412.00568).\n\n# How To Load from HuggingFace Hub\n\n1. Be sure to have `the_well` installed (`pip install the_well`)\n2. Use the `WellDataModule` to retrieve data as follows:\n\n```python\nfrom the_well.data import WellDataModule\n\n# The following line may take a couple of minutes to instantiate the datamodule\ndatamodule = WellDataModule(\n    \"hf://datasets/polymathic-ai/\",\n    \"turbulence_gravity_cooling\",\n)\ntrain_dataloader = datamodule.train_dataloader()\n\nfor batch in dataloader:\n    # Process training batch\n    ...\n```\n\n# Turbulent Interstellar Medium in Galaxies\n\n**One line description of the data:**  Turbulence in an interstellar medium in various evolution stages of galaxies.\n\n**Longer description of the data:**  These simulations are a turbulent fluid with gravity modeling interstellar medium in galaxies. These fluids make dense filaments, which will form new stars. The timescale and frequency of making new filaments are varied depending on the strength of cooling. It is parametrized by the amount of metal (metallicity), density, and temperature.\n\n**Associated paper**: [Paper](https://academic.oup.com/mnras/article/526/3/4054/7316686).\n\n**Domain expert**: [Keiya Hirashima](https://kyafuk.github.io/utokyo-hirashima/index.html), University of Tokyo & CCA, Flatiron Institute.\n\n**Code or software used to generate the data**: ASURA-FDPS (Smoothed Particle Hydrodynamics), [Github repository](https://github.com/FDPS/FDPS).\n\n**Equation**:\n\n$$\n\\begin{align*}\nP&=(\\gamma-1) \\rho u \\\\\n\\frac{d \\rho}{dt} &= -\\rho \\nabla \\cdot \\mathbf{v} \\\\\n\\frac{d^2 \\mathbf{r}}{dt^2}  &= -\\frac{\\nabla P}{\\rho} + \\mathbf{a}_{\\rm visc}-\\nabla \\Phi \\\\\n\\frac{d u}{dt} &= -\\frac{P}{\\rho} \\nabla \\cdot \\mathbf{v} + \\frac{\\Gamma-\\Lambda}{\\rho}\n\\end{align*}\n$$\n\nwhere \\\\(P\\\\), \\\\(\\rho\\\\), and \\\\(u\\\\) are the pressure. \\\\(r\\\\) is the position, \\\\(a_{\\rm visc}\\\\) is the acceleration generated by the viscosity, \\\\(\\Phi\\\\) is the gravitational potential, \\\\(\\Gamma\\\\) is the radiative heat influx per unit volume, and \\\\(\\Lambda\\\\) is the radiative heat outflux per unit volume.\n\n![Gif](https://users.flatironinstitute.org/~polymathic/data/the_well/datasets/turbulence_gravity_cooling/gif/temperature_normalized.gif)\n\n| Dataset    | FNO | TFNO  | Unet | CNextU-net\n|:-:|:-:|:-:|:-:|:-:|\n| `turbulence_gravity_cooling` | 0.2429 |0.2673| 0.6753 |\\\\(\\mathbf{0.2096}\\\\) |\n\nTable: VRMSE metrics on test sets (lower is better). Best results are shown in bold. VRMSE is scaled such that predicting the mean value of the target field results in a score of 1.\n\n## About the data\n\n**Dimension of discretized data:** 50 time-steps of  64 \\\\(\\times\\\\) 64 \\\\(\\times\\\\) 64 cubes.\n\n**Fields available in the data:** Pressure (scalar field), density (scalar field), temperature (scalar field), velocity (tensor field).\n\n**Number of trajectories:** 2700 (27 parameters sets \\\\(\\times\\\\) 100 runs).\n\n**Estimated size of the ensemble of all simulations:** 829.4 GB.\n\n**Grid type:** uniform, cartesian coordinates.\n\n**Initial conditions:** 2700 random seeds generated using https://github.com/amusecode/amuse/blob/main/src/amuse/ext/molecular_cloud.py (Virialized isothermal gas sphere with turbulence following the velocity spectrum \\\\(E(k) \\propto k^{-2}\\\\), which is Burgers turbulence (Burgers 1948 and Kupilas+2021 for reference)).\n\n**Boundary conditions:** open.\n\n**Simulation time-step:** \\\\(2,000\\\\) ~ \\\\(10,000\\\\) years (variable timesteps).\n\n**Data are stored separated by ( \\\\(\\Delta t\\\\)):** 0.02 free fall time.\n\n**Total time range ( \\\\(t_{min}\\\\) to \\\\(t_{max}\\\\)):** 1 Free Fall time (= \\\\(L^3/GM\\\\) ); \\\\(L=(\\rho / \\rho_0)^{1/3} \\times 60\\\\) pc, \\\\(\\rho_0=44.5/\\rm{cc}\\\\), \\\\(M=1,000,000\\\\) M \\\\(_\\odot\\\\).\n\n\n**Spatial domain size ( \\\\(L_x\\\\), \\\\(L_y\\\\), \\\\(L_z\\\\)):**\n\n|           | Domain Length ( \\\\(L\\\\)) | Free Fall Time | Snapshot ( \\\\(\\delta t\\\\)) |\n|----------|:-----","encoding":"utf8","key":"README.md","name":"README.md","size":7747,"truncated":true}],"sourceObjectKey":"data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5","starterCell":"from huggingface_hub import hf_hub_download\npath = hf_hub_download(repo_id=\"polymathic-ai/turbulence_gravity_cooling\", filename=\"data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5\", repo_type=\"dataset\")\nprint(path)","starterSamplePath":"data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5","totalObjects":90},"summary":"3D simulations of a turbulent, self-gravitating fluid modelling the interstellar medium (ISM) of galaxies at different evolutionary stages, where dense filaments form that go on…","title":"The Well: Turbulence with Gravity and Radiative Cooling in the Interstellar Medium","updatedAt":"2026-11-14T02:36:09.653Z","visibility":"public","websiteUrl":"https://polymathic-ai.org/the_well/"}}