{"success":true,"data":{"author":"Michael J. Smith (UniverseTBD), from Multimodal Universe DESI and SDSS subsets","bucketAccessType":"public","bucketName":"Smith42/desi_sdss_crossmatched","bucketPrefix":"","category":"Astronomy & Space","cloudProvider":"huggingface","createdAt":"2026-11-16T14:11:26.955Z","description":"Paired optical spectra of the same objects observed by both the Dark Energy Spectroscopic Instrument (DESI, Early Data Release) and the Sloan Digital Sky Survey (SDSS/BOSS), cross-matched by sky position from the Multimodal Universe DESI EDR SV3 and SDSS subsets. Each of 13,794 rows holds a DESI spectrum (7,781 pixels: flux, inverse variance, line spread function width, wavelength and mask) and an SDSS spectrum with the same fields, the DESI redshift Z with ZERR and ZWARN, the SDSS redshift with Z_ERR, ZWARNING and velocity dispersion VDISP, SDSS spectro-photometric and synthetic ugriz fluxes with inverse variances, Legacy Surveys g, r, z total and fiber fluxes, and Galactic E(B-V). The data are Parquet shards under data/ (one train split, about 1.76 GB, measured 2026-11-16), loadable with Hugging Face datasets, pandas or pyarrow. Uses include cross-instrument spectral translation, testing spectrum foundation models for instrument invariance, and redshift calibration between surveys. DESI data are licensed CC-BY-4.0 and SDSS public data are in the public domain; the packager also tags the repository CC-BY-SA-4.0. Cite DESI EDR, SDSS and the Multimodal Universe paper (arXiv:2412.02527).","displayTitle":"Multimodal Universe DESI x SDSS Cross-Matched Spectra Pairs (13,794 Galaxies)","id":"cd0addff-3d3c-513f-96fa-b1f798e0bac0","license":"CC-BY-4.0","licenseEvidenceUrl":"https://data.desi.lbl.gov/doc/acknowledgments/","objectCountEstimate":9,"probeStatus":"ok","referenceUrl":"https://arxiv.org/abs/2412.02527","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"Smith42/desi_sdss_crossmatched\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"Smith42/desi_sdss_crossmatched\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=Smith42, license:cc-by-sa-4.0, size_categories:10K<n<100K, format:parquet, downloads=97"],"format":"mixed","generatedAt":"2026-11-16T14:11:35.242Z","layout":{"example":"data/train-00000-of-00006.parquet","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"50415231150415b83e15c23e4c15ce0f15001200009c1ff49b0fd42cbf4072c86740bc088e3f209f063f7fa3743f20bcd240d7664541ac69a7403b109740f15d8840b5221041793853414de61b422464c3405c4b07401158454144223941def80541690fbf413fb616411f94673ba01a28414504243dbb36c840dcad3741b9645641af019540e283433f1e3a9040c47eb8404fd62541c71caf41dc24e140347e654084693840f72c4e416ae181be84c501403ef02d4130c7cd3d67e40442f9420c3efa3f5d41b604bb40a631f440003a82414f8393415fe08a40f18e0341f7f28fbd1d067a402bb8cb409d78024113dc844177ec8941c2ed824154bba841368eeb40d724633eedd24c3e59d45441c551c54100899c41e570a041f04097407be36540c4c96b3f139c023f59ac2a4087cc67401d65ba40abfe0e41459e4241870c584117038142fd1aa93e2c4c1a4191fdae3eb662734016708f41ffb49541598d4341046264417377f34157e85c40c705683fc140af40403d3d3f91c727419e9a7a4132ef163fcd594ebd9a0c1d3f33d66840c9aadb3e0885ce3e76b01141fe256241df109041867a9d4126a0b040d03b5241e7189740a6f6124166bd87428d16134111ea124186926340e33ede403a728e40f0b69b409cd2504198129040ca7dcc4106afa43f64ed014110630342aa68f641539b8f40446f7240e84184402cb3","encoding":"hex","key":"data/train-00000-of-00006.parquet","truncatedAt":512}],"sampleObjects":["data/train-00000-of-00006.parquet","data/train-00001-of-00006.parquet","data/train-00002-of-00006.parquet","data/train-00003-of-00006.parquet","data/train-00004-of-00006.parquet"],"sidecars":[{"bytes":"---\nlicense: cc-by-sa-4.0\ndataset_info:\n  features:\n  - name: SPECTROFLUX_U\n    dtype: float32\n  - name: SPECTROSYNFLUX_I\n    dtype: float32\n  - name: Z_ERR\n    dtype: float32\n  - name: VDISP\n    dtype: float32\n  - name: FLUX_IVAR_Z\n    dtype: float32\n  - name: SPECTROSYNFLUX_IVAR_G\n    dtype: float32\n  - name: SPECTROSYNFLUX_IVAR_I\n    dtype: float32\n  - name: SPECTROFLUX_I\n    dtype: float32\n  - name: FIBERFLUX_G\n    dtype: float32\n  - name: sdss_Z\n    dtype: float32\n  - name: desi_Z\n    dtype: float32\n  - name: VDISP_ERR\n    dtype: float32\n  - name: FLUX_IVAR_G\n    dtype: float32\n  - name: SPECTROFLUX_IVAR_U\n    dtype: float32\n  - name: FLUX_R\n    dtype: float32\n  - name: SPECTROSYNFLUX_IVAR_R\n    dtype: float32\n  - name: SPECTROSYNFLUX_R\n    dtype: float32\n  - name: FIBERTOTFLUX_G\n    dtype: float32\n  - name: FIBERTOTFLUX_R\n    dtype: float32\n  - name: SPECTROSYNFLUX_G\n    dtype: float32\n  - name: SPECTROFLUX_IVAR_R\n    dtype: float32\n  - name: SPECTROFLUX_G\n    dtype: float32\n  - name: FLUX_Z\n    dtype: float32\n  - name: sdss_object_id\n    dtype: string\n  - name: desi_object_id\n    dtype: string\n  - name: FIBERFLUX_R\n    dtype: float32\n  - name: SPECTROSYNFLUX_IVAR_Z\n    dtype: float32\n  - name: SPECTROFLUX_IVAR_Z\n    dtype: float32\n  - name: SPECTROFLUX_IVAR_I\n    dtype: float32\n  - name: SPECTROSYNFLUX_IVAR_U\n    dtype: float32\n  - name: SPECTROFLUX_R\n    dtype: float32\n  - name: FLUX_IVAR_R\n    dtype: float32\n  - name: ZERR\n    dtype: float32\n  - name: FIBERTOTFLUX_Z\n    dtype: float32\n  - name: SPECTROFLUX_Z\n    dtype: float32\n  - name: SPECTROFLUX_IVAR_G\n    dtype: float32\n  - name: SPECTROSYNFLUX_Z\n    dtype: float32\n  - name: EBV\n    dtype: float32\n  - name: FLUX_G\n    dtype: float32\n  - name: ZWARN\n    dtype: bool\n  - name: ZWARNING\n    dtype: bool\n  - name: SPECTROSYNFLUX_U\n    dtype: float32\n  - name: FIBERFLUX_Z\n    dtype: float32\n  - name: sdss_spectrum\n    sequence:\n    - name: flux\n      dtype: float32\n    - name: ivar\n      dtype: float32\n    - name: lsf_sigma\n      dtype: float32\n    - name: lambda\n      dtype: float32\n    - name: mask\n      dtype: bool\n  - name: desi_spectrum\n    sequence:\n    - name: flux\n      dtype: float32\n    - name: ivar\n      dtype: float32\n    - name: lsf_sigma\n      dtype: float32\n    - name: lambda\n      dtype: float32\n    - name: mask\n      dtype: bool\n    length: 7781\n  splits:\n  - name: train\n    num_bytes: 2592884975\n    num_examples: 13794\n  download_size: 1762212984\n  dataset_size: 2592884975\nconfigs:\n- config_name: default\n  data_files:\n  - split: train\n    path: data/train-*\ntags:\n- astronomy\nsize_categories:\n- 10K<n<100K\n---\n<div align=\"center\">\n<img src=\"https://huggingface.co/datasets/Smith42/desi_sdss_crossmatched/resolve/main/im.png\" alt=\"samples\" width=\"100%\"/>\n</div>\n\n#  Crossmatched samples from the Multimodal Universe for DESI/SDSS\n\nMother paper here: [https://arxiv.org/abs/2412.02527](arxiv.org/abs/2412.02527)","encoding":"utf8","key":"README.md","name":"README.md","size":2928,"truncated":false}],"sourceObjectKey":"data/train-00000-of-00006.parquet","starterCell":"from datasets import load_dataset\nds = load_dataset(\"Smith42/desi_sdss_crossmatched\")\nprint(ds)","starterSamplePath":"data/train-00000-of-00006.parquet","totalObjects":9},"summary":"Paired optical spectra of the same objects observed by both the Dark Energy Spectroscopic Instrument (DESI, Early Data Release) and the Sloan Digital Sky Survey (SDSS/BOSS),…","title":"Multimodal Universe DESI x SDSS Cross-Matched Spectra Pairs (13,794 Galaxies)","updatedAt":"2026-11-16T15:45:10.112Z","visibility":"public","websiteUrl":"https://huggingface.co/datasets/Smith42/desi_sdss_crossmatched"}}