{"success":true,"data":{"author":"MosaicML / Databricks (Aaron Gokaslan et al.)","bucketAccessType":"public","bucketName":"common-canvas/commoncatalog-cc-by-sa","bucketPrefix":"","category":"Computer Vision","cloudProvider":"huggingface","createdAt":"2026-11-14T14:15:13.339Z","description":"This is the CC BY-SA partition of CommonCatalog, the openly licensed image-caption collection MosaicML built to train the CommonCanvas latent diffusion models (Gokaslan et al., arXiv:2310.16825). Like the CC BY partition, it draws on Yahoo Flickr Creative Commons 100M (YFCC100M) photographs uploaded by Flickr users around 2014, keeps only images under a ShareAlike Creative Commons licence that allows commercial use, and pairs each with a synthetic BLIP-2 caption. Parquet rows contain the JPEG bytes, the BLIP-2 caption, the Flickr title, user and machine tags, capture device, date taken, geolocation where present, original and stored image dimensions, Flickr page and download URLs, and the per-photo licensename and licenseurl, so derived works can carry correct attribution and share-alike notices. Images go up to 4K resolution. Measured 2026-11-14: ten top-level subsets (0 to 9), each partitioned by least_dim_range and aspect_ratio_bucket folders of Parquet files; the Hub reports about 13.6 TB of storage. Read with pyarrow, pandas or the datasets library in streaming mode. Uses: text-to-image diffusion training, image captioning, provenance and attribution studies. Every image is under a CC BY-SA licence from its Flickr author; attribute the photographer and share adaptations alike.","displayTitle":"CommonCatalog CC-BY-SA: Flickr ShareAlike images with synthetic captions","id":"a83d871f-51c9-591d-8bda-533698bda6a4","license":"CC-BY-SA-4.0","licenseEvidenceUrl":"https://huggingface.co/datasets/common-canvas/commoncatalog-cc-by-sa","objectCountEstimate":4131,"probeStatus":"ok","referenceUrl":"https://arxiv.org/abs/2310.16825","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"common-canvas/commoncatalog-cc-by-sa\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"common-canvas/commoncatalog-cc-by-sa\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=common-canvas, license:cc-by-sa-4.0, size_categories:1M<n<10M, format:parquet, downloads=25995"],"format":"mixed","generatedAt":"2026-11-14T14:15:20.181Z","layout":{"example":"0/least_dim_range=1024-2048/aspect_ratio_bucket=1-1/part-00000-tid-7761264679195244086-4c6ec9dc-fb3d-4bd3-98ec-f987466013dd-3488916-1-c000.parquet","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"50415231150015de0e15de0e15a3d6c5bf0d1c15ea01150015061508000003000000ea01015f4d4c1b00000000568fde00000000005556f8110000000078c9660b000000004d91eb0500000000eacade080000000009acfb06000000007cd73d1b00000000029a8d0000000000cec4cf09000000006587e5150000000048b92a1c00000000c26c280f00000000ed29f81100000000743b3d050000000026f25d03000000006fc856000000000053cb2801000000008499991100000000c638b71c000000000710ca10000000001a29900000000000f597a202000000008e6ea11900000000125bad1a00000000e52aa600000000002b06660000000000eeb0be160000000038c856000000000083bc4414000000003b9e971500000000d01a7f04000000008bdade1700000000c17edc12000000000390b901000000000d974905000000002f31f61100000000506f3604000000007213290b000000005bfec714000000001b0e250300000000d4d0f711000000000c0b9814000000004c095400000000004136410100000000b2b5f61100000000aab053000000000030878b16000000009630f40200000000a9ce7e10000000006c4a6a1000000000a52a900000000000f1895f15000000007bec4a02000000006867290f000000001d9ba30000000000f316990000000000f4420a0100000000f2a37313000000002dd97e","encoding":"hex","key":"0/least_dim_range=1024-2048/aspect_ratio_bucket=1-1/part-00000-tid-7761264679195244086-4c6ec9dc-fb3d-4bd3-98ec-f987466013dd-3488916-1-c000.parquet","truncatedAt":512}],"sampleObjects":["0/least_dim_range=1024-2048/aspect_ratio_bucket=1-1/part-00000-tid-7761264679195244086-4c6ec9dc-fb3d-4bd3-98ec-f987466013dd-3488916-1-c000.parquet","0/least_dim_range=1024-2048/aspect_ratio_bucket=1-2/part-00000-tid-1022232915236154389-d5cd4b58-1ac9-4eaf-b907-8a281144ae77-5057851-1-c000.parquet","0/least_dim_range=1024-2048/aspect_ratio_bucket=11-21/part-00000-tid-1204112698477760368-1894ff1b-6a48-433e-9e47-0a855a7f3ddf-4582970-1-c000.parquet","0/least_dim_range=1024-2048/aspect_ratio_bucket=13-18/part-00000-tid-4147550586390514142-ceee28b8-e82c-4531-988d-348a8b0ab0e3-910684-1-c000.parquet","0/least_dim_range=1024-2048/aspect_ratio_bucket=13-18/part-00001-tid-4147550586390514142-ceee28b8-e82c-4531-988d-348a8b0ab0e3-910682-1-c000.parquet"],"sidecars":[{"bytes":"---\nlicense: cc-by-sa-4.0\ndataset_info:\n  features:\n    - name: jpg\n      dtype: image\n    - name: blip2_caption\n      dtype: string\n    - name: caption\n      dtype: string\n    - name: licensename\n      dtype: string\n    - name: licenseurl\n      dtype: string\n    - name: width\n      dtype: int32\n    - name: height\n      dtype: int32\n    - name: original_width\n      dtype: int32\n    - name: original_height\n      dtype: int32\n    - name: photoid\n      dtype: int64\n    - name: uid\n      dtype: string\n    - name: unickname\n      dtype: string\n    - name: datetaken\n      dtype: timestamp[us]\n    - name: dateuploaded\n      dtype: int64\n    - name: capturedevice\n      dtype: string\n    - name: title\n      dtype: string\n    - name: usertags\n      dtype: string\n    - name: machinetags\n      dtype: string\n    - name: longitude\n      dtype: float64\n    - name: latitude\n      dtype: float64\n    - name: accuracy\n      dtype: int64\n    - name: pageurl\n      dtype: string\n    - name: downloadurl\n      dtype: string\n    - name: serverid\n      dtype: int64\n    - name: farmid\n      dtype: int64\n    - name: secret\n      dtype: string\n    - name: secretoriginal\n      dtype: string\n    - name: ext\n      dtype: string\n    - name: url\n      dtype: string\n    - name: key\n      dtype: string\n    - name: status\n      dtype: string\n    - name: error_message\n      dtype: string\n    - name: exif\n      dtype: string\n    - name: sha256\n      dtype: string\n    - name: description\n      dtype: string\ntask_categories:\n  - text-to-image\nlanguage:\n  - en\n---\n# Dataset Card for CommonCatalog CC-BY-SA\n\nThis dataset is a large collection of high-resolution Creative Common images (composed of different licenses, see paper Table 1 in the Appendix) collected in 2014 from users of Yahoo Flickr. \nThe dataset contains images of up to 4k resolution, making this one of the highest resolution captioned image datasets.\n \n## Dataset Details\n\n### Dataset Description\n\nWe provide captions synthetic captions to approximately 100 million high resolution images collected from Yahoo Flickr Creative Commons (YFCC).\n\n- **Curated by:** Aaron Gokaslan \n- **Language(s) (NLP):** en\n- **License:** See relevant yaml tag / dataset name.\n\n### Dataset Sources\n\n<!-- Provide the basic links for the dataset. -->\n\n- **Repository:** https://github.com/mosaicml/diffusion  \n- **Paper:** https://arxiv.org/abs/2310.16825\n- **Demo:** See CommonCanvas Gradios\n\n## Uses\n\nWe use CommonCatalog to train a family latent diffusion models called CommonCanvas.\nThe goal is to produce a model that is competitive with Stable Diffusion 2, but to do so using an easily accessible dataset of known provenance. \nDoing so makes replicating the model significantly easier, and provides a clearer mechanism for applying training-data attribution techniques. \n\n\n### Direct Use\n\nTraining text-to-image models\nTraining image-to-text models\n\n\n### Out-of-Scope Use\n\n<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->\n\n* Crafting content that is offensive or injurious towards individuals, including negative portrayals of their living conditions, cultural backgrounds, religious beliefs, etc.\n* Deliberately creating or spreading content that is discriminatory or reinforces harmful stereotypes.\n* Falsely representing individuals without their permission.\n* Generating sexual content that may be seen by individuals without their consent.\n* Producing or disseminating false or misleading information.\n* Creating content that depicts extreme violence or bloodshed.\n* Distributing content that modifies copyrighted or licensed material in a way that breaches its usage terms.\n\n## Dataset Structure\n\nThe dataset is divided into 10 subsets each containing parquets about 4GB each. Each subfolder within contains a resolution range of the images and their respective aspect ratios.\nThe dataset is also divided along images licensed for commercial use (C) and those that are not (NC).\n\n## Dataset Creation\n\n### Curation Rationale\n\nCreating a standardized, accessible dataset with synthetic caption and ","encoding":"utf8","key":"README.md","name":"README.md","size":5528,"truncated":true}],"sourceObjectKey":"0/least_dim_range=1024-2048/aspect_ratio_bucket=1-1/part-00000-tid-7761264679195244086-4c6ec9dc-fb3d-4bd3-98ec-f987466013dd-3488916-1-c000.parquet","starterCell":"from datasets import load_dataset\nds = load_dataset(\"common-canvas/commoncatalog-cc-by-sa\")\nprint(ds)","starterSamplePath":"0/least_dim_range=1024-2048/aspect_ratio_bucket=1-1/part-00000-tid-7761264679195244086-4c6ec9dc-fb3d-4bd3-98ec-f987466013dd-3488916-1-c000.parquet","totalObjects":4131},"summary":"This is the CC BY-SA partition of CommonCatalog, the openly licensed image-caption collection MosaicML built to train the CommonCanvas latent diffusion models (Gokaslan et al.,…","title":"CommonCatalog CC-BY-SA: Flickr ShareAlike images with synthetic captions","updatedAt":"2026-11-14T17:34:14.351Z","visibility":"public","websiteUrl":"https://github.com/mosaicml/diffusion"}}