{"success":true,"data":{"author":"Jigsaw and Google (Borkan et al.); Civil Comments platform","bucketAccessType":"public","bucketName":"google/civil_comments","bucketPrefix":"","category":"Natural Language Processing","cloudProvider":"huggingface","createdAt":"2026-11-22T01:09:15.576Z","description":"Civil Comments holds about two million public comments posted between 2015 and 2017 on roughly 50 English-language news sites that used the Civil Comments commenting plugin. When the platform shut down in 2017 it released the comment text as an open archive for research, and Jigsaw (Google) added crowd-sourced labels: a toxicity score for each comment (the fraction of raters who judged it toxic) plus sub-attributes such as severe toxicity, obscene, threat, insult, identity attack and sexually explicit. This is the data released for the Jigsaw Unintended Bias in Toxicity Classification challenge, widely used to study hate speech and abusive language detection, online harassment, content moderation and bias against identity groups in text classifiers. Splits: 1,804,874 training, 97,320 validation and 97,320 test comments, stored as four Parquet files (about 420 MB) under data/. Load with the Hugging Face datasets library (load_dataset('google/civil_comments')) or pandas. Released under CC0 1.0, as is the underlying comment text; cite Borkan et al., Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification, WWW 2019 Companion.","displayTitle":"Civil Comments: 2 Million Public News-Site Comments with Crowd-Rated Toxicity and Identity-Mention Labels (Jigsaw, Google)","huggingFaceUrl":"https://huggingface.co/datasets/google/civil_comments","id":"cc30b74d-53e7-567e-b843-812316d309ed","license":"CC0-1.0","licenseEvidenceUrl":"https://huggingface.co/datasets/google/civil_comments","objectCountEstimate":6,"probeStatus":"ok","referenceUrl":"https://arxiv.org/abs/1903.04561","region":"us","schemaCard":{"accessHints":[{"language":"python-datasets","snippet":"from datasets import load_dataset\nds = load_dataset(\"google/civil_comments\")"},{"language":"python-hub","snippet":"from huggingface_hub import snapshot_download\nsnapshot_download(repo_id=\"google/civil_comments\", repo_type=\"dataset\")"}],"caveats":["HuggingFace metadata: author=google, license:cc0-1.0, size_categories:1M<n<10M, format:parquet, downloads=17737"],"format":"mixed","generatedAt":"2026-11-22T01:10:10.169Z","layout":{"example":"data/test-00000-of-00001.parquet","pattern":"{repoId}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"504152311504158c90251592ad194c15d00f150012000086c812f42001540000005b20496e74656772697479206d65616e73207468617420796f752070617920796f75722064656274732e5d0a0a446f65732074686973206170706c7920746f20507265736964656e74205472756d7020746f6f3f5400000054686973206973206d616c66656173616e6365206279207468652041646d696e6973747261746f7220616e642074686520426f6172642e202054686579206172652077617374696e67206f7572206d6f6e657921c800000040526d696c6c6572313031202d2053706f6b656e206c696b652061207472756520656c69746973742e20427574206c6f6f6b206f7574206275642e205468652072652d6177616b656e696e6720696e204575726f70652c2042726578697420616e64206e6f772074686520547201d13c766963746f727920617265206a75737405c320626567696e6e696e67095538756e776173686564206d6173736573052c24636f6d696e6720666f72254d08616e6401085c7220696c6be280a62ee10300005061756c3a205468616e6b011c112cc072206b696e6420776f7264732e20204920646f2c20696e646565642c2068617665207374726f6e672062656c6965667320015c24646f6e2774206869646501a1106d2e2020543149446261736564206f6e20626f74682066616374093310","encoding":"hex","key":"data/test-00000-of-00001.parquet","truncatedAt":512}],"sampleObjects":["data/test-00000-of-00001.parquet","data/train-00000-of-00002.parquet","data/train-00001-of-00002.parquet","data/validation-00000-of-00001.parquet"],"sidecars":[{"bytes":"---\nlanguage:\n- en\nlicense: cc0-1.0\npaperswithcode_id: civil-comments\npretty_name: Civil Comments\ntags:\n- toxic-comment-classification\ntask_categories:\n- text-classification\ntask_ids:\n- multi-label-classification\ndataset_info:\n  features:\n  - name: text\n    dtype: string\n  - name: toxicity\n    dtype: float32\n  - name: severe_toxicity\n    dtype: float32\n  - name: obscene\n    dtype: float32\n  - name: threat\n    dtype: float32\n  - name: insult\n    dtype: float32\n  - name: identity_attack\n    dtype: float32\n  - name: sexual_explicit\n    dtype: float32\n  splits:\n  - name: train\n    num_bytes: 594805164\n    num_examples: 1804874\n  - name: validation\n    num_bytes: 32216880\n    num_examples: 97320\n  - name: test\n    num_bytes: 31963524\n    num_examples: 97320\n  download_size: 422061071\n  dataset_size: 658985568\nconfigs:\n- config_name: default\n  data_files:\n  - split: train\n    path: data/train-*\n  - split: validation\n    path: data/validation-*\n  - split: test\n    path: data/test-*\n---\n\n# Dataset Card for \"civil_comments\"\n\n## Table of Contents\n- [Dataset Description](#dataset-description)\n  - [Dataset Summary](#dataset-summary)\n  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)\n  - [Languages](#languages)\n- [Dataset Structure](#dataset-structure)\n  - [Data Instances](#data-instances)\n  - [Data Fields](#data-fields)\n  - [Data Splits](#data-splits)\n- [Dataset Creation](#dataset-creation)\n  - [Curation Rationale](#curation-rationale)\n  - [Source Data](#source-data)\n  - [Annotations](#annotations)\n  - [Personal and Sensitive Information](#personal-and-sensitive-information)\n- [Considerations for Using the Data](#considerations-for-using-the-data)\n  - [Social Impact of Dataset](#social-impact-of-dataset)\n  - [Discussion of Biases](#discussion-of-biases)\n  - [Other Known Limitations](#other-known-limitations)\n- [Additional Information](#additional-information)\n  - [Dataset Curators](#dataset-curators)\n  - [Licensing Information](#licensing-information)\n  - [Citation Information](#citation-information)\n  - [Contributions](#contributions)\n\n## Dataset Description\n\n- **Homepage:** [https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data](https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data)\n- **Repository:** https://github.com/conversationai/unintended-ml-bias-analysis\n- **Paper:** https://arxiv.org/abs/1903.04561\n- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)\n- **Size of downloaded dataset files:** 414.95 MB\n- **Size of the generated dataset:** 661.23 MB\n- **Total amount of disk used:** 1.08 GB\n\n### Dataset Summary\n\nThe comments in this dataset come from an archive of the Civil Comments\nplatform, a commenting plugin for independent news sites. These public comments\nwere created from 2015 - 2017 and appeared on approximately 50 English-language\nnews sites across the world. When Civil Comments shut down in 2017, they chose\nto make the public comments available in a lasting open archive to enable future\nresearch. The original data, published on figshare, includes the public comment\ntext, some associated metadata such as article IDs, timestamps and\ncommenter-generated \"civility\" labels, but does not include user ids. Jigsaw\nextended this dataset by adding additional labels for toxicity and identity\nmentions. This data set is an exact replica of the data released for the\nJigsaw Unintended Bias in Toxicity Classification Kaggle challenge.  This\ndataset is released under CC0, as is the underlying comment text.\n\n### Supported Tasks and Leaderboards\n\n[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)\n\n### Languages\n\n[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)\n\n## Dataset Structure\n\n### Data Instances\n\n#### default\n\n- **Size of downloaded dataset files:** 414.95 MB\n- **Size of the generated data","encoding":"utf8","key":"README.md","name":"README.md","size":7734,"truncated":true}],"sourceObjectKey":"data/test-00000-of-00001.parquet","starterCell":"from datasets import load_dataset\nds = load_dataset(\"google/civil_comments\")\nprint(ds)","starterSamplePath":"data/test-00000-of-00001.parquet","totalObjects":6},"summary":"Civil Comments holds about two million public comments posted between 2015 and 2017 on roughly 50 English-language news sites that used the Civil Comments commenting plugin.","title":"Civil Comments: 2 Million Public News-Site Comments with Crowd-Rated Toxicity and Identity-Mention Labels (Jigsaw, Google)","updatedAt":"2026-11-22T04:01:41.648Z","visibility":"public","websiteUrl":"https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification"}}