{"success":true,"data":{"author":"Allen Institute for AI and UC Irvine (Dua, Wang, Dasigi, Stanovsky, Singh, Gardner)","bucketAccessType":"public","bucketListable":true,"bucketName":"ai2-public-datasets","bucketPrefix":"drop","category":"Natural Language Processing","cloudProvider":"aws","createdAt":"2026-11-22T01:11:45.364Z","description":"DROP (Discrete Reasoning Over the content of Paragraphs) is an English reading comprehension benchmark in which a system must resolve references in a passage and then perform discrete operations over them, such as addition, subtraction, counting, comparison and sorting, to answer a question. The questions were written by crowd workers against baseline models. The folder holds drop_dataset.zip (8.3 MB) with drop_dataset_train.json, drop_dataset_dev.json and license.txt. Each JSON file maps a passage id to the passage text and its question-answer pairs; an answer is a number, a date or one or more text spans. The standard metrics are exact match and a numeracy-aware F1, implemented in the AllenNLP drop_eval script. DROP is a common evaluation for numerical reasoning in language models and is part of several LLM evaluation suites. Load the JSON with Python's json module, or through Hugging Face datasets and TensorFlow Datasets loaders. License: CC BY-SA 4.0, stated in the license.txt shipped inside the archive. Cite Dua et al., DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs (NAACL 2019).","displayTitle":"DROP: Discrete Reasoning Over Paragraphs Reading Comprehension Benchmark, Questions Requiring Addition, Counting and Sorting (Allen Institute for AI)","fuseMountBrowsable":true,"id":"b10bc8de-ed02-5e7d-9eed-5b16d76d9b4a","license":"CC-BY-SA-4.0","licenseEvidenceUrl":"https://ai2-public-datasets.s3.amazonaws.com/drop/drop_dataset.zip","probeStatus":"ok","region":"us-west-2","schemaCard":{"accessHints":[{"language":"python-anonymous","snippet":"import boto3\nfrom botocore import UNSIGNED\nfrom botocore.client import Config\ns3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))\ns3.list_objects_v2(Bucket='ai2-public-datasets', Prefix='drop/', Delimiter='/')"},{"language":"python-local","snippet":"open('/mnt/archive/drop_dataset.zip', 'rb')"}],"caveats":["Bucket has a flat key structure (no prefix folders). Avoid unbounded LIST — page with ContinuationToken or filter by key prefix.","Files are binary — use a domain-specific parser (e.g. metpy / pynexrad / pydicom) rather than text I/O."],"format":"binary","generatedAt":"2026-11-22T01:11:50.190Z","layout":{"example":"drop/drop_dataset.zip","pattern":"{id}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"504b03041400000008000d49ba4ec4f78fe9cb5d100057acd1002200000064726f705f646174617365742f64726f705f646174617365745f6465762e6a736f6eec5d5b93dc36767e4f55fe034a2f4aaa066312042fd8979425d96b6bedd89155d143e252e1c66966d8642fc9d678ecca7f0f0ec8beb0d93dec1db27b3743e241a5c19cc1e53b071f0e4000e78f7ffe2764d2ab2c4e3fbb6e445ffd09fd5167d9ec152f4b7ea74dee2bf45dbe4ab23b54e5a8d0225f670ac545be44d54227054af3b2845f999fd0cfbc2a92bc2a6fec4f1f78a27451a2b2e28f5a215ea145bed428ce0bc4d127adef911b20b5d6297a48aa85fd93eff27559e519faa87fe359798bd04ffc3ee5a6c2877c9d2a74a72b2ba679913ea254738592cce6c4495156e8af6b5e54da145f6efe2bb8bc47eff98fbc90eb127d5897a54e5324f3e52ad515340a11073ff242992eace542e50f1982aedbcee6f97da24de394361d973af9628a7ebbe0bfa35fe42249b56de0475379dddaa68d852e5739b418fa14afd3d436e13ff3ace2e807cde5027a51019e1cb9875517ebec063d36bddce057976b6a7830f5db62ef13796ffeff8b16bcac129e991e66c97dfe50de277ba57b5e5d3ce0677e6afa19271a90cc796a5abfc1bbaea232bd858aefb85153036ca925f46683ec7ef57f299212bd29a0ddbb4afd56a584762b6dabb4e2f775a5fbdaac164971","encoding":"hex","key":"drop/drop_dataset.zip","truncatedAt":512}],"sampleObjects":["drop/drop_dataset.zip"],"sourceObjectKey":"drop/drop_dataset.zip","starterCell":"with open('/mnt/archive/drop_dataset.zip', 'rb') as fh:\n    head = fh.read(1024)\nprint(len(head), head[:64])","starterSamplePath":"drop_dataset.zip","totalObjects":"flat keyspace (count unknown from bounded probe)"},"summary":"DROP (Discrete Reasoning Over the content of Paragraphs) is an English reading comprehension benchmark in which a system must resolve references in a passage and then perform…","title":"DROP: Discrete Reasoning Over Paragraphs Reading Comprehension Benchmark, Questions Requiring Addition, Counting and Sorting (Allen Institute for AI)","updatedAt":"2026-11-22T04:02:06.826Z","visibility":"public","websiteUrl":"https://allenai.org/data"}}