{"success":true,"data":{"author":"Library of Congress Computing Cultural Heritage (Huang and Lee 2025); embeddings by Mahowald (2024)","bucketAccessType":"public","bucketListable":true,"bucketName":"us-east-2.opendata.source.coop","bucketPrefix":"l4cch/loc-maps-clip","category":"Machine Learning & AI","cloudProvider":"aws","createdAt":"2026-11-17T14:12:23.219Z","description":"One CLIP ViT-B/32 image embedding for each of 562,842 scanned map sheets in the Library of Congress Geography and Map Division, from 56,525 catalog items. 78% are Sanborn fire insurance maps of American towns; the rest are city views, atlases, charts and other maps, nine in ten dated 1862 to 1955. data/embeddings/embeddings.pt is a PyTorch float32 tensor of 562,842 x 512 L2-normalized vectors; item_ids.pt lists each sheet's IIIF identifier in vector order; metadata.json gives each sheet's IIIF image service, thumbnail and full-size request URLs, its loc.gov record and its title and date. Images are not included and can be fetched at any size from tile.loc.gov. It is the index behind the Digital Collections Explorer for text-to-image and image-to-image search of historical cartography. Load with torch.load and search with cosine similarity. Licensed CC BY 4.0 (the Zenodo embeddings record); cite Huang and Lee (2025), Computational Humanities Research 1:e14, and Mahowald (2024), doi:10.5281/zenodo.11538437.","displayTitle":"CLIP Embeddings of 562,842 Library of Congress Historical Map Sheets (Sanborn maps, atlases, city views)","doi":"10.5281/zenodo.11538437","fuseMountBrowsable":true,"id":"6677ae2d-0704-5450-b3ba-582cafff8f43","license":"CC-BY-4.0","licenseEvidenceUrl":"https://zenodo.org/records/11538437","objectCountEstimate":1,"probeStatus":"ok","referenceUrl":"https://doi.org/10.1017/chr.2025.10017","region":"us-east-2","schemaCard":{"accessHints":[{"language":"python-anonymous","snippet":"import boto3\nfrom botocore import UNSIGNED\nfrom botocore.client import Config\ns3 = boto3.client('s3', region_name='us-east-2', config=Config(signature_version=UNSIGNED))\ns3.list_objects_v2(Bucket='us-east-2.opendata.source.coop', Prefix='l4cch/loc-maps-clip/', Delimiter='/')"},{"language":"python-local","snippet":"open('/mnt/archive/data/embeddings/embeddings.pt', 'rb')"}],"caveats":["Files are binary — use a domain-specific parser (e.g. metpy / pynexrad / pydicom) rather than text I/O."],"format":"binary","generatedAt":"2026-11-17T14:24:44.588Z","layout":{"example":"l4cch/loc-maps-clip/data/embeddings/embeddings.pt","pattern":"{id}/{seg1}/{seg2}/{seg3}/{filename}"},"mountPath":"/mnt/archive","sampleHeaders":[{"bytes":"504b03040000080800000000000000000000000000000000000018000a006265746f5f6e6f726d616c697a65642f646174612e706b6c464206005a5a5a5a5a5a800263746f7263682e5f7574696c730a5f72656275696c645f74656e736f725f76320a71002828580700000073746f72616765710163746f7263680a466c6f617453746f726167650a71025801000000307103580300000063707571044a00342d11747105514b004a9a9608004d00028671064d00024b018671078963636f6c6c656374696f6e730a4f726465726564446963740a71082952710974710a52710b2e504b0708b1005b49a2000000a2000000504b030400000808000000000000000000000000000000000000190017006265746f5f6e6f726d616c697a65642f627974656f72646572464213005a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a6c6974746c65504b0708853de3190600000006000000504b030400000808000000000000000000000000000000000000160036006265746f5f6e6f726d616c697a65642f646174612f30464232005a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5a5aaab6efbc8392183d481724ba4bbee3bab254033c677d3b3ce26cfbbcf0024e3dedb32c3d0186a93c547fb03c8b662abd4605b43cb86d8d3c6f636a3bb2097dbd","encoding":"hex","key":"l4cch/loc-maps-clip/data/embeddings/embeddings.pt","truncatedAt":512},{"bytes":"504b030400000808000000000000000000000000000000000000110011006974656d5f6964732f646174612e706b6c46420d005a5a5a5a5a5a5a5a5a5a5a5a5a80025d710028584c00000063325679646d6c6a5a54706e625751365a32316b4e44417a6254706e4e44417a4d5730365a7a51774d7a46776254706e593351774d4459774f4638774d44493659334d774d446b334e7a513d7101586400000063325679646d6c6a5a54706e625751365a32316b4d7a6b326254706e4d7a6b324e4730365a7a4d354e6a526a6254706e4d7a6b324e474e74583263774f4449354d5445354d7a41774d7a6f774f4449354d5638774d3138784f544d774c5441324e44553d7102586400000063325679646d6c6a5a54706e625751365a32316b4e444d326254706e4e444d324e4730365a7a517a4e6a527a6254706e4e444d324e484e74583263774d4467784d7a45344f546b774e446f774d4467784d3138774e4638784f446b354c5441304d44633d7103585000000063325679646d6c6a5a54706e625751365a32316b6332563062574677637a6f794d446f794d6a6f314f546f774f546f774d446f794d4449794e546b774f5441774f6d4e7a4d4441784d44597863673d3d7104584800000063325679646d6c6a5a54706e625751365a32316b4e444d336254706e4e444d334d6d30365a7a517a4e7a4a356254706e625759774d","encoding":"hex","key":"l4cch/loc-maps-clip/data/embeddings/item_ids.pt","truncatedAt":512}],"sampleObjects":["l4cch/loc-maps-clip/data/embeddings/embeddings.pt","l4cch/loc-maps-clip/data/embeddings/item_ids.pt","l4cch/loc-maps-clip/data/embeddings/metadata.json"],"sidecars":[{"bytes":"# CLIP Embeddings and Metadata for Historical Maps from the Library of Congress\n\nOne CLIP ViT-B/32 image embedding for each of 562,842 scanned map sheets in the Library of Congress Geography and Map Division, with each sheet's IIIF image service, its record at loc.gov, and its title and date. The sheets come from 56,525 catalog items. 78% are Sanborn fire insurance maps of American towns, and the rest are city views, atlases, charts and other maps. Nine in ten are dated between 1862 and 1955.\n\nThe images are not included. Each can be requested at any size from its IIIF image service at tile.loc.gov.\n\nThis is the index behind [digital-collections-explorer.com](https://digital-collections-explorer.com/), laid out for [Digital Collections Explorer](https://github.com/L4CCH/digital-collections-explorer).\n\n## Files\n\n| File | Size | What it holds |\n| --- | --- | --- |\n| `data/embeddings/embeddings.pt` | 1.15 GB | A PyTorch float32 tensor of 562,842 × 512, one L2-normalized vector per sheet |\n| `data/embeddings/item_ids.pt` | 55 MB | A list of 562,842 ids in the order of the vectors: each sheet's IIIF identifier, such as `service:gmd:gmd403m:g4031m:...`, in URL-safe base64 |\n| `data/embeddings/metadata.json` | 587 MB | A record for each id, described below |\n| `data/collection.json`, `config.json` | 1 KB | Settings for Digital Collections Explorer: the site's title and suggested searches, and the model |\n\n## Each sheet's record\n\n| Field | What it holds |\n| --- | --- |\n| `iiif_id` | The sheet's identifier at the Library's IIIF image server |\n| `iiif` | The `info.json` of its IIIF image service |\n| `paths` | Requests to that service: `thumbnail` 400 pixels wide, `processed` 2,000 pixels wide, `original` at full size |\n| `source_url` | Its item's record at loc.gov |\n| `title`, `date` | Its item's title and date, as the loc.gov API gave them in November 2026 |\n\nAn item often has many sheets: an atlas or a Sanborn volume has one for each page. 25 items, with 1,682 sheets, were no longer at loc.gov in November 2026, so those sheets have no `source_url`, `title` or `date`. Another 1,344 sheets have no `date`.\n\n## Where it comes from\n\n`embeddings.pt` is `beto_normalized.pt` from [clip-loc-maps](https://doi.org/10.5281/zenodo.11538437) by Jamie Mahowald (2024), unchanged. `item_ids.pt` and `metadata.json` were made from that record's `beto_idx.pt` and `merged_files.csv` by [`create_loc_assets.py`](https://github.com/L4CCH/digital-collections-explorer/blob/main/scripts/create_loc_assets.py). The titles and dates were read from the loc.gov API by [`fetch_loc_titles.py`](https://github.com/L4CCH/digital-collections-explorer/blob/main/scripts/fetch_loc_titles.py).\n\n## Cite\n\nHuang, Ying-Hsiang, and Benjamin Charles Germain Lee. 2025. \"Digital Collections Explorer: An Open-Source, Multimodal Viewer for Searching Digital Collections.\" *Computational Humanities Research* 1: e14. https://doi.org/10.1017/chr.2025.10017\n\nMahowald, Jamie. 2024. *clip-loc-maps*. Zenodo. https://doi.org/10.5281/zenodo.11538437\n\n## License\n\n[CC BY 4.0](https://creativecommons.org/licenses/by/4.0/), the license of the embeddings it is built on.\n","encoding":"utf8","key":"l4cch/loc-maps-clip/README.md","name":"README.md","size":3155,"truncated":false}],"sourceObjectKey":"l4cch/loc-maps-clip/data/embeddings/embeddings.pt","starterCell":"with open('/mnt/archive/data/embeddings/embeddings.pt', 'rb') as fh:\n    head = fh.read(1024)\nprint(len(head), head[:64])","starterSamplePath":"data/embeddings/metadata.json","totalObjects":"1 top-level prefixes"},"summary":"One CLIP ViT-B/32 image embedding for each of 562,842 scanned map sheets in the Library of Congress Geography and Map Division, from 56,525 catalog items.","title":"CLIP Embeddings of 562,842 Library of Congress Historical Map Sheets (Sanborn maps, atlases, city views)","updatedAt":"2026-11-17T20:14:19.809Z","visibility":"public","websiteUrl":"https://digital-collections-explorer.com/"}}