{"success":true,"data":{"author":"Google Research (Bileschi et al.)","bucketAccessType":"public","bucketListable":true,"bucketName":"brain-genomics-public","bucketPrefix":"research/proteins/pfam","category":"Proteomics","cloudProvider":"gcp","createdAt":"2026-11-17T14:12:20.518Z","description":"Machine learning splits of the Pfam 32.0 seed alignments released with Bileschi et al., Using deep learning to annotate the protein universe (Nature Biotechnology, 2022; preprint title Can Deep Learning Classify the Protein Universe). The task is to predict which of about 18,000 Pfam families a protein domain sequence belongs to, from about 1 million training domains. Each record has the domain sequence, family_accession (the label, e.g. PF02953.15), family_id, sequence_name (UniProt accession with start and end) and the aligned_sequence from the seed multiple sequence alignment. Measured 2026-11-17: random_split/ has train/ (80 CSV shards), dev/ and test/; clustered_split/ holds a 258 MB tar.gz of a clustered train/dev/test split for harder out-of-distribution evaluation; pfam-n2/v35.0/ holds significant and insignificant domain-call tables (about 2 GB TSV each) with aligned Stockholm and unaligned FASTA archives; a models/ folder sits alongside. Load the CSVs with pandas. The folder's LICENSE and README state CC0 1.0; cite Bileschi et al. 2022.","displayTitle":"Pfam Seed Protein Domain Classification Splits (Random and Clustered) and Pfam-N2 Predictions (Google Research)","doi":"10.1038/s41587-021-01179-w","fuseMountBrowsable":true,"id":"c0207e70-8c73-54bf-949f-f0749e476443","license":"CC0-1.0","licenseEvidenceUrl":"https://storage.googleapis.com/brain-genomics-public/research/proteins/pfam/LICENSE","objectCountEstimate":5,"probeStatus":"ok","referenceUrl":"https://doi.org/10.1038/s41587-021-01179-w","region":"us","schemaCard":{"accessHints":[{"language":"python-gcsfs","snippet":"import gcsfs\nfs = gcsfs.GCSFileSystem(token='anon')\nfs.ls('brain-genomics-public/research/proteins/pfam/', detail=False)[:10]"},{"language":"python-storage","snippet":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nlist(client.bucket('brain-genomics-public').list_blobs(prefix='research/proteins/pfam/', max_results=10))"}],"caveats":["Files are binary — use a domain-specific parser rather than text I/O."],"format":"binary","generatedAt":"2026-11-17T14:24:12.738Z","layout":{"example":"research/proteins/pfam/clustered_split/dev/data-00000-of-00010","pattern":"{prefix}/{seg1}/{seg2}/{seg3}/{seg4}/{object}"},"mountPath":"/mnt/gcs-archive/data","sampleHeaders":[{"bytes":"family_id,sequence_name,family_accession,aligned_sequence,sequence\nMed20,A5B151_VITVI/20-228,PF08612.11,CRL.SW...............VFHWQPNAGTTVNSQMINEVSQCVESINGVKEGRWKATLTFYKPMFRADQA............VPAEYP.......RDFLGISLPEQPNRYYFIIRSQK.....................................................I.....VLEADSSIQMIMEKLQSY...KSRVSLTFEGFQYQL.....GDFQLRVGKVAPSAS.ENLRGIVFEVEY.............................................................................................LPLSSMEKSRQILDGFVEIW........QEAMSKRSLPGH......FMHIEPNFAEFGLSDHYT...","encoding":"utf8","key":"research/proteins/pfam/clustered_split/dev/data-00000-of-00010","truncatedAt":512},{"bytes":"family_id,sequence_name,family_accession,aligned_sequence,sequence\nDpnII-MboI,A0A120FDU1_9RHIZ/129-267,PF18742.1,AVLQNILENTRKILVDAGI..................PVPKTEKEIYDAVGKVLNYAFHDVIPQFSLPRPLK..QYKPEFAVKSVKSLVEYKF..A.....RSE.KD..LKTKVDELYTDTRGY...VND..SGY..STFFAVIYCHDQ.YAHIEKVKREFQ..TSEIGPHWRIVLVHG,AVLQNILENTRKILVDAGIPVPKTEKEIYDAVGKVLNYAFHDVIPQFSLPRPLKQYKPEFAVKSVKSLVEYKFARSEKDLKTKVDELYTDTRGYVNDSGYSTFFAVIYCHDQYAHIEKVKREFQTSEIGPHWRIVLVHG\nDUF1772,D7C300_STRBB/18-146,PF08592.11,GVELAVAVF..................VNPILD.RLP...","encoding":"utf8","key":"research/proteins/pfam/clustered_split/dev/data-00001-of-00010","truncatedAt":512}],"sampleObjects":["research/proteins/pfam/clustered_split/dev/data-00000-of-00010","research/proteins/pfam/clustered_split/dev/data-00001-of-00010","research/proteins/pfam/clustered_split/dev/data-00002-of-00010","research/proteins/pfam/clustered_split/dev/data-00003-of-00010","research/proteins/pfam/clustered_split/dev/data-00004-of-00010"],"sidecars":[{"bytes":"CC0 1.0 Universal\n\nStatement of Purpose\n\nThe laws of most jurisdictions throughout the world automatically confer\nexclusive Copyright and Related Rights (defined below) upon the creator and\nsubsequent owner(s) (each and all, an \"owner\") of an original work of\nauthorship and/or a database (each, a \"Work\").\n\nCertain owners wish to permanently relinquish those rights to a Work for the\npurpose of contributing to a commons of creative, cultural and scientific\nworks (\"Commons\") that the public can reliably and without fear of later\nclaims of infringement build upon, modify, incorporate in other works, reuse\nand redistribute as freely as possible in any form whatsoever and for any\npurposes, including without limitation commercial purposes. These owners may\ncontribute to the Commons to promote the ideal of a free culture and the\nfurther production of creative, cultural and scientific works, or to gain\nreputation or greater distribution for their Work in part through the use and\nefforts of others.\n\nFor these and/or other purposes and motivations, and without any expectation\nof additional consideration or compensation, the person associating CC0 with a\nWork (the \"Affirmer\"), to the extent that he or she is an owner of Copyright\nand Related Rights in the Work, voluntarily elects to apply CC0 to the Work\nand publicly distribute the Work under its terms, with knowledge of his or her\nCopyright and Related Rights in the Work and the meaning and intended legal\neffect of CC0 on those rights.\n\n1. Copyright and Related Rights. A Work made available under CC0 may be\nprotected by copyright and related or neighboring rights (\"Copyright and\nRelated Rights\"). Copyright and Related Rights include, but are not limited\nto, the following:\n\n  i. the right to reproduce, adapt, distribute, perform, display, communicate,\n  and translate a Work;\n\n  ii. moral rights retained by the original author(s) and/or performer(s);\n\n  iii. publicity and privacy rights pertaining to a person's image or likeness\n  depicted in a Work;\n\n  iv. rights protecting against unfair competition in regards to a Work,\n  subject to the limitations in paragraph 4(a), below;\n\n  v. rights protecting the extraction, dissemination, use and reuse of data in\n  a Work;\n\n  vi. database rights (such as those arising under Directive 96/9/EC of the\n  European Parliament and of the Council of 11 March 1996 on the legal\n  protection of databases, and under any national implementation thereof,\n  including any amended or successor version of such directive); and\n\n  vii. other similar, equivalent or corresponding rights throughout the world\n  based on applicable law or treaty, and any national implementations thereof.\n\n2. Waiver. To the greatest extent permitted by, but not in contravention of,\napplicable law, Affirmer hereby overtly, fully, permanently, irrevocably and\nunconditionally waives, abandons, and surrenders all of Affirmer's Copyright\nand Related Rights and associated claims and causes of action, whether now\nknown or unknown (including existing as well as future claims and causes of\naction), in the Work (i) in all territories worldwide, (ii) for the maximum\nduration provided by applicable law or treaty (including future time\nextensions), (iii) in any current or future medium and for any number of\ncopies, and (iv) for any purpose whatsoever, including without limitation\ncommercial, advertising or promotional purposes (the \"Waiver\"). Affirmer makes\nthe Waiver for the benefit of each member of the public at large and to the\ndetriment of Affirmer's heirs and successors, fully intending that such Waiver\nshall not be subject to revocation, rescission, cancellation, termination, or\nany other legal or equitable action to disrupt the quiet enjoyment of the Work\nby the public as contemplated by Affirmer's express Statement of Purpose.\n\n3. Public License Fallback. Should any part of the Waiver for any reason be\njudged legally invalid or ineffective under applicable law, then the Waiver\nshall be preserved to the maximum extent permitted taking into account\nAffirmer's express Statement of Purpose. ","encoding":"utf8","key":"research/proteins/pfam/LICENSE","name":"LICENSE","size":6555,"truncated":true},{"bytes":"Creative Commons Legal Code\n\nCC0 1.0 Universal\n\n    CREATIVE COMMONS CORPORATION IS NOT A LAW FIRM AND DOES NOT PROVIDE\n    LEGAL SERVICES. DISTRIBUTION OF THIS DOCUMENT DOES NOT CREATE AN\n    ATTORNEY-CLIENT RELATIONSHIP. CREATIVE COMMONS PROVIDES THIS\n    INFORMATION ON AN \"AS-IS\" BASIS. CREATIVE COMMONS MAKES NO WARRANTIES\n    REGARDING THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS\n    PROVIDED HEREUNDER, AND DISCLAIMS LIABILITY FOR DAMAGES RESULTING FROM\n    THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS PROVIDED\n    HEREUNDER.\n\nStatement of Purpose\n\nThe laws of most jurisdictions throughout the world automatically confer\nexclusive Copyright and Related Rights (defined below) upon the creator\nand subsequent owner(s) (each and all, an \"owner\") of an original work of\nauthorship and/or a database (each, a \"Work\").\n\nCertain owners wish to permanently relinquish those rights to a Work for\nthe purpose of contributing to a commons of creative, cultural and\nscientific works (\"Commons\") that the public can reliably and without fear\nof later claims of infringement build upon, modify, incorporate in other\nworks, reuse and redistribute as freely as possible in any form whatsoever\nand for any purposes, including without limitation commercial purposes.\nThese owners may contribute to the Commons to promote the ideal of a free\nculture and the further production of creative, cultural and scientific\nworks, or to gain reputation or greater distribution for their Work in\npart through the use and efforts of others.\n\nFor these and/or other purposes and motivations, and without any\nexpectation of additional consideration or compensation, the person\nassociating CC0 with a Work (the \"Affirmer\"), to the extent that he or she\nis an owner of Copyright and Related Rights in the Work, voluntarily\nelects to apply CC0 to the Work and publicly distribute the Work under its\nterms, with knowledge of his or her Copyright and Related Rights in the\nWork and the meaning and intended legal effect of CC0 on those rights.\n\n1. Copyright and Related Rights. A Work made available under CC0 may be\nprotected by copyright and related or neighboring rights (\"Copyright and\nRelated Rights\"). Copyright and Related Rights include, but are not\nlimited to, the following:\n\n  i. the right to reproduce, adapt, distribute, perform, display,\n     communicate, and translate a Work;\n ii. moral rights retained by the original author(s) and/or performer(s);\niii. publicity and privacy rights pertaining to a person's image or\n     likeness depicted in a Work;\n iv. rights protecting against unfair competition in regards to a Work,\n     subject to the limitations in paragraph 4(a), below;\n  v. rights protecting the extraction, dissemination, use and reuse of data\n     in a Work;\n vi. database rights (such as those arising under Directive 96/9/EC of the\n     European Parliament and of the Council of 11 March 1996 on the legal\n     protection of databases, and under any national implementation\n     thereof, including any amended or successor version of such\n     directive); and\nvii. other similar, equivalent or corresponding rights throughout the\n     world based on applicable law or treaty, and any national\n     implementations thereof.\n\n2. Waiver. To the greatest extent permitted by, but not in contravention\nof, applicable law, Affirmer hereby overtly, fully, permanently,\nirrevocably and unconditionally waives, abandons, and surrenders all of\nAffirmer's Copyright and Related Rights and associated claims and causes\nof action, whether now known or unknown (including existing as well as\nfuture claims and causes of action), in the Work (i) in all territories\nworldwide, (ii) for the maximum duration provided by applicable law or\ntreaty (including future time extensions), (iii) in any current or future\nmedium and for any number of copies, and (iv) for any purpose whatsoever,\nincluding without limitation commercial, advertising or promotional\npurposes (the \"Waiver\"). Affirmer makes the Waiver for the benefit of each\nmember of the public at large and to the detriment of Affirmer","encoding":"utf8","key":"research/proteins/pfam/clustered_split/LICENSE","name":"LICENSE","size":7048,"truncated":true}],"sourceObjectKey":"research/proteins/pfam/clustered_split/dev/data-00000-of-00010","starterCell":"from google.cloud import storage\nclient = storage.Client.create_anonymous_client()\nbucket = client.bucket('brain-genomics-public')\nblob = bucket.blob('research/proteins/pfam/clustered_split/dev/data-00000-of-00010')\nwith blob.open(\"rb\") as fh:\n    print(fh.read(64))","starterSamplePath":"clustered_split/dev/data-00000-of-00010","totalObjects":"5 top-level prefixes"},"summary":"Machine learning splits of the Pfam 32.0 seed alignments released with Bileschi et al., Using deep learning to annotate the protein universe (Nature Biotechnology, 2022; preprint…","title":"Pfam Seed Protein Domain Classification Splits (Random and Clustered) and Pfam-N2 Predictions (Google Research)","updatedAt":"2026-11-17T20:02:19.856Z","visibility":"public","websiteUrl":"https://storage.googleapis.com/brain-genomics-public/research/proteins/pfam/training_data_readme.md"}}