{"doi":"10.1038/s41587-024-02414-w","title":"A community effort to optimize sequence-based deep learning models of gene regulation","abstract":"A systematic evaluation of how model architectures and training strategies impact genomics model performance is needed. To address this gap, we held a DREAM Challenge where competitors trained models on a dataset of millions of random promoter DNA sequences and corresponding expression levels, experimentally determined in yeast. For a robust evaluation of the models, we designed a comprehensive suite of benchmarks encompassing various sequence types. All top-performing models used neural networks but diverged in architectures and training strategies. To dissect how architectural and training choices impact performance, we developed the Prix Fixe framework to divide models into modular building blocks. We tested all possible combinations for the top three models, further improving their performance. The DREAM Challenge models not only achieved state-of-the-art results on our comprehensive yeast dataset but also consistently surpassed existing benchmarks on Drosophila and human genomic datasets, demonstrating the progress that can be driven by gold-standard genomics datasets.","journal":"Nature Biotechnology","year":2024,"id":11122,"datarank":0.6758266478515468,"base_score":3.58351893845611,"endowment":3.58351893845611,"self_citation_contribution":0.5375278407684165,"citation_network_contribution":0.13829880708313025,"self_endowment_contribution":0.5375278407684165,"citer_contribution":0.13829880708313025,"corpus_percentile":70.41850390655217,"corpus_rank":3825,"citation_count":35,"citer_count":25,"citers_with_citation_signal":12,"citers_with_endowment":12,"datacite_reuse_total":0,"is_dataset":true,"is_dataset_confidence":0.8215,"is_data_producer":false,"deposit_databanks":null,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2024-10-11","fair_score":70.8333,"fair_percentile":91.99021705900336,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":89794,"name":"Daria Nogina","orcid":"0000-0002-0593-2726","position":1,"is_corresponding":false},{"id":77537,"name":"Dmitry Penzar","orcid":"0000-0001-7960-9385","position":2,"is_corresponding":false},{"id":89795,"name":"Dohoon Lee","orcid":"0000-0003-2163-5489","position":3,"is_corresponding":false},{"id":89796,"name":"Danyeong Lee","orcid":null,"position":4,"is_corresponding":false},{"id":89797,"name":"Nayeon Kim","orcid":null,"position":5,"is_corresponding":false},{"id":89798,"name":"Sangyeup Kim","orcid":null,"position":6,"is_corresponding":false},{"id":89799,"name":"Dohyeon Kim","orcid":"0000-0002-0116-7756","position":7,"is_corresponding":false},{"id":89800,"name":"Yeojin Shin","orcid":"0000-0001-8920-8964","position":8,"is_corresponding":false},{"id":89801,"name":"Il-Youp Kwak","orcid":"0000-0002-7117-7669","position":9,"is_corresponding":false},{"id":89802,"name":"Georgy Meshcheryakov","orcid":null,"position":10,"is_corresponding":false},{"id":89803,"name":"Andrey Lando","orcid":null,"position":11,"is_corresponding":false},{"id":89804,"name":"Arsenii Zinkevich","orcid":"0000-0001-9450-4629","position":12,"is_corresponding":false},{"id":89805,"name":"Byeong-Chan Kim","orcid":null,"position":13,"is_corresponding":false},{"id":89806,"name":"Juhyun Lee","orcid":"0000-0002-9609-4376","position":14,"is_corresponding":false},{"id":89807,"name":"Taein Kang","orcid":null,"position":15,"is_corresponding":false},{"id":2692,"name":"Eeshit Dhaval Vaishnav","orcid":"0000-0003-3720-8051","position":16,"is_corresponding":false},{"id":24052,"name":"Payman Yadollahpour","orcid":"0000-0003-1984-5014","position":17,"is_corresponding":false},{"id":89808,"name":"Random Promoter DREAM Challenge Consortium","orcid":null,"position":18,"is_corresponding":false},{"id":89809,"name":"Susanne Bornelöv","orcid":"0000-0001-9276-9981","position":19,"is_corresponding":false},{"id":89810,"name":"Fredrik Svensson","orcid":"0000-0002-5556-8133","position":20,"is_corresponding":false},{"id":89811,"name":"Maria-Anna Trapotsi","orcid":null,"position":21,"is_corresponding":false},{"id":12237,"name":"Tin Nguyen","orcid":"0000-0001-8001-9470","position":23,"is_corresponding":false},{"id":89813,"name":"Xinming Tu","orcid":"0009-0004-0833-6876","position":24,"is_corresponding":false},{"id":89814,"name":"Wuwei Zhang","orcid":null,"position":25,"is_corresponding":false},{"id":89815,"name":"Wei Qiu","orcid":"0000-0001-8093-3094","position":26,"is_corresponding":false},{"id":89816,"name":"Rohan Ghotra","orcid":null,"position":27,"is_corresponding":false},{"id":89817,"name":"Yiyang Yu","orcid":"0000-0001-7594-1401","position":28,"is_corresponding":false},{"id":89818,"name":"Ethan Labelson","orcid":null,"position":29,"is_corresponding":false},{"id":89819,"name":"Aayush Prakash","orcid":null,"position":30,"is_corresponding":false},{"id":89820,"name":"Ashwin Narayanan","orcid":"0000-0002-2609-8881","position":31,"is_corresponding":false},{"id":89821,"name":"Peter Koo","orcid":null,"position":32,"is_corresponding":false},{"id":89822,"name":"Xiaoting Chen","orcid":null,"position":33,"is_corresponding":false},{"id":89823,"name":"David T. Jones","orcid":"0000-0001-8626-3765","position":34,"is_corresponding":false},{"id":4926,"name":"Yuanfang Guan","orcid":"0000-0001-8275-2852","position":36,"is_corresponding":false},{"id":89825,"name":"Maolin Ding","orcid":"0009-0007-2837-9533","position":37,"is_corresponding":false},{"id":13086,"name":"Calvin Wing Yiu Chan","orcid":"0000-0002-3656-7709","position":38,"is_corresponding":false},{"id":89826,"name":"Yuedong Yang","orcid":null,"position":39,"is_corresponding":false},{"id":54470,"name":"Ke Ding","orcid":"0000-0001-9016-812X","position":40,"is_corresponding":false},{"id":89827,"name":"Gunjan Dixit","orcid":"0000-0003-4609-4316","position":41,"is_corresponding":false},{"id":41931,"name":"Jiayu Wen","orcid":"0000-0003-1249-6456","position":42,"is_corresponding":false},{"id":7295,"name":"Zhihan Zhou","orcid":"0000-0002-9475-465X","position":43,"is_corresponding":false},{"id":74322,"name":"Pratik Dutta","orcid":"0000-0002-1579-8946","position":44,"is_corresponding":false},{"id":89828,"name":"Rekha Sathian","orcid":null,"position":45,"is_corresponding":false},{"id":89829,"name":"Pallavi Surana","orcid":"0009-0004-4241-9181","position":46,"is_corresponding":false},{"id":89830,"name":"Yanrong Ji","orcid":"0000-0002-0134-664X","position":47,"is_corresponding":false},{"id":247,"name":"Han Liu","orcid":"0009-0003-8160-5780","position":48,"is_corresponding":false},{"id":89831,"name":"Ramana V. Davuluri","orcid":"0000-0002-7053-1064","position":49,"is_corresponding":false},{"id":89832,"name":"Yu Hiratsuka","orcid":null,"position":50,"is_corresponding":false},{"id":89833,"name":"Mao Takatsu","orcid":null,"position":51,"is_corresponding":false},{"id":89834,"name":"Tsai-Min Chen","orcid":null,"position":52,"is_corresponding":false},{"id":89835,"name":"Chih-Han Huang","orcid":"0000-0001-7339-1194","position":53,"is_corresponding":false},{"id":89836,"name":"Hsuan-Kai Wang","orcid":null,"position":54,"is_corresponding":false},{"id":89837,"name":"Edward S. C. Shih","orcid":null,"position":55,"is_corresponding":false},{"id":89838,"name":"Sz-Hau Chen","orcid":null,"position":56,"is_corresponding":false},{"id":89839,"name":"Chih-Hsun Wu","orcid":null,"position":57,"is_corresponding":false},{"id":89840,"name":"Jhih-Yu Chen","orcid":"0000-0003-1652-8566","position":58,"is_corresponding":false},{"id":89841,"name":"Kuei-Lin Huang","orcid":null,"position":59,"is_corresponding":false},{"id":89842,"name":"Ibrahim Alsaggaf","orcid":"0009-0007-7379-5915","position":60,"is_corresponding":false},{"id":89843,"name":"Patrick Greaves","orcid":null,"position":61,"is_corresponding":false},{"id":89844,"name":"Carl Barton","orcid":"0000-0003-1589-0432","position":62,"is_corresponding":false},{"id":89845,"name":"Cen Wan","orcid":"0000-0002-3872-0340","position":63,"is_corresponding":false},{"id":89846,"name":"Nicholas Abad","orcid":null,"position":64,"is_corresponding":false},{"id":13091,"name":"Klev Diamanti","orcid":"0000-0002-4922-8415","position":65,"is_corresponding":false},{"id":13073,"name":"Lars Feuerbach","orcid":"0000-0003-1503-437X","position":66,"is_corresponding":false},{"id":13301,"name":"Benedikt Brors","orcid":"0000-0001-5940-3101","position":67,"is_corresponding":false},{"id":12577,"name":"Yichao Li","orcid":"0000-0001-5791-096X","position":68,"is_corresponding":false},{"id":89848,"name":"Sebastian Röner","orcid":"0000-0002-8578-1269","position":69,"is_corresponding":false},{"id":89849,"name":"Pyaree Mohan Dash","orcid":"0000-0002-1005-0437","position":70,"is_corresponding":false},{"id":89851,"name":"Onuralp Soylemez","orcid":null,"position":72,"is_corresponding":false},{"id":89852,"name":"Andreas Møller","orcid":"0000-0002-4073-5568","position":73,"is_corresponding":false},{"id":89853,"name":"Gabija Kavaliauskaite","orcid":"0000-0001-7719-9108","position":74,"is_corresponding":false},{"id":89854,"name":"Jesper Madsen","orcid":null,"position":75,"is_corresponding":false},{"id":89855,"name":"Zhixiu Lu","orcid":"0009-0000-9904-9741","position":76,"is_corresponding":false},{"id":89856,"name":"Owen Queen","orcid":"0009-0009-1675-5313","position":77,"is_corresponding":false},{"id":89857,"name":"Ashley Babjac","orcid":"0000-0002-0991-7726","position":78,"is_corresponding":false},{"id":89858,"name":"Scott Emrich","orcid":"0000-0002-5741-4517","position":79,"is_corresponding":false},{"id":89859,"name":"Konstantinos Kardamiliotis","orcid":"0000-0002-5175-0552","position":80,"is_corresponding":false},{"id":89860,"name":"Konstantinos Kyriakidis","orcid":"0000-0002-1696-4838","position":81,"is_corresponding":false},{"id":89861,"name":"Andigoni Malousi","orcid":"0000-0002-1968-7020","position":82,"is_corresponding":false},{"id":89862,"name":"Ashok Palaniappan","orcid":"0000-0003-2841-9527","position":83,"is_corresponding":false},{"id":89863,"name":"Krishnakant Gupta","orcid":null,"position":84,"is_corresponding":false},{"id":89864,"name":"Prasanna Kumar S","orcid":null,"position":85,"is_corresponding":false},{"id":89865,"name":"Jake Bradford","orcid":null,"position":86,"is_corresponding":false},{"id":6606,"name":"Dimitri Perrin","orcid":"0000-0002-4007-5256","position":87,"is_corresponding":false},{"id":89866,"name":"Robert Salomone","orcid":"0000-0002-6808-6918","position":88,"is_corresponding":false},{"id":89867,"name":"Carl Schmitz","orcid":"0009-0005-6620-633X","position":89,"is_corresponding":false},{"id":89868,"name":"Chen JiaXing","orcid":null,"position":90,"is_corresponding":false},{"id":89869,"name":"Wang JingZhe","orcid":null,"position":91,"is_corresponding":false},{"id":89870,"name":"Yang AiWei","orcid":null,"position":92,"is_corresponding":false},{"id":89871,"name":"Sun Kim","orcid":null,"position":93,"is_corresponding":false},{"id":29633,"name":"Prisca Liberali","orcid":"0000-0003-0695-6081","position":95,"is_corresponding":false},{"id":17840,"name":"Ivan V. Kulakovskiy","orcid":"0000-0002-6554-8128","position":97,"is_corresponding":false},{"id":3029,"name":"Carl G. de Boer","orcid":"0000-0001-8935-5921","position":99,"is_corresponding":false},{"id":89875,"name":"N. S. KIM","orcid":"0000-0003-1222-8742","position":100,"is_corresponding":false},{"id":89876,"name":"G. A. Meshcheryakov","orcid":"0000-0003-0751-8286","position":101,"is_corresponding":false},{"id":89877,"name":"Byeongchan Kim","orcid":"0009-0007-7113-9906","position":102,"is_corresponding":false},{"id":89878,"name":"Maria‐Anna Trapotsi","orcid":"0000-0002-9177-4241","position":103,"is_corresponding":false},{"id":89879,"name":"Tsai‐Min Chen","orcid":"0000-0002-1143-0677","position":105,"is_corresponding":false},{"id":89880,"name":"Edward S.C. Shih","orcid":"0000-0002-8175-0393","position":106,"is_corresponding":false},{"id":89881,"name":"Chih‐Hsun Wu","orcid":"0000-0003-4613-5915","position":107,"is_corresponding":false},{"id":89882,"name":"P W Greaves","orcid":null,"position":108,"is_corresponding":false},{"id":89883,"name":"Nicholas Allen Baclig Abad","orcid":"0009-0004-8322-564X","position":109,"is_corresponding":false},{"id":15079,"name":"Onuralp Söylemez","orcid":"0000-0001-8308-6855","position":110,"is_corresponding":false},{"id":89884,"name":"Jesper Grud Skat Madsen","orcid":"0000-0002-0518-0800","position":111,"is_corresponding":false},{"id":89885,"name":"Krishna Kant Gupta","orcid":"0000-0002-4703-6452","position":112,"is_corresponding":false},{"id":89886,"name":"Prasanna Kumar Saravanam","orcid":"0000-0002-8238-0419","position":113,"is_corresponding":false},{"id":89887,"name":"Jacob Bradford","orcid":"0000-0003-3619-5682","position":114,"is_corresponding":false},{"id":89888,"name":"Jiaxing Chen","orcid":"0000-0001-5795-6722","position":115,"is_corresponding":false},{"id":89889,"name":"Jingzhe Wang","orcid":"0000-0001-8332-7997","position":116,"is_corresponding":false},{"id":89890,"name":"Sun Kim","orcid":"0000-0001-5385-9546","position":117,"is_corresponding":false},{"id":89793,"name":"Abdul Muntakim Rafi","orcid":"0000-0002-0387-5430","position":0,"is_corresponding":true}],"reference_count":71,"raw_metadata":{"citation_network_status":"fetched"},"created_at":"2026-03-01T18:20:47.508186Z","pmid":"39394483","pmcid":"PMC12339383","fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":"hybrid","license":"cc-by","views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":88.8889,"fair_a":50.0,"fair_i":20.0,"fair_r":41.6667,"fair_zscore":1.4401,"fair_rationale":{"fair_score":70.83,"has_llm":true,"taxonomy_version":"fair_taxonomy_v5","dimensions":{"F":{"name":"Findable","score":88.89,"criteria":[{"key":"f_dataset_pid","label":"Persistent identifier for the data","kind":"llm","weight":2.0,"fraction":1.0,"verdict":"yes","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493 . The processed datasets are available from Zenodo (10.5281/zenodo.10633252) 70 .","grounded":true,"rationale":"The paper provides a persistent identifier (GEO accession and Zenodo DOI) for its own dataset. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["RDA-F1-01D — FAIR Data Maturity Model: 'Data is identified by a persistent identifier' (priorit","RDA-F1-02D — FAIR Data Maturity Model: 'Data is identified by a globally unique identifier'","FsF-F1-02D — F-UJI/FAIRsFAIR: 'Data is assigned a persistent identifier'"],"scored":true,"signal":null},{"key":"f_repository_named","label":"Named repository","kind":"llm","weight":2.0,"fraction":1.0,"verdict":"yes","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493 . The processed datasets are available from Zenodo (10.5281/zenodo.10633252) 70 .","grounded":true,"rationale":"The paper names GEO and Zenodo, both curated repositories listed in re3data/FAIRsharing. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["RDA-F4-01M — FAIR Data Maturity Model: metadata is offered so it can be harvested and indexed (","NIH DMS Policy Element 4 (NOT-OD-21-014) — name the repository where data will be archived","NSTC Desirable Characteristics of Data Repositories (2022) — 'Long-Term Sustainability', 'Reten"],"scored":true,"signal":null},{"key":"f_data_availability_statement","label":"Data-availability statement","kind":"llm","weight":2.0,"fraction":1.0,"verdict":"yes","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493 . The processed datasets are available from Zenodo (10.5281/zenodo.10633252) 70 .","grounded":true,"rationale":"The data availability statement points to repository records with accessions, matching Colavizza category 3. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["Colavizza, Hrynaszkiewicz, Staden, Whitaker & McGillivray (2020), 'The citation advantage of li","Springer Nature research data policy — Data Availability Statements: standard statement templat","RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes"],"scored":false,"signal":null},{"key":"f_discovery_metadata","label":"Description of the dataset as an object","kind":"llm","weight":2.0,"fraction":0.5,"verdict":"partial","evidence":"This resulted in a training dataset of 6,739,258 random promoter sequences and their corresponding mean expression values.","grounded":true,"rationale":"The dataset is described in a sentence in the Results, not in an itemized list. [majority verdict 'partial' (3/5 passes agreed)]","anchors":["RDA-F2-01M — 'Rich metadata is provided to allow discovery' (priority Essential)","FsF-F2-01M — F-UJI: 'Metadata includes descriptive core elements to support data findability'","FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data'"],"scored":false,"signal":null},{"key":"f_dataset_cited","label":"Dataset formally cited","kind":"llm","weight":1.0,"fraction":1.0,"verdict":"yes","evidence":"Rafi, A. M. Random Promoter DREAM Challenge 2022: predicting gene expression using millions of random promoter sequences. Zenodo 10.5281/zenodo.10633252 (2024).","grounded":true,"rationale":"The dataset appears as a reference-list entry in the bibliography. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["FORCE11 Joint Declaration of Data Citation Principles (2014) — data should be cited as a first-","RDA-F3-01M — metadata clearly and explicitly includes the identifier of the data it describes","FsF-F3-01M — F-UJI: 'Metadata includes the identifier of the data it describes'"],"scored":true,"signal":null}]},"A":{"name":"Accessible","score":50.0,"criteria":[{"key":"a_data_openly_accessible","label":"Access route free of preconditions","kind":"llm","weight":2.0,"fraction":1.0,"verdict":"yes","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493 .","grounded":true,"rationale":"The text gives a route to the data with no stated precondition; the data are publicly available at a repository. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["RDA-A1.1-01D — 'Data is accessible through a free access protocol'","FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data'","NSTC Desirable Characteristics of Data Repositories (2022) — 'Free and Easy Access'"],"scored":true,"signal":null},{"key":"a_access_conditions_stated","label":"Access level labelled","kind":"llm","weight":1.0,"fraction":0.0,"verdict":"no","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493.","grounded":false,"rationale":"No access-level label is used; only an action is described. [downgraded to 'no' — no verifiable quote from the paper] [majority verdict 'no' (3/5 passes agreed)]","anchors":["FsF-A1-01M — F-UJI: 'Metadata contains access level and access conditions of the data'","RDA-A1-01M — metadata contains information to enable the user to get access to the data","COAR Controlled Vocabularies — Access Rights v1.0 (open / embargoed / restricted / metadata-onl"],"scored":false,"signal":null},{"key":"a_controlled_access_for_sensitive","label":"Gatekeeper for sensitive data","kind":"llm","weight":0.5,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"The data are not sensitive human-subject data, and no gatekeeper is named.","anchors":["NIH Genomic Data Sharing Policy (NOT-OD-14-124) — controlled-access via a Data Access Committee","RDA-A1.2-01D — 'Data is accessible through an access protocol that supports authentication and ","NIH DMS Policy Element 5 (NOT-OD-21-014) — Access, Distribution, or Reuse Considerations (conse"],"scored":false,"signal":null},{"key":"a_timeline_retention","label":"Availability timing & retention","kind":"llm","weight":0.5,"fraction":0.0,"verdict":"no","evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493.","grounded":false,"rationale":"The data are stated to be available now, but no persistence period is given. [downgraded to 'no' — no verifiable quote from the paper]","anchors":["NIH DMS Plan Element 4 (NOT-OD-21-014) — Data Preservation, Access, and Associated Timelines","NSTC Desirable Characteristics (2022), Organizational Infrastructure: 'Retention Policy'","RDA-A2-01M — 'Metadata is guaranteed to remain available after data is no longer available'"],"scored":false,"signal":null}]},"I":{"name":"Interoperable","score":20.0,"criteria":[{"key":"i_open_nonproprietary_format","label":"Open file format","kind":"llm","weight":1.0,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"No file format is named for the released data.","anchors":["FsF-R1.3-02D — F-UJI: 'Data is available in a file format recommended by the target research co","RDA-R1.3-02D — data is expressed in a machine-understandable community standard","RDA-I1-01D — data uses a knowledge representation expressed in a standardised format"],"scored":true,"signal":null},{"key":"i_community_standard_vocabulary","label":"Community standard / vocabulary","kind":"llm","weight":1.0,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"No community data standard is named.","anchors":["RDA-R1.3-01M — 'Metadata complies with a community standard' (priority Essential)","RDA-R1.3-01D — 'Data complies with a community standard'","RDA-I2-01M — '(Meta)data use vocabularies that follow FAIR principles'"],"scored":false,"signal":null},{"key":"i_qualified_references","label":"Identifiers for the resources the data depend on","kind":"llm","weight":0.5,"fraction":1.0,"verdict":"yes","evidence":"The Drosophila STARR-seq data are available from the GEO under accession number GSE183939 .","grounded":true,"rationale":"The paper provides identifiers for external datasets used in benchmarks (e.g., GEO accession GSE183939). [majority verdict 'yes' (3/5 passes agreed)]","anchors":["RDA-I3-01M — '(meta)data include references to other (meta)data'","RDA-I3-03M — 'metadata includes qualified references to other metadata'","FsF-I3-01M — F-UJI: 'Metadata includes links between the data and its related entities'"],"scored":false,"signal":null}]},"R":{"name":"Reusable","score":41.67,"criteria":[{"key":"r_reuse_license","label":"Reuse licence","kind":"llm","weight":2.0,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"No licence is stated for the data.","anchors":["RDA-R1.1-01M — 'Metadata includes information about the licence under which the data can be reu","RDA-R1.1-02M — 'Metadata refers to a standard reuse licence'","RDA-R1.1-03M — 'Metadata refers to a machine-understandable reuse licence'"],"scored":true,"signal":null},{"key":"r_provenance_methods","label":"Provenance of the data","kind":"llm","weight":1.0,"fraction":1.0,"verdict":"yes","evidence":"sequenced on an Illumina NextSeq using 2 × 76-bp paired-end reads with 150-cycle kits.","grounded":true,"rationale":"The paper names specific instruments and kits used in data generation. [majority verdict 'yes' (3/5 passes agreed)]","anchors":["RDA-R1.2-01M — 'Metadata includes provenance information according to community- specific standa","FsF-R1.2-01M — F-UJI: 'Metadata includes provenance information about data creation or generati","W3C PROV-O (W3C Recommendation, 2013) — the entity/activity/agent model of provenance"],"scored":false,"signal":null},{"key":"r_documentation_codebook","label":"Documentation / codebook","kind":"llm","weight":1.0,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"No documentation object (e.g., README, data dictionary) is named as accompanying the data; field definitions are not provided. [majority verdict 'no' (3/5 passes agreed)]","anchors":["RDA-R1-01M — '(Meta)data are richly described with a plurality of accurate and relevant attribu","FsF-R1-01MD — F-UJI: 'Metadata specifies the content of the data'","NIH DMS Policy Element 3 (NOT-OD-21-014) — Standards (documentation and metadata to accompany t"],"scored":false,"signal":null},{"key":"r_versioning","label":"Snapshot identified","kind":"llm","weight":0.5,"fraction":0.0,"verdict":"no","evidence":null,"grounded":false,"rationale":"No version token or date is provided for the dataset.","anchors":["DataCite Metadata Schema 4.6 — the 'Version' property","RDA-R1.2-01M — provenance information (which version was used is provenance)","NSTC Desirable Characteristics of Data Repositories (2022) — 'Provenance', 'Retention Policy'"],"scored":true,"signal":null},{"key":"x_code_availability","label":"Analysis code available","kind":"llm","weight":1.0,"fraction":1.0,"verdict":"yes","evidence":"Open-source code for our models is available from GitHub ( https://github.com/de-Boer-Lab/random-promoter-dream-challenge-2022 ).","grounded":true,"rationale":"A GitHub repository URL is provided for the code.","anchors":["NIH DMS Policy Element 2 (NOT-OD-21-014) — 'Related Tools, Software and/or Code'","FAIR4RS Principles v1.0 (Chue Hong et al., 2022; RDA/FORCE11/ReSA) — FAIR Principles for Resear","FORCE11 Software Citation Principles (Smith, Katz & Niemeyer, 2016, PeerJ CS 2:e86)"],"scored":true,"signal":null},{"key":"x_funding_attribution","label":"Funder and award number","kind":"llm","weight":0.5,"fraction":1.0,"verdict":"yes","evidence":"RGPIN-2020-05425","grounded":true,"rationale":"An award number is given for the funding. [majority verdict 'yes' (4/5 passes agreed)]","anchors":["DataCite Metadata Schema 4.6 — 'FundingReference' property (funderName, funderIdentifier, award","Crossref Funder Registry — canonical funder identifiers for funding metadata","RDA-F2-01M — rich metadata provided to allow discovery (funding is part of the descriptive reco"],"scored":true,"signal":null}]}},"actions":[{"key":"r_reuse_license","dimension":"R","label":"Reuse licence","action":"Attach a standard, machine-readable open licence to the deposit — CC0 or CC BY, which is what Horizon Europe and most funders expect — and print the licence identifier in the paper. 'Free to use' is not a licence: it grants nothing a reuser's institution can rely on.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"No licence is stated for the data.","gain":16.67,"priority":"essential","scored":true},{"key":"i_open_nonproprietary_format","dimension":"I","label":"Open file format","action":"Release the data in an open, community-standard format (CSV/TSV, JSON, HDF5, NetCDF, FASTQ, VCF, NIfTI…) instead of — or alongside — any proprietary or instrument-native format, and name the format in the paper. A dataset that needs a €2,000 licence to open is not reusable. Prefer open neuroimaging formats such as NIfTI or BIDS.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"No file format is named for the released data.","gain":8.33,"priority":"important","scored":true},{"key":"r_versioning","dimension":"R","label":"Snapshot identified","action":"Version the deposit and cite the exact version analysed (a version-specific DOI, or an accession with its version suffix). A reader reproducing your work against 'the current release' is reproducing it against a different dataset.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"No version token or date is provided for the dataset.","gain":4.17,"priority":"useful","scored":true},{"key":"f_discovery_metadata","dimension":"F","label":"Description of the dataset as an object","action":"Add a 'Data Records' section: itemise every file in the deposit and every variable or sample it holds, with counts and units. Describe the dataset as an object in its own right, not as a by-product of the findings — this is what makes it discoverable to someone who is not looking for your paper.","anchors":["yes","partial","no"],"verdict":"partial","current":0.5,"evidence":"This resulted in a training dataset of 6,739,258 random promoter sequences and their corresponding mean expression values.","why":"The dataset is described in a sentence in the Results, not in an itemized list. [majority verdict 'partial' (3/5 passes agreed)]","gain":0.0,"priority":"essential","scored":false},{"key":"a_access_conditions_stated","dimension":"A","label":"Access level labelled","action":"State the access level in words, using the standard vocabulary: 'These data are open access' / 'These data are controlled access'. A reader — and a harvester — should not have to infer the access level from the presence of a download link.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493.","why":"No access-level label is used; only an action is described. [downgraded to 'no' — no verifiable quote from the paper] [majority verdict 'no' (3/5 passes agreed)]","gain":0.0,"priority":"important","scored":false},{"key":"i_community_standard_vocabulary","dimension":"I","label":"Community standard / vocabulary","action":"Adopt and NAME your domain's data standard — the minimum-information checklist, metadata schema, or ontology your community uses (MIAME/MINSEQE, ISA-Tab, BIDS, an OBO ontology, HL7 FHIR/OMOP) — and say which one you followed. A reporting checklist standardises your paper; it does nothing for your data. In neuroimaging, describe the data with BIDS, NIfTI or DICOM.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"No community data standard is named.","gain":0.0,"priority":"important","scored":false},{"key":"r_documentation_codebook","dimension":"R","label":"Documentation / codebook","action":"Ship a README and a data dictionary IN the deposit — every file, every variable, its units, its allowed values, its missing-value codes. It is the cheapest single thing that makes a dataset usable by someone who was not in the lab, and a table buried in the article does not travel with the data.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"No documentation object (e.g., README, data dictionary) is named as accompanying the data; field definitions are not provided. [majority verdict 'no' (3/5 passes agreed)]","gain":0.0,"priority":"important","scored":false},{"key":"a_controlled_access_for_sensitive","dimension":"A","label":"Gatekeeper for sensitive data","action":"Route sensitive data through an institutional gatekeeper — deposit in a controlled- access repository (dbGaP, EGA) with a Data Access Committee and a published DUA — rather than through the corresponding author's inbox. An author-gated dataset dies with the author's email address, and 'on reasonable request' has been shown repeatedly not to yield data.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":null,"why":"The data are not sensitive human-subject data, and no gatekeeper is named.","gain":0.0,"priority":"useful","scored":false},{"key":"a_timeline_retention","dimension":"A","label":"Availability timing & retention","action":"State when the data become available AND how long they will be retained — cite the repository's preservation policy. NIH DMS Element 4 asks for both; most papers give neither.","anchors":["yes","partial","no"],"verdict":"no","current":0.0,"evidence":"Data generated for this study are available from the National Center of Biotechnology Information Gene Expression Omnibus (GEO) under accession number GSE254493.","why":"The data are stated to be available now, but no persistence period is given. [downgraded to 'no' — no verifiable quote from the paper]","gain":0.0,"priority":"useful","scored":false}],"suggestions":["Attach a standard, machine-readable open licence to the deposit — CC0 or CC BY, which is what Horizon Europe and most funders expect — and print the licence identifier in the paper. 'Free to use' is not a licence: it grants nothing a reuser's institution can rely on.","Release the data in an open, community-standard format (CSV/TSV, JSON, HDF5, NetCDF, FASTQ, VCF, NIfTI…) instead of — or alongside — any proprietary or instrument-native format, and name the format in the paper. A dataset that needs a €2,000 licence to open is not reusable. Prefer open neuroimaging formats such as NIfTI or BIDS.","Version the deposit and cite the exact version analysed (a version-specific DOI, or an accession with its version suffix). A reader reproducing your work against 'the current release' is reproducing it against a different dataset.","Add a 'Data Records' section: itemise every file in the deposit and every variable or sample it holds, with counts and units. Describe the dataset as an object in its own right, not as a by-product of the findings — this is what makes it discoverable to someone who is not looking for your paper.","State the access level in words, using the standard vocabulary: 'These data are open access' / 'These data are controlled access'. A reader — and a harvester — should not have to infer the access level from the presence of a download link."],"model":"deepseek/deepseek-v4-flash","agent_version":"fair_agent_v8","fulltext_source":"epmc_xml"},"fair_model":"deepseek/deepseek-v4-flash","fair_agent_version":"fair_agent_v8","fair_fulltext_source":"epmc_xml","fair_has_llm":true,"fair_computed_at":"2026-07-20T11:29:34.158635Z","clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}