{"doi":"10.1098/rsta.2021.0300","title":"FAIR data pipeline: provenance-driven data management for traceable scientific workflows","abstract":"<jats:p>Modern epidemiological analyses to understand and combat the spread of disease depend critically on access to, and use of, data. Rapidly evolving data, such as data streams changing during a disease outbreak, are particularly challenging. Data management is further complicated by data being imprecisely identified when used. Public trust in policy decisions resulting from such analyses is easily damaged and is often low, with cynicism arising where claims of ‘following the science’ are made without accompanying evidence. Tracing the provenance of such decisions back through open software to primary data would clarify this evidence, enhancing the transparency of the decision-making process. Here, we demonstrate a Findable, Accessible, Interoperable and Reusable (FAIR) data pipeline. Although developed during the COVID-19 pandemic, it allows easy annotation of any data as they are consumed by analyses, or conversely traces the provenance of scientific outputs back through the analytical or modelling source code to primary data. Such a tool provides a mechanism for the public, and fellow scientists, to better assess scientific evidence by inspecting its provenance, while allowing scientists to support policymakers in openly justifying their decisions. We believe that such tools should be promoted for use across all areas of policy-facing research.</jats:p>\n                  <jats:p>This article is part of the theme issue ‘Technical challenges of modelling real-life epidemics and examples of overcoming these’.</jats:p>","journal":"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences","year":2022,"id":591341,"datarank":1.392703423802965,"base_score":3.58351893845611,"endowment":3.58351893845611,"self_citation_contribution":0.5375278407684165,"citation_network_contribution":0.8551755830345484,"self_endowment_contribution":0.5375278407684165,"citer_contribution":0.8551755830345484,"corpus_percentile":null,"corpus_rank":null,"citation_count":35,"citer_count":30,"citers_with_citation_signal":20,"citers_with_endowment":20,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":null,"is_data_producer":false,"deposit_databanks":null,"is_oa":false,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":null,"fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":1512965,"name":"Andrew Lahiff","orcid":"0000-0002-2785-4116","position":1,"is_corresponding":false},{"id":1512967,"name":"Nathan Cummings","orcid":"0000-0003-4359-6337","position":2,"is_corresponding":false},{"id":1512969,"name":"Jonathan Hollocombe","orcid":"0000-0001-7159-158X","position":3,"is_corresponding":false},{"id":1512971,"name":"Bram Boskamp","orcid":"0000-0002-5446-3209","position":4,"is_corresponding":false},{"id":1512973,"name":"Ryan Field","orcid":"0000-0002-4424-9890","position":5,"is_corresponding":false},{"id":1512976,"name":"Dennis Reddyhoff","orcid":"0000-0002-4971-2346","position":6,"is_corresponding":false},{"id":1512978,"name":"Kristian Zarebski","orcid":"0000-0002-6773-1049","position":7,"is_corresponding":false},{"id":1512980,"name":"Antony Wilson","orcid":"0000-0001-7336-4823","position":8,"is_corresponding":false},{"id":1512982,"name":"Bruno Viola","orcid":"0000-0001-5406-5860","position":9,"is_corresponding":false},{"id":1512983,"name":"Martin Burke","orcid":"0000-0002-5540-9087","position":10,"is_corresponding":false},{"id":1512985,"name":"Blair Archibald","orcid":"0000-0003-3699-6658","position":11,"is_corresponding":false},{"id":1512986,"name":"Paul Bessell","orcid":"0000-0002-7901-969X","position":12,"is_corresponding":false},{"id":1512987,"name":"Richard Blackwell","orcid":null,"position":13,"is_corresponding":false},{"id":1512988,"name":"Lisa A. Boden","orcid":"0000-0002-9317-4741","position":14,"is_corresponding":false},{"id":1512991,"name":"Alys Brett","orcid":"0000-0002-5789-0572","position":15,"is_corresponding":false},{"id":1512994,"name":"Sam Brett","orcid":null,"position":16,"is_corresponding":false},{"id":1512995,"name":"Ruth Dundas","orcid":"0000-0002-3836-4286","position":17,"is_corresponding":false},{"id":1512997,"name":"Jessica Enright","orcid":"0000-0002-0266-3292","position":18,"is_corresponding":false},{"id":286,"name":"Alejandra Noemí González Beltrán","orcid":"0000-0003-3499-8262","position":19,"is_corresponding":false},{"id":1512998,"name":"Claire Harris","orcid":"0000-0003-0852-2340","position":20,"is_corresponding":false},{"id":1512999,"name":"Ian Hinder","orcid":"0000-0003-3548-9101","position":21,"is_corresponding":false},{"id":1513000,"name":"Christopher David Hughes","orcid":null,"position":22,"is_corresponding":false},{"id":1513001,"name":"Martin Knight","orcid":"0000-0002-3812-4397","position":23,"is_corresponding":false},{"id":1513002,"name":"Vino Mano","orcid":null,"position":24,"is_corresponding":false},{"id":1513003,"name":"Ciaran McMonagle","orcid":"0000-0002-1325-2413","position":25,"is_corresponding":false},{"id":1513004,"name":"Dominic Mellor","orcid":"0000-0001-7141-652X","position":26,"is_corresponding":false},{"id":1433732,"name":"Sibylle Mohr","orcid":"0000-0002-9089-6327","position":27,"is_corresponding":false},{"id":1513005,"name":"Glenn Marion","orcid":"0000-0002-0454-9338","position":28,"is_corresponding":false},{"id":825822,"name":"Louise Matthews","orcid":"0000-0003-4420-8367","position":29,"is_corresponding":false},{"id":1513006,"name":"Iain J. McKendrick","orcid":"0000-0002-7529-0749","position":30,"is_corresponding":false},{"id":1513007,"name":"Christopher Mark Pooley","orcid":"0000-0002-8779-4477","position":31,"is_corresponding":false},{"id":1513008,"name":"Thibaud Porphyre","orcid":"0000-0002-8552-9899","position":32,"is_corresponding":false},{"id":1513009,"name":"Aaron Reeves","orcid":"0000-0001-6387-7481","position":33,"is_corresponding":false},{"id":1513010,"name":"Edward Townsend","orcid":null,"position":34,"is_corresponding":false},{"id":709759,"name":"Robert D. Turner","orcid":"0000-0002-1353-1404","position":35,"is_corresponding":false},{"id":1513011,"name":"Jeremy Walton","orcid":"0000-0001-7372-178X","position":36,"is_corresponding":false},{"id":1513012,"name":"Richard Reeve","orcid":"0000-0003-2589-8091","position":37,"is_corresponding":false},{"id":1512964,"name":"Sonia Natalie Mitchell","orcid":"0000-0003-1536-2066","position":0,"is_corresponding":false}],"reference_count":0,"raw_metadata":{"has_enrichment":true,"resolved":true,"title":"FAIR data pipeline: provenance-driven data management for traceable scientific workflows","abstract":"<jats:p>Modern epidemiological analyses to understand and combat the spread of disease depend critically on access to, and use of, data. Rapidly evolving data, such as data streams changing during a disease outbreak, are particularly challenging. Data management is further complicated by data being imprecisely identified when used. Public trust in policy decisions resulting from such analyses is easily damaged and is often low, with cynicism arising where claims of ‘following the science’ are made without accompanying evidence. Tracing the provenance of such decisions back through open software to primary data would clarify this evidence, enhancing the transparency of the decision-making process. Here, we demonstrate a Findable, Accessible, Interoperable and Reusable (FAIR) data pipeline. Although developed during the COVID-19 pandemic, it allows easy annotation of any data as they are consumed by analyses, or conversely traces the provenance of scientific outputs back through the analytical or modelling source code to primary data. Such a tool provides a mechanism for the public, and fellow scientists, to better assess scientific evidence by inspecting its provenance, while allowing scientists to support policymakers in openly justifying their decisions. We believe that such tools should be promoted for use across all areas of policy-facing research.</jats:p>\n                  <jats:p>This article is part of the theme issue ‘Technical challenges of modelling real-life epidemics and examples of overcoming these’.</jats:p>","is_dataset_classified":null,"base_score":3.58351893845611,"endowment":3.58351893845611,"datacite_reuse_total":0,"file_count":0,"downloads":0,"views":0,"has_version_chain":false,"is_dataset":false,"is_oa":false,"pmid":"35965468","pmcid":"PMC9376726","openalex_id":"https://openalex.org/W3205484189","authors":[],"funders":[{"funder_name":"Engineering and Physical Sciences Research Council","grant_id":"EP/T004878/1","title":null},{"funder_name":"Engineering and Physical Sciences Research Council","grant_id":"EP/V054236/1","title":null},{"funder_name":"Biotechnology and Biological Sciences Research Council","grant_id":"BB/M003949/1","title":null},{"funder_name":"Biotechnology and Biological Sciences Research Council","grant_id":"BB/R012679/1","title":null},{"funder_name":"Biotechnology and Biological Sciences Research Council","grant_id":"BB/S001034/1","title":null},{"funder_name":"Scottish Government Chief Scientist Office","grant_id":"SPHSU17","title":null},{"funder_name":"Natural Environment Research Council","grant_id":"NE/T004193/1","title":null},{"funder_name":"Natural Environment Research Council","grant_id":"NE/T010355/1","title":null},{"funder_name":"Agence Nationale de la Recherche","grant_id":"ANR-16-IDEX-0005","title":null},{"funder_name":"Science and Technology Facilities Council","grant_id":"ST/V006126/1","title":null},{"funder_name":"UK Atomic Energy Authority","grant_id":"N/A - UKAEA funded, supported by BEIS","title":null},{"funder_name":"Medical Research Council","grant_id":"MC_UU_00022/2","title":null},{"funder_name":"Medical Research Council","grant_id":"MR/R00241X","title":null},{"funder_name":"Boehringer Ingelheim Animal Health France","grant_id":"The Veterinary Public Health (VPH) hub","title":null},{"funder_name":"Rural and Environment Science and Analytical Services Division","grant_id":"Centre of Expertise in Animal Disease Outbreaks","title":null},{"funder_name":"Rural and Environment Science and Analytical Services Division","grant_id":"Strategic Research Programme","title":null},{"funder_name":"Engineering and Physical Sciences Research Council","grant_id":"EP/V053507/1","title":null}],"total_grants":17,"fwci":12.8363,"citation_percentile":0.98048871,"influential_citations":0,"citation_trend":[{"year":2022,"count":7},{"year":2023,"count":6},{"year":2024,"count":12},{"year":2025,"count":5},{"year":2026,"count":5}],"oa_status":"green","license":"cc-by","oa_locations":[{"url":"https://www.research.ed.ac.uk/en/publications/e62eca54-3fc9-45d0-aa5f-e8b1f10912e5","host_type":"repository"},{"url":"https://www.research.ed.ac.uk/en/publications/e62eca54-3fc9-45d0-aa5f-e8b1f10912e5","host_type":"repository"},{"url":"https://royalsocietypublishing.org/doi/pdf/10.1098/rsta.2021.0300","host_type":"publisher"},{"url":"https://royalsocietypublishing.org/doi/full-xml/10.1098/rsta.2021.0300","host_type":"publisher"},{"url":"https://doi.org/10.1098/rsta.2021.0300","host_type":"journal"},{"url":"https://pubmed.ncbi.nlm.nih.gov/35965468","host_type":"repository"},{"url":"https://eprints.gla.ac.uk/view/journal_volume/Philosophical_Transactions_of_the_Royal_Society_A=3A_Mathematical,_Physical_and_Engineering_Sciences.html>,","host_type":"journal"},{"url":"http://arxiv.org/abs/2110.07117","host_type":"repository"},{"url":"https://hal.science/hal-03747524","host_type":"repository"},{"url":"https://hal.science/hal-03752208","host_type":"repository"},{"url":"https://www.ncbi.nlm.nih.gov/pmc/articles/9376726","host_type":"repository"},{"url":"https://arxiv.org/pdf/2110.07117","host_type":"repository"},{"url":"https://europepmc.org/articles/PMC9376726","host_type":"Europe_PMC"},{"url":"https://europepmc.org/articles/PMC9376726?pdf=render","host_type":"Europe_PMC"}],"fields_of_study":["Scientific Computing and Data Management","Research Data Management Practices","Distributed and Parallel Computing Systems"],"mesh_terms":["Data Management","COVID-19","Humans","Software","Workflow","Pandemics"],"keywords":["Workflow","Pipeline (software)","Provenance","Computer science","Data science","Data management","Database","Geology","Operating system","epidemiology","Modelling","Fair","Covid-19"],"sdg_mappings":[{"sdg_number":0,"sdg_label":"Good health and well-being"}],"linked_datasets":[],"clinical_trials":[],"software_tools":[],"database_accessions":[],"source":"live","citation_network_status":"fetched"},"created_at":"2026-07-25T15:51:58.778208Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}