{"doi":"10.17504/protocols.io.6x8hfrw","title":"University Published Paper Reproducibility Assessment Protocol - For Teachers v1","abstract":"<p>This protocol is for teachers to set up a data curation exercise for their students. Using a universities IR or CRIS to select papers that their researchers have published, and then assign them to students to see if the data availability meets the national, funder, university and journal policies. The students carrying out this assessment have a separate related protocol they need to follow. </p>","journal":null,"year":2019,"id":11016,"datarank":0.0,"base_score":0.0,"endowment":0.0,"self_citation_contribution":0.0,"citation_network_contribution":0.0,"self_endowment_contribution":0.0,"citer_contribution":0.0,"corpus_percentile":0.0,"corpus_rank":10062,"citation_count":0,"citer_count":0,"citers_with_citation_signal":0,"citers_with_endowment":0,"datacite_reuse_total":0,"is_dataset":true,"is_dataset_confidence":0.5292,"is_data_producer":false,"deposit_databanks":null,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2019-08-30","fair_score":28.125,"fair_percentile":8.167770419426049,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":31235,"name":"Jesse Xiao","orcid":null,"position":1,"is_corresponding":false},{"id":14760,"name":"Hongling Zhou","orcid":"0000-0002-7295-8176","position":2,"is_corresponding":false},{"id":46,"name":"Scott C. Edmunds","orcid":"0000-0001-6444-1436","position":0,"is_corresponding":true}],"reference_count":0,"raw_metadata":null,"created_at":"2026-03-01T18:20:47.508186Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":"gold","license":"other-oa","views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":32.5,"fair_a":42.5,"fair_i":12.5,"fair_r":25.0,"fair_zscore":-1.4312,"fair_rationale":{"fair_score":28.12,"has_llm":true,"dimensions":{"F":{"name":"Findable","score":32.5,"criteria":[{"key":"f_has_doi","label":"Has a persistent DOI","kind":"deterministic","weight":1.0,"fraction":1.0,"signal":"DOI present","rationale":null},{"key":"f_repository_presence","label":"Indexed in repositories / literature DBs","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"datacite=0, pmcid=False, pmid=False","rationale":null},{"key":"f_persistent_ids","label":"Resolvable scholarly identifiers (OpenAlex)","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"no OpenAlex id","rationale":null},{"key":"f_metadata_richness","label":"Rich, machine-readable metadata","kind":"llm","weight":1.0,"fraction":0.25,"signal":null,"rationale":"The paper provides a DOI but lacks machine-readable metadata such as structured keywords, ontology terms, or formal metadata schema in the text."}]},"A":{"name":"Accessible","score":42.5,"criteria":[{"key":"a_open_access","label":"Open Access / files deposited","kind":"deterministic","weight":1.5,"fraction":1.0,"signal":"Open Access","rationale":null},{"key":"a_retrievable","label":"Free full text retrievable","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"0 OA location(s)","rationale":null},{"key":"a_access_protocol","label":"Clear data/code access protocol","kind":"llm","weight":1.0,"fraction":0.25,"signal":null,"rationale":"The protocol does not specify a clear, standardized access protocol for retrieving the underlying data/code; it only describes a manual email-based verification for 'data on request'."}]},"I":{"name":"Interoperable","score":12.5,"criteria":[{"key":"i_linked_data","label":"Linked datasets / DataCite relations","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"linked_datasets=0, datacite=0","rationale":null},{"key":"i_standard_ids","label":"References data via standard accessions","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"accessions=0, trials=0","rationale":null},{"key":"i_standards","label":"Standard formats, vocabularies & identifiers","kind":"llm","weight":1.0,"fraction":0.25,"signal":null,"rationale":"Use of standard identifiers (DOI, DSpace handles) is present, but no standard formats, controlled vocabularies, or formal interoperability standards are described."}]},"R":{"name":"Reusable","score":25.0,"criteria":[{"key":"r_license","label":"Clear, open reuse license","kind":"deterministic","weight":1.5,"fraction":0.0,"signal":"no license","rationale":null},{"key":"r_downloads","label":"Demonstrated reuse (downloads)","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"downloads=0","rationale":null},{"key":"r_version","label":"Versioned / maintained","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"no version chain","rationale":null},{"key":"r_dataset","label":"Classified as a data resource","kind":"deterministic","weight":0.5,"fraction":1.0,"signal":"is_dataset","rationale":null},{"key":"r_reusability","label":"Data-availability statement, license & reproducibility","kind":"llm","weight":2.0,"fraction":0.333,"signal":null,"rationale":"The protocol has an open license (Creative Commons Attribution) and is openly shared, but lacks a data-availability statement for its own outputs and provides minimal detail for reproducibility of the assessment process."}]}},"suggestions":["Add machine-readable metadata (e.g., Schema.org/Dublin Core) to the protocol's landing page.","Specify an access protocol (e.g., REST API or download link) for the assessment spreadsheet and student data.","Define controlled vocabularies for the assessment categories (e.g., 'Data available', 'Data on request').","Include a reusable data-availability statement and license for the protocol's output dataset.","Provide more detailed steps for reproducing the web scraping script (e.g., input parameters, expected output formats)."],"model":"deepseek/deepseek-v4-flash","agent_version":"fair_agent_v2","fulltext_source":"unpaywall_pdf"},"fair_model":"deepseek/deepseek-v4-flash","fair_agent_version":"fair_agent_v2","fair_fulltext_source":"unpaywall_pdf","fair_has_llm":true,"fair_computed_at":"2026-06-18T06:45:45.371243Z","clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}