{"doi":"10.1007/s11192-016-2237-2","title":"How many scientific papers are mentioned in policy-related documents? An empirical investigation using Web of Science and Altmetric data","abstract":"In this short communication, we provide an overview of a relatively newly provided source of altmetrics data which could possibly be used for societal impact measurements in scientometrics. Recently, Altmetric-a start-up providing publication level metrics-started to make data for publications available which have been mentioned in policy-related documents. Using data from Altmetric, we study how many papers indexed in the Web of Science (WoS) are mentioned in policy-related documents. We find that less than 0.5% of the papers published in different subject categories are mentioned at least once in policy-related documents. Based on our results, we recommend that the analysis of (WoS) publications with at least one policy-related mention is repeated regularly (annually) in order to check the usefulness of the data. Mentions in policy-related documents should not be used for impact measurement until new policy-related sites are tracked.","journal":"Scientometrics","year":2017,"id":9311,"datarank":4.076454072368429,"base_score":4.219507705176107,"endowment":4.219507705176107,"self_citation_contribution":0.6329261557764161,"citation_network_contribution":3.4435279165920125,"self_endowment_contribution":0.6329261557764161,"citer_contribution":3.4435279165920125,"corpus_percentile":69.81285598047192,"corpus_rank":372,"citation_count":73,"citer_count":64,"citers_with_citation_signal":47,"citers_with_endowment":47,"datacite_reuse_total":0,"is_dataset":true,"is_dataset_confidence":0.7608,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2017-01-09","fair_score":22.7083,"fair_percentile":2.440633245382586,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":661,"name":"Lutz Bornmann","orcid":"0000-0003-0810-7091","position":1,"is_corresponding":false},{"id":839,"name":"Robin Haunschild","orcid":"0000-0001-7025-7256","position":0,"is_corresponding":true}],"reference_count":18,"raw_metadata":{"citation_network_status":"fetched"},"created_at":"2026-03-01T18:20:47.508186Z","pmid":"28255186","pmcid":"PMC5311084","fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":"hybrid","license":"cc-by","views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":40.0,"fair_a":30.0,"fair_i":12.5,"fair_r":8.3333,"fair_zscore":-2.0355,"fair_rationale":{"fair_score":22.71,"has_llm":true,"dimensions":{"F":{"name":"Findable","score":40.0,"criteria":[{"key":"f_has_doi","label":"Has a persistent DOI","kind":"deterministic","weight":1.0,"fraction":1.0,"signal":"DOI present","rationale":null},{"key":"f_repository_presence","label":"Indexed in repositories / literature DBs","kind":"deterministic","weight":1.0,"fraction":1.0,"signal":"datacite=0, pmcid=True, pmid=True","rationale":null},{"key":"f_persistent_ids","label":"Resolvable scholarly identifiers (OpenAlex)","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"no OpenAlex id","rationale":null},{"key":"f_metadata_richness","label":"Rich, machine-readable metadata","kind":"llm","weight":1.0,"fraction":0.0,"signal":null,"rationale":"The paper does not mention any machine-readable metadata provision or use of standardized metadata schemas (e.g., Dublin Core, DataCite) for its data."}]},"A":{"name":"Accessible","score":30.0,"criteria":[{"key":"a_open_access","label":"Open Access / files deposited","kind":"deterministic","weight":1.5,"fraction":1.0,"signal":"Open Access","rationale":null},{"key":"a_retrievable","label":"Free full text retrievable","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"0 OA location(s)","rationale":null},{"key":"a_access_protocol","label":"Clear data/code access protocol","kind":"llm","weight":1.0,"fraction":0.0,"signal":null,"rationale":"There is no statement providing a protocol or link to access the underlying data (bibliometric and altmetrics data); the paper only mentions that data were retrieved from proprietary sources."}]},"I":{"name":"Interoperable","score":12.5,"criteria":[{"key":"i_linked_data","label":"Linked datasets / DataCite relations","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"linked_datasets=0, datacite=0","rationale":null},{"key":"i_standard_ids","label":"References data via standard accessions","kind":"deterministic","weight":1.0,"fraction":0.0,"signal":"accessions=0, trials=0","rationale":null},{"key":"i_standards","label":"Standard formats, vocabularies & identifiers","kind":"llm","weight":1.0,"fraction":0.25,"signal":null,"rationale":"The paper uses DOIs as identifiers, which is a standard, but does not mention using controlled vocabularies or standard file formats for data sharing."}]},"R":{"name":"Reusable","score":8.33,"criteria":[{"key":"r_license","label":"Clear, open reuse license","kind":"deterministic","weight":1.5,"fraction":0.0,"signal":"no license","rationale":null},{"key":"r_downloads","label":"Demonstrated reuse (downloads)","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"downloads=0","rationale":null},{"key":"r_version","label":"Versioned / maintained","kind":"deterministic","weight":0.5,"fraction":0.0,"signal":"no version chain","rationale":null},{"key":"r_dataset","label":"Classified as a data resource","kind":"deterministic","weight":0.5,"fraction":1.0,"signal":"is_dataset","rationale":null},{"key":"r_reusability","label":"Data-availability statement, license & reproducibility","kind":"llm","weight":2.0,"fraction":0.0,"signal":null,"rationale":"No data-availability statement, license for data or code, or reproducibility information is provided; the paper only has a general CC-BY license for the article text itself."}]}},"suggestions":["Provide a data-availability statement explicitly describing how to access the merged bibliometric and altmetrics dataset, ideally in a public repository.","Include the DOI or accession numbers for the altmetrics dataset used (if any) to enable machine access.","Describe the data formats used (e.g., CSV, JSON) and any controlled vocabularies applied to category fields to improve interoperability.","Add a license for the derived dataset (e.g., CC0 or CC-BY) separately from the article license to clarify reuse permissions.","Specify the exact version of the WoS and Altmetric data retrieval (e.g., date, query parameters) to enable reproducibility."],"model":"deepseek/deepseek-v4-flash","agent_version":"fair_agent_v2","fulltext_source":"epmc_xml"},"fair_model":"deepseek/deepseek-v4-flash","fair_agent_version":"fair_agent_v2","fair_fulltext_source":"epmc_xml","fair_has_llm":true,"fair_computed_at":"2026-06-18T00:41:48.077805Z","clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}