{"doi":"10.1016/j.ymeth.2021.11.005","title":"External validation of a shortened screening tool using individual participant data meta-analysis: A case study of the Patient Health Questionnaire-Dep-4","abstract":"Shortened versions of self-reported questionnaires may be used to reduce respondent burden. When shortened screening tools are used, it is desirable to maintain equivalent diagnostic accuracy to full-length forms. This manuscript presents a case study that illustrates how external data and individual participant data meta-analysis can be used to assess the equivalence in diagnostic accuracy between a shortened and full-length form. This case study compares the Patient Health Questionnaire-9 (PHQ-9) and a 4-item shortened version (PHQ-Dep-4) that was previously developed using optimal test assembly methods. Using a large database of 75 primary studies (34,698 participants, 3,392 major depression cases), we evaluated whether the PHQ-Dep-4 cutoff of ≥ 4 maintained equivalent diagnostic accuracy to a PHQ-9 cutoff of ≥ 10. Using this external validation dataset, a PHQ-Dep-4 cutoff of ≥ 4 maximized the sum of sensitivity and specificity, with a sensitivity of 0.88 (95% CI 0.81, 0.93), 0.68 (95% CI 0.56, 0.78), and 0.80 (95% CI 0.73, 0.85) for the semi-structured, fully structured, and MINI reference standard categories, respectively, and a specificity of 0.79 (95% CI 0.74, 0.83), 0.85 (95% CI 0.78, 0.90), and 0.83 (95% CI 0.80, 0.86) for the semi-structured, fully structured, and MINI reference standard categories, respectively. While equivalence with a PHQ-9 cutoff of ≥ 10 was not established, we found the sensitivity of the PHQ-Dep-4 to be non-inferior to that of the PHQ-9, and the specificity of the PHQ-Dep-4 to be marginally smaller than the PHQ-9.","journal":"Methods","year":2022,"id":511,"datarank":0.29188652235829704,"base_score":1.9459101490553132,"endowment":1.9459101490553132,"self_citation_contribution":0.29188652235829704,"citation_network_contribution":0.0,"self_endowment_contribution":0.29188652235829704,"citer_contribution":0.0,"corpus_percentile":null,"corpus_rank":null,"citation_count":6,"citer_count":0,"citers_with_citation_signal":0,"citers_with_endowment":0,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":0.0463,"is_data_producer":false,"deposit_databanks":null,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2022-08-01","fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":2035,"name":"Brooke Levis","orcid":"0000-0002-4310-3689","position":1,"is_corresponding":false},{"id":2040,"name":"Ying Sun","orcid":"0000-0002-8529-3521","position":2,"is_corresponding":false},{"id":3162,"name":"Felix H. Fischer","orcid":"0000-0002-9693-6676","position":3,"is_corresponding":false},{"id":2052,"name":"Pim Cuijpers","orcid":"0000-0001-5497-2743","position":5,"is_corresponding":false},{"id":2055,"name":"Scott B. Patten","orcid":"0000-0001-9871-4041","position":6,"is_corresponding":false},{"id":2057,"name":"Roy C. Ziegelstein","orcid":"0000-0001-7671-1501","position":7,"is_corresponding":false},{"id":5048,"name":"Sarah Markham","orcid":"0000-0002-8755-5935","position":8,"is_corresponding":false},{"id":2083,"name":"Andrea Benedetti","orcid":"0000-0002-8314-9497","position":9,"is_corresponding":false},{"id":2034,"name":"Brett D. Thombs","orcid":"0000-0002-5644-8432","position":10,"is_corresponding":false},{"id":2041,"name":"Chen He","orcid":"0000-0002-7308-0350","position":11,"is_corresponding":false},{"id":2039,"name":"Yin Wu","orcid":"0000-0001-5527-1746","position":12,"is_corresponding":false},{"id":2042,"name":"Ankur Krishnan","orcid":"0000-0001-8671-7421","position":13,"is_corresponding":false},{"id":2044,"name":"Parash Mani Bhandari","orcid":"0000-0002-4235-3029","position":14,"is_corresponding":false},{"id":59287,"name":"Tiffany Dal Santo","orcid":"0000-0001-8505-3969","position":15,"is_corresponding":false},{"id":2038,"name":"Zelalem Negeri","orcid":"0000-0002-3154-3855","position":16,"is_corresponding":false},{"id":2045,"name":"Mahrukh Imran","orcid":"0000-0002-2478-0182","position":17,"is_corresponding":false},{"id":2046,"name":"Danielle B. Rice","orcid":"0000-0001-5615-7005","position":18,"is_corresponding":false},{"id":2050,"name":"Kira E. Riehm","orcid":"0000-0002-9061-0560","position":19,"is_corresponding":false},{"id":2047,"name":"Marleine Azar","orcid":null,"position":20,"is_corresponding":false},{"id":5049,"name":"Alexander W. Levis","orcid":"0000-0002-8678-0292","position":21,"is_corresponding":false},{"id":2084,"name":"Jill Boruff","orcid":"0000-0002-0338-7322","position":22,"is_corresponding":false},{"id":2053,"name":"Simon Gilbody","orcid":"0000-0002-8236-6983","position":23,"is_corresponding":false},{"id":2054,"name":"Lorie A. Kloda","orcid":"0000-0003-1429-1497","position":24,"is_corresponding":false},{"id":5050,"name":"Dagmar Amtmann","orcid":"0000-0003-1142-9729","position":25,"is_corresponding":false},{"id":5985,"name":"Bruce Arroll","orcid":"0000-0002-0451-9462","position":26,"is_corresponding":false},{"id":3089,"name":"Anna Beraldi","orcid":null,"position":28,"is_corresponding":false},{"id":5053,"name":"Charles N. Bernstein","orcid":null,"position":29,"is_corresponding":false},{"id":5054,"name":"Arvin Bhana","orcid":"0000-0003-4235-0108","position":30,"is_corresponding":false},{"id":5055,"name":"Ryna Imma Buji","orcid":"0000-0003-2366-4400","position":31,"is_corresponding":false},{"id":5057,"name":"Juliana C. N. Chan","orcid":null,"position":33,"is_corresponding":false},{"id":5058,"name":"Lai Fong Chan","orcid":"0000-0003-0958-6178","position":34,"is_corresponding":false},{"id":5059,"name":"Dixon Chibanda","orcid":"0000-0003-2505-8607","position":35,"is_corresponding":false},{"id":5060,"name":"Aaron Conway","orcid":"0000-0002-9583-8636","position":36,"is_corresponding":false},{"id":3101,"name":"Federico M. Daray","orcid":"0000-0003-2949-7252","position":37,"is_corresponding":false},{"id":5061,"name":"Janneke M. de Man-van Ginkel","orcid":null,"position":38,"is_corresponding":false},{"id":5062,"name":"Crisanto Diez-Quevedo","orcid":null,"position":39,"is_corresponding":false},{"id":5063,"name":"Sally Field","orcid":"0000-0002-7917-2598","position":40,"is_corresponding":false},{"id":5064,"name":"Jane R. W. Fisher","orcid":null,"position":41,"is_corresponding":false},{"id":5065,"name":"Daniel Fung","orcid":"0000-0003-0718-9363","position":42,"is_corresponding":false},{"id":5066,"name":"Emily C. Garman","orcid":null,"position":43,"is_corresponding":false},{"id":5067,"name":"Alan J. Flisher","orcid":null,"position":44,"is_corresponding":false},{"id":6053,"name":"Felicity Goodyear‐Smith","orcid":"0000-0002-6657-9401","position":45,"is_corresponding":false},{"id":5069,"name":"Leila Gholizadeh","orcid":"0000-0002-6711-3312","position":46,"is_corresponding":false},{"id":5070,"name":"Lorna J. Gibson","orcid":null,"position":47,"is_corresponding":false},{"id":13504,"name":"Robert C. Grant","orcid":"0000-0002-9821-0377","position":48,"is_corresponding":false},{"id":5072,"name":"Brian J. Hall","orcid":"0000-0001-9358-2377","position":49,"is_corresponding":false},{"id":5073,"name":"Liisa Hantsoo","orcid":"0000-0002-3402-9499","position":50,"is_corresponding":false},{"id":5074,"name":"Emily E. Haroz","orcid":"0000-0003-1833-4925","position":51,"is_corresponding":false},{"id":3113,"name":"Martin Härter","orcid":"0000-0001-7443-9890","position":52,"is_corresponding":false},{"id":5075,"name":"Ulrich Hegerl","orcid":"0000-0002-3039-7470","position":53,"is_corresponding":false},{"id":5077,"name":"Stevan E. Hobfoll","orcid":"0000-0003-4136-0929","position":55,"is_corresponding":false},{"id":5078,"name":"Simone Honikman","orcid":"0000-0002-7045-5532","position":56,"is_corresponding":false},{"id":5079,"name":"Marie Hudson","orcid":"0000-0001-6718-2468","position":57,"is_corresponding":false},{"id":5080,"name":"Thomas N. Hyphantis","orcid":"0000-0002-7647-4312","position":58,"is_corresponding":false},{"id":5081,"name":"Masatoshi Inagaki","orcid":"0000-0002-9822-8649","position":59,"is_corresponding":false},{"id":5082,"name":"Hong Jin Jeon","orcid":"0000-0002-6126-542X","position":60,"is_corresponding":false},{"id":3115,"name":"Nathalie Jetté","orcid":"0000-0003-1351-5866","position":61,"is_corresponding":false},{"id":5083,"name":"Mohammad E. Khamseh","orcid":"0000-0003-4313-8440","position":62,"is_corresponding":false},{"id":3120,"name":"Sebastian Köhler","orcid":"0000-0002-2398-0609","position":63,"is_corresponding":false},{"id":5084,"name":"Brandon A. Kohrt","orcid":"0000-0002-3829-4820","position":64,"is_corresponding":false},{"id":6009,"name":"Kim M. Kiely","orcid":"0000-0001-5876-3201","position":65,"is_corresponding":false},{"id":5086,"name":"Femke Lamers","orcid":"0000-0003-4344-5766","position":66,"is_corresponding":false},{"id":5087,"name":"Maria Asunción Lara","orcid":null,"position":67,"is_corresponding":false},{"id":5088,"name":"Holly F. Levin-Aspenson","orcid":null,"position":68,"is_corresponding":false},{"id":5089,"name":"Shen-Ing Liu","orcid":null,"position":69,"is_corresponding":false},{"id":2136,"name":"Bernd Löwe","orcid":"0000-0003-4220-3378","position":72,"is_corresponding":false},{"id":5092,"name":"Nagendra P. Luitel","orcid":"0000-0002-8291-0205","position":73,"is_corresponding":false},{"id":5093,"name":"Crick Lund","orcid":"0000-0002-5159-8220","position":74,"is_corresponding":false},{"id":5094,"name":"Ruth Ann Marrie","orcid":"0000-0002-1855-5595","position":76,"is_corresponding":false},{"id":5095,"name":"Brian P. Marx","orcid":"0000-0001-8988-1796","position":77,"is_corresponding":false},{"id":5096,"name":"Sherina Mohd Sidik","orcid":"0000-0001-6754-6145","position":78,"is_corresponding":false},{"id":5097,"name":"Tiago N. Munhoz","orcid":"0000-0003-1281-9542","position":79,"is_corresponding":false},{"id":5099,"name":"Juliet E. M. Nakku","orcid":null,"position":81,"is_corresponding":false},{"id":5100,"name":"Laura Navarrete","orcid":"0000-0001-5421-9794","position":82,"is_corresponding":false},{"id":5102,"name":"Philippe Persoons","orcid":"0000-0002-4052-3127","position":84,"is_corresponding":false},{"id":5104,"name":"Stephanie L. Pugh","orcid":"0000-0002-5977-8912","position":86,"is_corresponding":false},{"id":3134,"name":"Terence J. Quinn","orcid":"0000-0003-1401-0181","position":87,"is_corresponding":false},{"id":5105,"name":"Elmars Rancans","orcid":null,"position":88,"is_corresponding":false},{"id":5106,"name":"Sujit D. Rathod","orcid":"0000-0001-8783-7724","position":89,"is_corresponding":false},{"id":3136,"name":"Katrin Reuter","orcid":null,"position":90,"is_corresponding":false},{"id":5107,"name":"Heather J. Rowe","orcid":null,"position":91,"is_corresponding":false},{"id":5108,"name":"Iná S. Santos","orcid":"0000-0003-1258-9249","position":92,"is_corresponding":false},{"id":5109,"name":"Miranda T. Schram","orcid":"0000-0001-8113-7604","position":93,"is_corresponding":false},{"id":5110,"name":"Eileen H. Shinn","orcid":"0000-0002-3220-7423","position":95,"is_corresponding":false},{"id":5111,"name":"Lena Spangenberg","orcid":"0000-0001-8248-6734","position":96,"is_corresponding":false},{"id":3146,"name":"Lesley Stafford","orcid":"0000-0002-6460-9881","position":97,"is_corresponding":false},{"id":5113,"name":"Keiko Suzuki","orcid":"0000-0002-4285-0658","position":99,"is_corresponding":false},{"id":5114,"name":"Pei Lin Lynnette Tan","orcid":"0009-0001-1716-6563","position":100,"is_corresponding":false},{"id":53976,"name":"Martin Scherer","orcid":"0000-0003-3448-9679","position":101,"is_corresponding":false},{"id":2079,"name":"Thach D. Tran","orcid":null,"position":102,"is_corresponding":false},{"id":5117,"name":"Thandi van Heyningen","orcid":"0000-0002-5812-6170","position":104,"is_corresponding":false},{"id":5119,"name":"Lynne I. Wagner","orcid":"0000-0001-9685-4796","position":106,"is_corresponding":false},{"id":5120,"name":"Jian Li Wang","orcid":null,"position":107,"is_corresponding":false},{"id":5121,"name":"David Watson","orcid":"0000-0003-2125-2373","position":108,"is_corresponding":false},{"id":5122,"name":"Karen Wynter","orcid":"0000-0003-4620-7691","position":109,"is_corresponding":false},{"id":5123,"name":"Mitsuhiko Yamada","orcid":"0000-0002-5649-2310","position":110,"is_corresponding":false},{"id":5124,"name":"Qing Zhi Zeng","orcid":null,"position":111,"is_corresponding":false},{"id":148,"name":"John P. A. Ioannidis","orcid":"0000-0003-3118-6859","position":113,"is_corresponding":false},{"id":5126,"name":"Hamid Reza Baradaran","orcid":"0000-0002-5070-5864","position":114,"is_corresponding":false},{"id":5127,"name":"Çharles N. Bernstein","orcid":"0000-0001-8041-3574","position":115,"is_corresponding":false},{"id":5128,"name":"Marcos Hortes Nisihara Chagas","orcid":"0000-0003-3752-7984","position":116,"is_corresponding":false},{"id":1143,"name":"Juliana C.N. Chan","orcid":"0000-0003-1325-1194","position":117,"is_corresponding":false},{"id":5129,"name":"Janneke M. de Man‐van Ginkel","orcid":"0000-0002-3702-3711","position":118,"is_corresponding":false},{"id":5130,"name":"Crisanto Díez","orcid":"0000-0002-0705-295X","position":119,"is_corresponding":false},{"id":5131,"name":"Jane Fisher","orcid":"0000-0002-1959-6807","position":120,"is_corresponding":false},{"id":5132,"name":"Emily Garman","orcid":"0000-0002-8128-5997","position":121,"is_corresponding":false},{"id":5133,"name":"Eric Green","orcid":"0000-0003-2188-2244","position":122,"is_corresponding":false},{"id":5134,"name":"Ma. Asunción Lara","orcid":"0000-0002-0536-8520","position":123,"is_corresponding":false},{"id":5135,"name":"Holly Frances Levin-Aspenson","orcid":"0000-0002-3980-8299","position":124,"is_corresponding":false},{"id":5136,"name":"Shen‐Ing Liu","orcid":null,"position":125,"is_corresponding":false},{"id":5137,"name":"Sônia Regina Loureiro","orcid":"0000-0001-9423-2897","position":126,"is_corresponding":false},{"id":5138,"name":"Juliet Nakku","orcid":"0000-0002-0611-1102","position":127,"is_corresponding":false},{"id":5139,"name":"Flávia de Lima Osório","orcid":"0000-0003-1396-555X","position":128,"is_corresponding":false},{"id":5140,"name":"Elmārs Rancāns","orcid":"0000-0002-8329-7887","position":129,"is_corresponding":false},{"id":5141,"name":"Heather Rowe","orcid":"0000-0002-3664-6167","position":130,"is_corresponding":false},{"id":5142,"name":"Martin Taylor‐Rowan","orcid":"0000-0002-3027-5369","position":131,"is_corresponding":false},{"id":2089,"name":"Thach Tran","orcid":"0000-0002-4686-8601","position":132,"is_corresponding":false},{"id":5143,"name":"Christina M. van der Feltz‐Cornelis","orcid":"0000-0001-6925-8956","position":133,"is_corresponding":false},{"id":5144,"name":"Henk van Weert","orcid":"0000-0001-6370-4724","position":134,"is_corresponding":false},{"id":5145,"name":"JianLi Wang","orcid":"0000-0002-1329-914X","position":135,"is_corresponding":false},{"id":5047,"name":"Daphna Harel","orcid":"0000-0001-7015-5989","position":0,"is_corresponding":true}],"reference_count":40,"raw_metadata":{"citation_network_status":"fetched"},"created_at":"2026-03-01T18:20:47.508186Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}