{"doi":"10.1101/2020.12.15.20248283","title":"Crowdsourced feature tagging for scalable and privacy-preserved autism diagnosis","abstract":"ABSTRACT Standard medical diagnosis of mental health conditions often requires licensed experts who are increasingly outnumbered by those at risk, limiting reach. We test the hypothesis that a trustworthy crowd of non-experts can efficiently label features needed for accurate machine learning detection of the common childhood developmental disorder autism. We implement a novel process for creating a trustworthy distributed workforce for video feature extraction, selecting a workforce of 102 workers from a pool of 1,107. Two previously validated binary autism logistic regression classifiers were used to evaluate the quality of the curated crowd’s ratings on unstructured home videos. A clinically representative balanced sample (N=50 videos) of videos were evaluated with and without face box and pitch shift privacy alterations, with AUROC and AUPRC scores >0.98. With both privacy-preserving modifications, sensitivity is preserved (96.0%) while maintaining specificity (80.0%) and accuracy (88.0%) at levels that exceed classification methods without alterations. We find that machine learning classification from features extracted by a curated nonexpert crowd achieves clinical performance for pediatric autism videos and maintains acceptable performance when privacy-preserving mechanisms are applied. These results suggest that privacy-based crowdsourcing of short videos can be leveraged for rapid and mobile assessment of behavioral health.","journal":"medRxiv","year":2020,"id":120381,"datarank":0.37273599746820013,"base_score":2.4849066497880004,"endowment":2.4849066497880004,"self_citation_contribution":0.37273599746820013,"citation_network_contribution":0.0,"self_endowment_contribution":0.37273599746820013,"citer_contribution":0.0,"corpus_percentile":null,"corpus_rank":null,"citation_count":11,"citer_count":0,"citers_with_citation_signal":0,"citers_with_endowment":0,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":0.9419,"is_data_producer":false,"deposit_databanks":null,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2020-01-01","fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":557619,"name":"Qandeel Tariq","orcid":"0000-0002-5217-8332","position":1,"is_corresponding":false},{"id":323277,"name":"Émilie Leblanc","orcid":"0000-0002-3492-3554","position":2,"is_corresponding":false},{"id":323283,"name":"Brianna Chrisman","orcid":"0000-0002-7157-607X","position":3,"is_corresponding":false},{"id":323278,"name":"Kaitlyn Dunlap","orcid":"0000-0003-4423-5269","position":4,"is_corresponding":false},{"id":323280,"name":"Aaron Kline","orcid":"0000-0002-0077-5485","position":5,"is_corresponding":false},{"id":557620,"name":"Haik Kalantarian","orcid":"0000-0002-7107-7908","position":6,"is_corresponding":false},{"id":323279,"name":"Yordan Penev","orcid":"0000-0001-8520-9417","position":7,"is_corresponding":false},{"id":323281,"name":"Kelley Paskov","orcid":"0000-0002-5252-1401","position":8,"is_corresponding":false},{"id":323285,"name":"Catalin Voss","orcid":"0000-0001-6480-7020","position":9,"is_corresponding":false},{"id":324708,"name":"Nathaniel Stockham","orcid":null,"position":10,"is_corresponding":false},{"id":323284,"name":"Maya Varma","orcid":"0000-0003-0693-7753","position":11,"is_corresponding":false},{"id":557621,"name":"Arman Husic","orcid":"0000-0002-9180-5212","position":12,"is_corresponding":false},{"id":558290,"name":"Jack Kent","orcid":null,"position":13,"is_corresponding":false},{"id":323286,"name":"Nick Haber","orcid":"0000-0001-8804-7804","position":14,"is_corresponding":false},{"id":350078,"name":"Terry Winograd","orcid":"0000-0003-4435-7215","position":15,"is_corresponding":false},{"id":80565,"name":"Dennis P. Wall","orcid":"0000-0002-7889-9146","position":16,"is_corresponding":false},{"id":323276,"name":"Peter Washington","orcid":"0000-0003-3276-4411","position":0,"is_corresponding":true}],"reference_count":59,"raw_metadata":{"citation_network_status":"fetched"},"created_at":"2026-07-18T23:14:33.640077Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}