{"doi":"10.1007/s11121-024-01706-6","title":"Does Being In-Person Matter? Demonstrating the Feasibility and Reliability of Fully Remote Observational Data Collection","abstract":"<jats:title>Abstract</jats:title>\n                  <jats:p>\n                    Many conventional research methods employed in randomized controlled trials were not possible during the height of the COVID-19 pandemic. In particular, behavioral observations are nearly universally gathered in-person. Observational methods are valued for the rich, informative data they produce in comparison to non-observational methods and are a cornerstone of parenting and family research. COVID provided the opportunity to, and indeed necessitated, the transition to fully remote observation. However, little to no studies have investigated whether remotely collected observational data are methodologically sound. This paper assesses the feasibility of remote data collection by describing the transition between in-person and fully remote observational data collection during a Sequential, Multiple Assignment, Randomized Trial (SMART) of a parenting program that took place both before and during the pandemic. Using mixed-methods data from coders, the overall quality of video-recorded data collected both before and during COVID was examined. Coder reliability over time was assessed with intraclass correlation coefficients. Results suggest that the frequency of audio problems, the severity of visual problems, and the level of administration challenges\n                    <jats:italic>decreased</jats:italic>\n                    after transitioning to remote data collection. Additionally, coders showed good to excellent reliability coding remotely collected data, and reliability even improved on some measured tasks. Although challenges to remote data collection exist, this study demonstrated that observational data can be collected feasibly and reliably. As observational data collection is a key method to assess parenting practices, these findings should improve researcher confidence in utilizing remote observational methods in prevention science.\n                  </jats:p>","journal":"Prevention Science","year":2026,"id":17017,"datarank":0.3687379215060122,"base_score":2.0794415416798357,"endowment":2.0794415416798357,"self_citation_contribution":0.31191623125197543,"citation_network_contribution":0.056821690254036765,"self_endowment_contribution":0.31191623125197543,"citer_contribution":0.056821690254036765,"corpus_percentile":null,"corpus_rank":null,"citation_count":7,"citer_count":7,"citers_with_citation_signal":3,"citers_with_endowment":3,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":null,"is_data_producer":false,"deposit_databanks":null,"is_oa":false,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":null,"fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":123285,"name":"Qiyue Cai","orcid":"0000-0001-8612-1759","position":1,"is_corresponding":false},{"id":123286,"name":"Susanne Lee","orcid":"0009-0005-8957-3239","position":2,"is_corresponding":false},{"id":123287,"name":"Tiffany Tran","orcid":"0000-0002-4185-629X","position":3,"is_corresponding":false},{"id":123288,"name":"Amy Majerle","orcid":null,"position":4,"is_corresponding":false},{"id":123289,"name":"Shauna Tiede","orcid":null,"position":5,"is_corresponding":false},{"id":123290,"name":"Abigail H. Gewirtz","orcid":"0000-0001-7376-2952","position":6,"is_corresponding":false},{"id":123284,"name":"Sydni A. J. Basha","orcid":"0000-0002-2252-6690","position":0,"is_corresponding":false}],"reference_count":0,"raw_metadata":{"has_enrichment":true,"base_score":2.0794415416798357,"endowment":2.0794415416798357,"datacite_reuse_total":0,"file_count":0,"downloads":0,"views":0,"has_version_chain":false,"is_dataset":false,"is_oa":false,"pmid":"38995340","pmcid":"PMC11899375","openalex_id":"https://openalex.org/W4400590447","authors":[],"funders":[{"funder_name":"Military Operational Medicine Research Program","grant_id":"W81XWH-16-1-0407","title":null},{"funder_name":"National Institutes of Health","grant_id":"T32 DA039772","title":null},{"funder_name":"National Institutes of Health","grant_id":"5T32DA039772-03","title":"Research training in drug abuse/HIV prevention: closing the research-practice gap"},{"funder_name":"Hebrew University of Jerusalem","grant_id":"","title":null}],"total_grants":4,"fwci":2.5093,"citation_percentile":0.89828725,"influential_citations":0,"citation_trend":[{"year":2025,"count":6},{"year":2026,"count":1}],"oa_status":"hybrid","license":"cc-by","oa_locations":[{"url":"https://link.springer.com/content/pdf/10.1007/s11121-024-01706-6.pdf","host_type":"journal"},{"url":"https://link.springer.com/content/pdf/10.1007/s11121-024-01706-6.pdf","host_type":"publisher"},{"url":"https://link.springer.com/article/10.1007/s11121-024-01706-6","host_type":"publisher"},{"url":"https://doi.org/10.1007/s11121-024-01706-6","host_type":"journal"},{"url":"https://pubmed.ncbi.nlm.nih.gov/38995340","host_type":"repository"},{"url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11899375/","host_type":"repository"},{"url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11899375/pdf/nihms-2061915.pdf","host_type":"repository"},{"url":"https://europepmc.org/articles/PMC11899375","host_type":"Europe_PMC"},{"url":"https://europepmc.org/articles/PMC11899375?pdf=render","host_type":"Europe_PMC"},{"url":"https://pubmed.ncbi.nlm.nih.gov/38995340/","host_type":""}],"fields_of_study":["Behavioral Health and Interventions","Digital Mental Health Interventions","COVID-19 and Mental Health","Medicine","Sociology","Psychology","05 social sciences","0501 psychology and cognitive sciences","Humans","COVID-19","Reproducibility of Results","Feasibility Studies","Data Collection","SARS-CoV-2","Pandemics","Parenting","Female","Male"],"mesh_terms":["COVID-19","SARS-CoV-2","Data Collection","Feasibility Studies","Female","Humans","Male","Reproducibility of Results","Parenting","Pandemics"],"keywords":["Observational study","Observational methods in psychology","Data collection","Reliability (semiconductor)","Computer science","Randomized controlled trial","Medicine","Statistics","Mathematics","Parenting","Military Families","Observational Methodology","Observational Research","Covid","Article"],"sdg_mappings":[{"sdg_number":3,"sdg_label":"3. Good health"},{"sdg_number":0,"sdg_label":"Good health and well-being"}],"linked_datasets":[],"clinical_trials":[],"software_tools":[],"database_accessions":[],"source":"live","citation_network_status":"fetched"},"created_at":"2026-06-02T15:55:37.676987Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}