{"doi":"10.18260/1-2--46841","title":"Board 268: Enhancing Zero-Shot Learning of Large Language Models for Early Forecasting of STEM Performance","abstract":"This paper introduces an innovative application of conversational Large Language Models (LLMs), such as OpenAI's ChatGPT and Google's Gemini, for the early prediction of student performance in STEM education, circumventing the need for extensive data collection or specialized model training.Utilizing the intrinsic capabilities of these pre-trained LLMs, we develop a cost-efficient, training-free strategy for forecasting end-of-semester outcomes based on initial academic indicators.Our research investigates the efficacy of these LLMs in zero-shot learning scenarios, focusing on their ability to forecast academic outcomes from minimal input.By incorporating diverse data elements, including students' background, cognitive, and non-cognitive factors, we aim to enhance the models' zero-shot forecasting accuracy.Our empirical studies on data from first-year college students in an introductory programming course reveal the potential of conversational LLMs to offer early warnings about students at risk, thereby facilitating timely interventions.The findings suggest that while fine-tuning could further improve performance, our training-free approach presents a valuable tool for educators and institutions facing resource constraints.The inclusion of broader feature dimensions and the strategic design of cognitive assessments emerge as key factors in maximizing the zero-shot efficacy of LLMs for educational forecasting.Our work underscores the significant opportunities for leveraging conversational LLMs in educational settings and sets the stage for future advancements in personalized, data-driven student support.","journal":"Papers on Engineering Education Repository (American Society for Engineering Education)","year":2024,"id":491554,"datarank":0.0,"base_score":0.0,"endowment":0.0,"self_citation_contribution":0.0,"citation_network_contribution":0.0,"self_endowment_contribution":0.0,"citer_contribution":0.0,"corpus_percentile":null,"corpus_rank":null,"citation_count":1,"citer_count":0,"citers_with_citation_signal":0,"citers_with_endowment":0,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":0.9579,"is_data_producer":false,"deposit_databanks":null,"is_oa":true,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":"2024-01-01","fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":1337510,"name":"Sharif Akil","orcid":null,"position":1,"is_corresponding":false},{"id":1337144,"name":"Helen Martinez","orcid":"0000-0002-7646-9126","position":2,"is_corresponding":false},{"id":1054235,"name":"Bilal Khan","orcid":"0000-0002-0382-4502","position":3,"is_corresponding":false},{"id":1054234,"name":"Mohammad Rashedul Hasan","orcid":"0000-0002-9818-9600","position":4,"is_corresponding":false},{"id":1337509,"name":"Ahatsham Hayat","orcid":null,"position":0,"is_corresponding":true}],"reference_count":16,"raw_metadata":null,"created_at":"2026-07-19T02:08:45.247225Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}