{"doi":"10.1016/j.jneumeth.2021.109098","title":"Grad-CAM helps interpret the deep learning models trained to classify multiple sclerosis types using clinical brain magnetic resonance imaging","abstract":null,"journal":"Journal of Neuroscience Methods","year":2021,"id":611044,"datarank":0.8069846030310691,"base_score":5.37989735354046,"endowment":5.37989735354046,"self_citation_contribution":0.8069846030310691,"citation_network_contribution":0.0,"self_endowment_contribution":0.8069846030310691,"citer_contribution":0.0,"corpus_percentile":null,"corpus_rank":null,"citation_count":216,"citer_count":0,"citers_with_citation_signal":0,"citers_with_endowment":0,"datacite_reuse_total":0,"is_dataset":false,"is_dataset_confidence":null,"is_data_producer":false,"deposit_databanks":null,"is_oa":false,"file_count":0,"downloads":0,"has_version_chain":false,"published_date":null,"fair_score":null,"fair_percentile":null,"algorithm_id":"datarank_citation_only_1hop_v6","ranking_scope":"data_only","authors":[{"id":1571290,"name":"Daphne Hong","orcid":null,"position":1,"is_corresponding":false},{"id":1571291,"name":"Daniel McClement","orcid":null,"position":2,"is_corresponding":false},{"id":761331,"name":"Olayinka Oladosu","orcid":null,"position":3,"is_corresponding":false},{"id":1571292,"name":"Glen Pridham","orcid":null,"position":4,"is_corresponding":false},{"id":1571293,"name":"Garth Slaney","orcid":null,"position":5,"is_corresponding":false},{"id":760650,"name":"Yunyan Zhang","orcid":"0000-0001-7440-5420","position":0,"is_corresponding":false}],"reference_count":0,"raw_metadata":{"has_enrichment":true,"resolved":true,"title":"Grad-CAM helps interpret the deep learning models trained to classify multiple sclerosis types using clinical brain magnetic resonance imaging","abstract":"<h4>Background</h4>Deep learning using convolutional neural networks (CNNs) has shown great promise in advancing neuroscience research. However, the ability to interpret the CNNs lags far behind, confounding their clinical translation.<h4>New method</h4>We interrogated 3 heatmap-generating techniques that have increasing generalizability for CNN interpretation: class activation mapping (CAM), gradient (Grad)-CAM, and Grad-CAM++. To investigate the impact of CNNs on heatmap generation, we also examined 6 different models trained to classify brain magnetic resonance imaging into 3 types: relapsing-remitting multiple sclerosis (RRMS), secondary progressive MS (SPMS), and control. Further, we designed novel methods to visualize and quantify the heatmaps to improve interpretability.<h4>Results</h4>Grad-CAM showed the best heatmap localizing ability, and CNNs with a global average pooling layer and pretrained weights had the best classification performance. Based on the best-performing CNN model, called VGG19, the 95th percentile values of Grad-CAM in SPMS were significantly higher than RRMS, indicating greater heterogeneity. Further, voxel-wise analysis of the thresholded Grad-CAM confirmed the difference identified visually between RRMS and SPMS in discriminative brain regions: occipital versus frontal and occipital, or temporal/parietal.<h4>Comparison with existing methods</h4>No study has examined the CAM methods together using clinical images. There is also lack of study on the impact of CNN architecture on heatmap outcomes, and of technologies to quantify heatmap patterns in clinical settings.<h4>Conclusions</h4>Grad-CAM outperforms CAM and Grad-CAM++. Integrating Grad-CAM, novel heatmap quantification approaches, and robust CNN models may be an effective strategy in identifying the most crucial brain areas underlying disease development in MS.","is_dataset_classified":null,"base_score":0.0,"endowment":0.0,"datacite_reuse_total":0,"file_count":0,"downloads":0,"views":0,"has_version_chain":false,"is_dataset":false,"is_oa":false,"pmid":"33582174","pmcid":null,"openalex_id":null,"authors":[],"funders":[{"funder_name":"Natural Sciences and Engineering Research Council of Canada","grant_id":"unidentified","title":"unidentified"},{"funder_name":"Multiple Sclerosis Society of Canada","grant_id":"","title":null},{"funder_name":"CIHR","grant_id":"","title":null},{"funder_name":"Natural Sciences and Engineering Research Council of Canada","grant_id":"","title":null},{"funder_name":"Canadian Institutes of Health Research","grant_id":"","title":null},{"funder_name":"CIHR","grant_id":"","title":null}],"total_grants":6,"fwci":null,"citation_percentile":null,"influential_citations":0,"citation_trend":[],"oa_status":"closed","license":"Elsevier TDM","oa_locations":[{"url":"https://api.elsevier.com/content/article/PII:S0165027021000339?httpAccept=text/xml","host_type":"publisher"},{"url":"https://api.elsevier.com/content/article/PII:S0165027021000339?httpAccept=text/plain","host_type":"publisher"},{"url":"https://doi.org/10.1016/j.jneumeth.2021.109098","host_type":""},{"url":"https://pubmed.ncbi.nlm.nih.gov/33582174","host_type":""},{"url":"https://dx.doi.org/10.1016/j.jneumeth.2021.109098","host_type":""}],"fields_of_study":["0301 basic medicine","03 medical and health sciences","0302 clinical medicine","Brain","Deep Learning","Humans","Magnetic Resonance Imaging","Multiple Sclerosis","Neural Networks, Computer"],"mesh_terms":["Brain","Humans","Multiple Sclerosis","Magnetic Resonance Imaging","Deep Learning","Neural Networks, Computer"],"keywords":["Magnetic Resonance Imaging","Multiple Sclerosis.","Convolutional Neural Network","Deep Learning","Heatmap","Model Interpretation","Disease Type","Class Activation Mapping/cam","Grad-cam++","Gradient-gam","Multiple Sclerosis","Brain","Humans","Neural Networks, Computer"],"sdg_mappings":[],"linked_datasets":[],"clinical_trials":[],"software_tools":[],"database_accessions":[],"source":"live","citation_network_status":"fetched"},"created_at":"2026-08-01T14:48:36.928226Z","pmid":null,"pmcid":null,"fwci":null,"citation_percentile":null,"influential_citations":0,"oa_status":null,"license":null,"views":0,"total_file_size_bytes":0,"version_count":0,"fair_f":null,"fair_a":null,"fair_i":null,"fair_r":null,"fair_zscore":null,"fair_rationale":null,"fair_model":null,"fair_agent_version":null,"fair_fulltext_source":null,"fair_has_llm":null,"fair_computed_at":null,"clinical_trials":[],"software_tools":[],"db_accessions":[],"linked_datasets":[],"topics":[]}