https://www.jmir.org/issue/feed Journal of Medical Internet Research 2023-01-03T13:00:05-05:00 JMIR Publications editor@jmir.org Open Journal Systems The leading peer-reviewed journal for digital medicine and health and health care in the internet age.&nbsp; https://www.jmir.org/2024/1/e59142/ Effectiveness of King’s Theory of Goal Attainment in Blood Glucose Management for Newly Diagnosed Patients With Type 2 Diabetes: Randomized Controlled Trial 2024-10-31T16:31:00-04:00 Man Yan Yingchun Yu Shuping Li Peiling Zhang Jiaxiang Yu <strong>Background:</strong> Diabetes poses a significant public health challenge in China and globally, with the number of patients expected to reach 592 million by 2035, notably in Asia. In China alone, an estimated 140 million individuals are living with diabetes, and a significant portion is nonadherent to medications, underscoring the urgency of effective management strategies. Recognizing the necessity of early and comprehensive management for newly diagnosed patients with type 2 diabetes, this study leverages an online teach-back method and “Internet + Nursing” platform based on King’s Theory of Goal Attainment. The approach aims to enhance glycemic control and reduce fear and misconceptions about the disease, addressing both the educational and emotional needs of the patients. <strong>Objective:</strong> The primary aim of this study was to assess the effectiveness of King’s Goal Attainment Theory in the management of newly diagnosed patients with type 2 diabetes. This research sought to develop a collaborative model for blood glucose management, integrating the expertise and roles of physicians, nurses, and patients. The model is designed to enhance the synergy in health care provision, ensuring a comprehensive approach to diabetes management. <strong>Methods:</strong> In this study conducted at Changzhou Traditional Chinese Medicine Hospital between January 2022 and February 2023, eligible patients were randomized into a control group or an online feedback group. The control group received standard care, while the online feedback group participated in a King’s Theory of Goal Attainment–based online teach-back program, enhanced by “Internet + Nursing” strategies. This included an interactive platform for goal planning, video content sharing, comprehension assessment, misconception correction, and patient-driven recaps of disease information. Health monitoring was facilitated through the “Internet + Nursing” platform. The study focused on comparing changes in glucose metabolism and emotional disorder symptoms between the groups to evaluate the intervention’s effectiveness. <strong>Results:</strong> Following a 24-week intervention, we observed significant differences in key metrics between the online feedback group and the control group, each comprising 60 participants. The online feedback group demonstrated significant reductions in fasting plasma glucose, 2-hour postprandial glucose, and hemoglobin A<sub>1c</sub> (<i>P</i>&lt;.05). Additionally, there was a notable decrease in hypoglycemia-related anxiety and alexithymia within this group. Conversely, the control group maintained relatively higher values for these metrics at the same time point (<i>P</i>&lt;.05). These findings underscore the efficacy of online feedback in managing glycemic control and reducing psychological distress associated with hypoglycemia. <strong>Conclusions:</strong> The online teaching-back method, guided by King’s Theory of Goal Attainment, effectively enhances glycemic control, reducing fasting plasma glucose, 2-hour postprandial glucose, and hemoglobin A<sub>1c</sub> levels in newly diagnosed patients with type 2 diabetes. Simultaneously, it alleviates hypoglycemia-related anxiety and mitigates alexithymia. This approach merits widespread promotion and implementation in clinical settings. <strong>Trial Registration:</strong> Chinese Clinical Trial Registry ChiCTR2400079547; https://www.chictr.org.cn/showproj.html?proj=208223 2024-10-31T16:31:00-04:00 https://www.jmir.org/2024/1/e58572/ Automated Speech Analysis for Risk Detection of Depression, Anxiety, Insomnia, and Fatigue: Algorithm Development and Validation Study 2024-10-31T16:30:40-04:00 Rachid Riad Martin Denais Marc de Gennes Adrien Lesage Vincent Oustric Xuan Nga Cao Stéphane Mouchabac Alexis Bourla Background: While speech analysis holds promise for mental health assessment, research often focuses on single symptoms, despite symptom co-occurrences and interactions. In addition, predictive models in mental health do not properly assess the limitations of speech-based systems, such as uncertainty, or fairness for a safe clinical deployment. Objective: We investigated the predictive potential of mobile-collected speech data for detecting and estimating depression, anxiety, fatigue, and insomnia, focusing on other factors than mere accuracy, in the general population. Methods: We included 865 healthy adults and recorded their answers regarding their perceived mental and sleep states. We asked how they felt and if they had slept well lately. Clinically validated questionnaires measuring depression, anxiety, insomnia, and fatigue severity were also used. We developed a novel speech and machine learning pipeline involving voice activity detection, feature extraction, and model training. We automatically modeled speech with pretrained deep learning models that were pretrained on a large, open, and free database, and we selected the best one on the validation set. Based on the best speech modeling approach, clinical threshold detection, individual score prediction, model uncertainty estimation, and performance fairness across demographics (age, sex, and education) were evaluated. We used a train-validation-test split for all evaluations: to develop our models, select the best ones, and assess the generalizability of held-out data. Results: The best model was Whisper M with a max pooling and oversampling method. Our methods achieved good detection performance for all symptoms, depression (Patient Health Questionnaire-9: area under the curve [AUC]=0.76; <i>F</i><sub>1</sub>-score=0.49 and Beck Depression Inventory: AUC=0.78; <i>F</i><sub>1</sub>-score=0.65), anxiety (Generalized Anxiety Disorder 7-item scale: AUC=0.77; <i>F</i><sub>1</sub>-score=0.50), insomnia (Athens Insomnia Scale: AUC=0.73; <i>F</i><sub>1</sub>-score=0.62), and fatigue (Multidimensional Fatigue Inventory total score: AUC=0.68; <i>F</i><sub>1</sub>-score=0.88). The system performed well when it needed to abstain from making predictions, as demonstrated by low abstention rates in depression detection with the Beck Depression Inventory and fatigue, with risk-coverage AUCs below 0.4. Individual symptom scores were accurately predicted (correlations were all significant with Pearson strengths between 0.31 and 0.49). Fairness analysis revealed that models were consistent for sex (average disparity ratio [DR] 0.86, SD 0.13), to a lesser extent for education level (average DR 0.47, SD 0.30), and worse for age groups (average DR 0.33, SD 0.30). Conclusions: This study demonstrates the potential of speech-based systems for multifaceted mental health assessment in the general population, not only for detecting clinical thresholds but also for estimating their severity. Addressing fairness and incorporating uncertainty estimation with selective classification are key contributions that can enhance the clinical utility and responsible implementation of such systems. 2024-10-31T16:30:40-04:00 https://www.jmir.org/2024/1/e57115/ Experiences With mHealth Use Among Patient-Caregiver Dyads With Chronic Heart Failure: Qualitative Study 2024-10-31T16:30:03-04:00 Xiaorong Jin Yimei Zhang Min Zhou Xiong Zhang Qian Mei Yangjuan Bai Wei Wei Fang Ma <strong>Background:</strong> Chronic heart failure has become a serious threat to the health of the global population, and self-management is key to treating chronic heart failure. The emergence of mobile health (mHealth) provides new ideas for the self-management of chronic heart failure in which the informal caregiver plays an important role. Current research has mainly studied the experiences with using mHealth among patients with chronic heart failure from the perspective of individual patients, and there is a lack of research from the dichotomous perspective. <strong>Objective:</strong> The aim of this study was to explore the experiences with mHealth use among patients with chronic heart failure and their informal caregivers from a dichotomous perspective. <strong>Methods:</strong> This descriptive phenomenological study from a post-positivist perspective used a dyadic interview method, and face-to-face semistructured interviews were conducted with patients with chronic heart failure and their informal caregivers. Data were collected and managed using NVivo 12 software, and data analysis used thematic analysis to identify and interpret participants’ experiences and perspectives. The thematic analysis included familiarizing ourselves with the data, generating initial codes, searching for themes, reviewing themes, defining and naming themes, and producing the report. <strong>Results:</strong> A total of 14 dyads of patients with chronic heart failure and their informal caregivers (13 men and 15 women) participated in this study, including 3 couples and 11 parent-child pairs. We constructed 4 key themes and their subthemes related to the experiences with mHealth use: (1) opposing experiences with mHealth as human interaction or trauma (great experience with mHealth use; trauma), (2) supplement instead of replacement (it is useful but better as a reference; offline is unavoidable sometimes), (3) both agreement and disagreement over who should be the adopter of mHealth (achieving consensus regarding who should adopt mHealth; conflict occurs when considering patients as the adopter of mHealth), (4) for better mHealth (applying mHealth with caution; suggestions for improved mHealth). <strong>Conclusions:</strong> This study reported that the experiences with mHealth use among patients with chronic heart failure and their informal caregivers were mixed, and it highlighted the human touch of mHealth and the importance of network security. These results featured mHealth as a complement to offline hospitals rather than a replacement. In the context of modern or changing Chinese culture, we encourage patients to use mHealth by themselves and their informal caregivers to provide help when necessary. In addition, we need to use mHealth carefully, and future mHealth designs should focus more on ease of use and be oriented more toward older adults. 2024-10-31T16:30:03-04:00 https://www.jmir.org/2024/1/e57040/ How Do Scholars Conceptualize and Conduct Health and Digital Health Literacy Research? Survey of Federally Funded Scholars 2024-10-31T14:00:04-04:00 Mayank Sakhuja Brooks Yelton Simone Kavarana Lauren Schaurer Jancham Rachel Rumthao Samuel Noblet Michelle A Arent Mark M Macauda Lorie Donelle Daniela B Friedman Background: The concept of health literacy (HL) is constantly evolving, and social determinants of health (SDoH) have been receiving considerable attention in public health scholarship. Since a 1-size-fits-all approach for HL fails to account for multiple contextual factors and as a result poses challenges in improving literacy levels, there is a need to develop a deeper understanding of the current state of HL and digital health literacy (DHL) research. Objective: This study examined scholars’ conceptualization and scope of work focused on HL and DHL. Methods: Using a search string, investigators (N=2042) focusing on HL, DHL, or both were identified from the grantee websites of the National Institutes of Health RePORTER (RePORT Expenditures and Results) and the Canadian Institutes of Health Research. The investigators were emailed a survey via Qualtrics. Survey questions examined the focus of work; whether the investigators studied HL/DHL in combination with other SDoH; the frameworks, definitions, and approaches used; and research settings. We analyzed survey data using SPSS Statistics version 28 and descriptive analysis, including frequencies and percentages, was conducted. Chi-square tests were performed to explore the association between the focus of work, settings, and age groups included in the investigators’ research. Results: A total of 193 (9.5%) of 2042 investigators responded to the online survey. Most investigators (76/153, 49.7%) were from public health, 83/193 (43%) reported their research focused on HL alone, 46/193 (23.8%) mentioned DHL, and 64/193 (33.2%) mentioned both. The majority (133/153, 86.9%) studied HL/DHL in combination with other SDoH, 106/135 (78.5%) conducted HL/DHL work in a community setting, and 100/156 (64.1%) reported not using any specific definition to guide their work. Digital tools (89/135, 65.9%), plain-language materials (82/135, 60.7%), and visual guides (56/135, 41.5%) were the top 3 approaches used. Most worked with adults (131/139, 94.2%) and all races and ethnicities (47/121, 38.8%). Conclusions: HL and DHL research largely considered SDoH. Multiple HL tools and approaches were used that support the examination and improvement of literacy and communication surrounding health care issues. 2024-10-31T14:00:04-04:00 https://www.jmir.org/2024/1/e50461/ Lessons From 3 Longitudinal Sensor-Based Human Behavior Assessment Field Studies and an Approach to Support Stakeholder Management: Content Analysis 2024-10-31T12:30:04-04:00 Johanna Kallio Atte Kinnula Satu-Marja Mäkelä Sari Järvinen Pauli Räsänen Simo Hosio Miguel Bordallo López Background: Pervasive technologies are used to investigate various phenomena outside the laboratory setting, providing valuable insights into real-world human behavior and interaction with the environment. However, conducting longitudinal field trials in natural settings remains challenging due to factors such as low recruitment success and high dropout rates due to participation burden or data quality issues with wireless sensing in changing environments. Objective: This study gathers insights and lessons from 3 real-world longitudinal field studies assessing human behavior and derives factors that impacted their research success. We aim to categorize challenges, observe how they were managed, and offer recommendations for designing and conducting studies involving human participants and pervasive technology in natural settings. Methods: We developed a qualitative coding framework to categorize and address the unique challenges encountered in real-life studies related to influential factor identification, stakeholder management, data harvesting and management, and analysis and interpretation. We applied inductive reasoning to identify issues and related mitigation actions in 3 separate field studies carried out between 2018 and 2022. These 3 field studies relied on gathering annotated sensor data. The topics involved stress and environmental assessment in an office and a school, collecting self-reports and wrist device and environmental sensor data from 27 participants for 3.5 to 7 months; work activity recognition at a construction site, collecting observations and wearable sensor data from 15 participants for 3 months; and stress recognition in location-independent knowledge work, collecting self-reports and computer use data from 57 participants for 2 to 5 months. Our key extension for the coding framework used a stakeholder identification method to identify the type and role of the involved stakeholder groups, evaluating the nature and degree of their involvement and influence on the field trial success. Results: Our analysis identifies 17 key lessons related to planning, implementing, and managing a longitudinal, sensor-based field study on human behavior. The findings highlight the importance of recognizing different stakeholder groups, including those not directly involved but whose areas of responsibility are impacted by the study and therefore have the power to influence it. In general, customizing communication strategies to engage stakeholders on their terms and addressing their concerns and expectations is essential, while planning for dropouts, offering incentives for participants, conducting field tests to identify problems, and using tools for quality assurance are relevant for successful outcomes. Conclusions: Our findings suggest that field trial implementation should include additional effort to clarify the expectations of stakeholders and to communicate with them throughout the process. Our framework provides a structured approach that can be adopted by other researchers in the field, facilitating robust and comparable studies across different contexts. Constantly managing the possible challenges will lead to better success in longitudinal field trials and developing future technology-based solutions. 2024-10-31T12:30:04-04:00 https://www.jmir.org/2024/1/e58066/ Electronic Health Interventions and Cervical Cancer Screening: Systematic Review and Meta-Analysis 2024-10-31T12:00:41-04:00 Xiaoxia Liu Lianzhen Ning Wenqi Fan Chanyi Jia Lina Ge Background: Cervical cancer is a significant cause of mortality in women. Although screening has reduced cervical cancer mortality, screening rates remain suboptimal. Electronic health interventions emerge as promising strategies to effectively tackle this issue. Objective: This systematic review and meta-analysis aimed to determine the effectiveness of electronic health interventions in cervical cancer screening. Methods: On December 29, 2023, we performed an extensive search for randomized controlled trials evaluating electronic health interventions to promote cervical cancer screening in adults. The search covered multiple databases, including MEDLINE, the Cochrane Central Registry of Controlled Trials, Embase, PsycINFO, PubMed, Scopus, Web of Science, and the Cumulative Index to Nursing and Allied Health Literature. These studies examined the effectiveness of electronic health interventions on cervical cancer screening. Studies published between 2013 and 2022 were included. Two independent reviewers evaluated the titles, abstracts, and full-text publications, also assessing the risk of bias using the Cochrane Risk of Bias 2 tool. Subgroup analysis was conducted based on subjects, intervention type, and economic level. The Mantel-Haenszel method was used within a random-effects model to pool the relative risk of participation in cervical cancer screening. Results: A screening of 713 records identified 14 articles (15 studies) with 23,102 participants, which were included in the final analysis. The intervention strategies used in these studies included short messaging services (4/14), multimode interventions (4/14), phone calls (2/14), web videos (3/14), and internet-based booking (1/14). The results indicated that electronic health interventions were more effective than control interventions for improving cervical cancer screening rates (relative risk [RR] 1.464, 95% CI 1.285-1.667; <i>P</i><.001; <i>I</i> <sup>2</sup>=84%), cervical cancer screening (intention-to-treat) (RR 1.382, 95% CI 1.214-1.574; <i>P</i><.001; <i>I</i> <sup>2</sup>=82%), and cervical cancer screening (per-protocol; RR 1.565, 95% CI 1.381-1.772; <i>P</i><.001; <i>I</i> <sup>2</sup>=74%). Subgroup analysis revealed that phone calls (RR 1.82, 95% CI 1.40-2.38), multimode (RR 1.62, 95% CI 1.26-2.08), SMS (RR 1.41, 95% CI 1.14-1.73), and video- and internet-based booking (RR 1.25, 95% CI 1.03-1.51) interventions were superior to usual care. In addition, electronic health interventions did not show a statistically significant improvement in cervical cancer screening rates among women with HPV (RR 1.17, 95% CI 0.95-1.45). Electronic health interventions had a greater impact on improving cervical cancer screening rates among women in low- and middle-income areas (RR 1.51, 95% CI 1.27-1.79). There were no indications of small study effects or publication bias. Conclusions: Electronic health interventions are recommended in cervical cancer screening programs due to their potential to increase participation rates. However, significant heterogeneity remained in this meta-analysis. Researchers should conduct large-scale studies focusing on the cost-effectiveness of these interventions. Clinical Trial: CRD42024502884; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=502884 2024-10-31T12:00:41-04:00 https://www.jmir.org/2024/1/e55148/ Establishing Medical Intelligence—Leveraging Fast Healthcare Interoperability Resources to Improve Clinical Management: Retrospective Cohort and Clinical Implementation Study 2024-10-31T12:00:22-04:00 Alexander Brehmer Christopher Martin Sauer Jayson Salazar Rodríguez Kelsey Herrmann Moon Kim Julius Keyl Fin Hendrik Bahnsen Benedikt Frank Martin Köhrmann Tienush Rassaf Amir-Abbas Mahabadi Boris Hadaschik Christopher Darr Ken Herrmann Susanne Tan Jan Buer Thorsten Brenner Hans Christian Reinhardt Felix Nensa Michael Gertz Jan Egger Jens Kleesiek Background: FHIR (Fast Healthcare Interoperability Resources) has been proposed to enable health data interoperability. So far, its applicability has been demonstrated for selected research projects with limited data. Objective: This study aimed to design and implement a conceptual medical intelligence framework to leverage real-world care data for clinical decision-making. Methods: A Python package for the use of multimodal FHIR data (FHIRPACK [FHIR Python Analysis Conversion Kit]) was developed and pioneered in 5 real-world clinical use cases, that is, myocardial infarction, stroke, diabetes, sepsis, and prostate cancer. Patients were identified based on the <i>ICD-10</i> (<i>International Classification of Diseases, Tenth Revision</i>) codes, and outcomes were derived from laboratory tests, prescriptions, procedures, and diagnostic reports. Results were provided as browser-based dashboards. Results: For 2022, a total of 1,302,988 patient encounters were analyzed. (1) Myocardial infarction: in 72.7% (261/359) of cases, medication regimens fulfilled guideline recommendations. (2) Stroke: out of 1277 patients, 165 received thrombolysis and 108 thrombectomy. (3) Diabetes: in 443,866 serum glucose and 16,180 glycated hemoglobin A<sub>1c</sub> measurements from 35,494 unique patients, the prevalence of dysglycemic findings was 39% (13,887/35,494). Among those with dysglycemia, diagnosis was coded in 44.2% (6138/13,887) of the patients. (4) Sepsis: In 1803 patients, <i>Staphylococcus epidermidis</i> was the primarily isolated pathogen (773/2672, 28.9%) and piperacillin and tazobactam was the primarily prescribed antibiotic (593/1593, 37.2%). (5) PC: out of 54, three patients who received radical prostatectomy were identified as cases with prostate-specific antigen persistence or biochemical recurrence. Conclusions: Leveraging FHIR data through large-scale analytics can enhance health care quality and improve patient outcomes across 5 clinical specialties. We identified (1) patients with sepsis requiring less broad antibiotic therapy, (2) patients with myocardial infarction who could benefit from statin and antiplatelet therapy, (3) patients who had a stroke with longer than recommended times to intervention, (4) patients with hyperglycemia who could benefit from specialist referral, and (5) patients with PC with early increases in cancer markers. 2024-10-31T12:00:22-04:00 https://www.jmir.org/2024/1/e51095/ Assessing the Role of the Generative Pretrained Transformer (GPT) in Alzheimer’s Disease Management: Comparative Study of Neurologist- and Artificial Intelligence–Generated Responses 2024-10-31T12:00:04-04:00 Jiaqi Zeng Xiaoyi Zou Shirong Li Yao Tang Sisi Teng Huanhuan Li Changyu Wang Yuxuan Wu Luyao Zhang Yunheng Zhong Jialin Liu Siru Liu <strong>Background:</strong> Alzheimer’s disease (AD) is a progressive neurodegenerative disorder posing challenges to patients, caregivers, and society. Accessible and accurate information is crucial for effective AD management. <strong>Objective:</strong> This study aimed to evaluate the accuracy, comprehensibility, clarity, and usefulness of the Generative Pretrained Transformer’s (GPT) answers concerning the management and caregiving of patients with AD. <strong>Methods:</strong> In total, 14 questions related to the prevention, treatment, and care of AD were identified and posed to GPT-3.5 and GPT-4 in Chinese and English, respectively, and 4 respondent neurologists were asked to answer them. We generated 8 sets of responses (total 112) and randomly coded them in answer sheets. Next, 5 evaluator neurologists and 5 family members of patients were asked to rate the 112 responses using separate 5-point Likert scales. We evaluated the quality of the responses using a set of 8 questions rated on a 5-point Likert scale. To gauge comprehensibility and participant satisfaction, we included 3 questions dedicated to each aspect within the same set of 8 questions. <strong>Results:</strong> As of April 10, 2023, the 5 evaluator neurologists and 5 family members of patients with AD rated the 112 responses: GPT-3.5: n=28, 25%, responses; GPT-4: n=28, 25%, responses; respondent neurologists: 56 (50%) responses. The top 5 (4.5%) responses rated by evaluator neurologists had 4 (80%) GPT (GPT-3.5+GPT-4) responses and 1 (20%) respondent neurologist’s response. For the top 5 (4.5%) responses rated by patients’ family members, all but the third response were GPT responses. Based on the evaluation by neurologists, the neurologist-generated responses achieved a mean score of 3.9 (SD 0.7), while the GPT-generated responses scored significantly higher (mean 4.4, SD 0.6; <i>P</i>&lt;.001). Language and model analyses revealed no significant differences in response quality between the GPT-3.5 and GPT-4 models (GPT-3.5: mean 4.3, SD 0.7; GPT-4: mean 4.4, SD 0.5; <i>P</i>=.51). However, English responses outperformed Chinese responses in terms of comprehensibility (Chinese responses: mean 4.1, SD 0.7; English responses: mean 4.6, SD 0.5; <i>P</i>=.005) and participant satisfaction (Chinese responses: mean 4.2, SD 0.8; English responses: mean 4.5, SD 0.5; <i>P</i>=.04). According to the evaluator neurologists’ review, Chinese responses had a mean score of 4.4 (SD 0.6), whereas English responses had a mean score of 4.5 (SD 0.5; <i>P</i>=.002). As for the family members of patients with AD, no significant differences were observed between GPT and neurologists, GPT-3.5 and GPT-4, or Chinese and English responses. <strong>Conclusions:</strong> GPT can provide patient education materials on AD for patients, their families and caregivers, nurses, and neurologists. This capability can contribute to the effective health care management of patients with AD, leading to enhanced patient outcomes. 2024-10-31T12:00:04-04:00 https://www.jmir.org/2024/1/e55766/ Health Care Professionals’ Experience of Using AI: Systematic Review With Narrative Synthesis 2024-10-30T16:30:49-04:00 Abimbola Ayorinde Daniel Opoku Mensah Julia Walsh Iman Ghosh Siti Aishah Ibrahim Jeffry Hogg Niels Peek Frances Griffiths Background: There has been a substantial increase in the development of artificial intelligence (AI) tools for clinical decision support. Historically, these were mostly knowledge-based systems, but recent advances include non–knowledge-based systems using some form of machine learning. The ability of health care professionals to trust technology and understand how it benefits patients or improves care delivery is known to be important for their adoption of that technology. For non–knowledge-based AI tools for clinical decision support, these issues are poorly understood. Objective: The aim of this study is to qualitatively synthesize evidence on the experiences of health care professionals in routinely using non–knowledge-based AI tools to support their clinical decision-making. Methods: In June 2023, we searched 4 electronic databases, MEDLINE, Embase, CINAHL, and Web of Science, with no language or date limit. We also contacted relevant experts and searched reference lists of the included studies. We included studies of any design that reported the experiences of health care professionals using non–knowledge-based systems for clinical decision support in their work settings. We completed double independent quality assessment for all included studies using the Mixed Methods Appraisal Tool. We used a theoretically informed thematic approach to synthesize the findings. Results: After screening 7552 titles and 182 full-text articles, we included 25 studies conducted in 9 different countries. Most of the included studies were qualitative (n=13), and the remaining were quantitative (n=9) and mixed methods (n=3). Overall, we identified 7 themes: health care professionals’ understanding of AI applications, level of trust and confidence in AI tools, judging the value added by AI, data availability and limitations of AI, time and competing priorities, concern about governance, and collaboration to facilitate the implementation and use of AI. The most frequently occurring are the first 3 themes. For example, many studies reported that health care professionals were concerned about not understanding the AI outputs or the rationale behind them. There were issues with confidence in the accuracy of the AI applications and their recommendations. Some health care professionals believed that AI provided added value and improved decision-making, and some reported that it only served as a confirmation of their clinical judgment, while others did not find it useful at all. Conclusions: Our review identified several important issues documented in various studies on health care professionals’ use of AI tools in real-world health care settings. Opinions of health care professionals regarding the added value of AI tools for supporting clinical decision-making varied widely, and many professionals had concerns about their understanding of and trust in this technology. The findings of this review emphasize the need for concerted efforts to optimize the integration of AI tools in real-world health care settings. Clinical Trial: PROSPERO CRD42022336359; https://tinyurl.com/2yunvkmb 2024-10-30T16:30:49-04:00 https://www.jmir.org/2024/1/e54528/ Evaluating the Implementation and Clinical Effectiveness of an Innovative Digital First Care Model for Behavioral Health Using the RE-AIM Framework: Quantitative Evaluation 2024-10-30T16:30:26-04:00 Samuel S Nordberg Brittany A Jaso-Yim Pratha Sah Keke Schuler Mara Eyllon Mariesa Pennine Georgia H Hoyler J Ben Barnes Lily Hong Murillo Heather O'Dea Laura Orth Elizabeth Rogers George Welch Gabrielle Peloquin Soo Jeong Youn <strong>Background:</strong> In the United States, innovation is needed to address the increasing need for mental health care services and widen the patient-to-provider ratio. Despite the benefits of digital mental health interventions (DMHIs), they have not been effective in addressing patients’ behavioral health challenges as stand-alone treatments. <strong>Objective:</strong> This study evaluates the implementation and effectiveness of precision behavioral health (PBH), a digital-first behavioral health care model embedded within routine primary care that refers patients to an ecosystem of evidence-based DMHIs with strategically placed human support. <strong>Methods:</strong> Patient demographic information, triage visit outcomes, multidimensional patient-reported outcome measure, enrollment, and engagement with the DMHIs were analyzed using data from the electronic health record and vendor-reported data files. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used to evaluate the implementation and clinical effectiveness outcomes of PBH. <strong>Results:</strong> PBH had a 47.58% reach rate, defined as patients accepting the PBH referral from their behavioral health integrated clinician. PBH patients had high DMHI registration rates (79.62%), high activation rates (76.54%), and high retention rates at 15 days (57.69%) and 30 days (44.58%) compared to literature benchmarks. In total, 74.01% (n=168) of patients showed clinical improvement, 22.47% (n=51) showed no clinical change, and 3.52% (n=8) showed clinical deterioration in symptoms. PBH had high adoption rates, with behavioral health integrated clinicians referring on average 4.35 (SD 0.46) patients to PBH per month and 90%-100% of clinicians (n=12) consistently referring at least 1 patient to PBH each month. A third (32%, n=1114) of patients were offered PBH as a treatment option during their triage visit. <strong>Conclusions:</strong> PBH as a care model with evidence-based DMHIs, human support for patients, and integration within routine settings offers a credible service to support patients with mild to moderate mental health challenges. This type of model has the potential to address real-life access to care problems faced by health care settings. <strong>Trial Registration:</strong> 2024-10-30T16:30:26-04:00