---
title: "Regulation and Evaluation of Medical Apps: Alternatives Needed?"
language: "en"
type: "post"
original_url: "https://www.atlas-digitale-gesundheitswirtschaft.de/en/blog/2025/02/27/regulation-and-evaluation-of-medical-apps-alternatives-needed-2/"
human_version: "../../../../../../1/en/blog/2025/02/27/regulation-and-evaluation-of-medical-apps-alternatives-needed-2/"
date: "2025-02-27"
section: "Global Science Digest"
categories: ["AI", "Apps"]
author: "Grigori Rogge [Quality Assurance L. Fluess]"
reading_time: "6 Min."
description: "Medical apps are regulated as MDs. However, evolve quickly, raising the question for other approaches in regulation and evaluation."
publisher: "Lehrstuhl für Management und Innovation im Gesundheitswesen, Universität Witten/Herdecke"
---

# Regulation and Evaluation of Medical Apps: Alternatives Needed?

*February 27, 2025 · Global Science Digest · By Grigori Rogge [Quality Assurance L. Fluess]*

Global Science Digest

Medical apps are mainly regulated as medical devices. However, these applications evolve quickly, raising the question of whether current approaches for regulation and evaluation are sufficient or if new incentives are needed.

### What are Medical Apps?

Medical apps are a subgroup of health apps [1]. They are intended for either medical professionals or caregiving relatives and serve medical purposes, such as exchanging medical data. These apps provide improved access to medical resources and offer deeper insights into treatment [2]. However, there are discussions, about whether current methods for evaluating and regulating these apps are adequate [3, 4].

### Focus Group Discussions at the 17th World Congress on Public Health

In their study, [Maaß et al.](https://www.jmir.org/2024/1/e54814/) aimed to identify potential future methods for evaluating the medical benefits and regulating medical apps. In the context of their study, they conducted focus group discussions with 46 participants from 14 countries at the [17th World Congress on Public Health](https://www.wcph.org/wcph-congresses/) on the topic [4].

### Regulation of Medical Apps in selected Countries

Medical apps are regulated differently across regions. To illustrate differences and similarities, Maaß et al. outlined regulations for medical apps of the four countries most prominently represented in the discussions (Germany, Italy, Australia, and Canada) in their study [4].

Medical apps are legally regulated as medical devices [5]. This imposes certain requirements, such as risk management and the need for evidence regarding medical benefits. To date, across the presented regions, evidence of medical benefits is mainly provided by conducting randomized clinical trials (RCTs), even though they are not legally required. Only in Germany medical apps are reimbursed. [4].

### Challenges related to RCTs in the Evaluation of Medical Apps

RCTs are considered as the gold-standard in clinical evaluation and follow a structured approach. One key aspect is randomization, which balances patient characteristics among the study groups. The study population is determined before the study begins and depends on the aspects that are observed. Due to their nature, RCTs are expensive and time-consuming, face the risk of attrition, and sometimes their results cannot be generalized [6]. However, medical apps are frequently updated and tailored to users’ needs, resulting in a continuous need to provide evidence of their medical benefits. This contrasts with the concept of RCTs, as the speed of medical app development often does not align with the duration of the RCT [4].

### Adaptable Evaluation and Regulation are needed to promote Innovation

During the focus group discussion conducted by Maaß et al., the participants acknowledged the value of traditional RCTs in reducing bias and establishing causal relationships, but emphasized the need for more flexible evaluation approaches. They highlighted the need for data regarding user engagement and in-app evaluations [4].

Concerning regulatory requirements, they discussed the importance of adaptable standards that align with the potential risk of the apps. The standards have to address data privacy, informed consent, and bias prevention. Over-regulation, they noted, could hinder innovation and lead to fragmented, narrowly focused “siloed” apps that reduce usability [4].

### Logic Model for the Evaluation and Regulation of Medical Apps

Following the focus group discussions, Maaß et al. developed a logic model for the evaluation and regulation of medical apps during their lifecycle (Figure 2) [4].

Figure 1: Schematic representation of the developed logic model on medical app (Maaß et al. 2024)

During app development, regulation should incorporate both safety- and harm-related issues, as well as the purpose and function of the apps. For evaluation, Maaß et al. propose feasibility studies that evaluate the target and content. They also state that there has to be evidence of a positive medical impact prior to market launch. This can be achieved either through traditional RCTs or other approaches, such as preference-based controlled trials [4]. Such trials aim to reduce challenges in recruitment and attrition associated with traditional RCTs by enrolling patients in treatment groups they prefer and, therefore, optimizing their treatment acceptance [7].

After the market launch, Maaß et al. state that regulation should require both the reporting of adverse events (market surveillance) and the collection of clinical evidence. For evaluation, they suggest analyzing real-world data, such as hospital data. Another option is pragmatic randomized controlled trials (PRCTs) [4].

PRCTs are conducted in a real-world setting with a focus on effectiveness and adverse events. They feature a diverse patient group [8]. Other approaches could focus on user analytics through qualitative interviews or built-in analytics functions (e.g., Google Analytics).

Quality management, risk management, and technical documentation of the app have to be continuously updated [4].

## Future Regulations of AI-enabled Medical Apps

Maintaining medical apps will be a challenge for manufacturers in the future. Due to their high potential, there is a strong trend toward integrating AI features in medical technologies [9], which further increases the pace of change within medical apps. The FDA has taken this into account by issuing a draft guidance intended to help manufacturers maintain and advance their AI-enabled medical devices throughout the Total Product Lifecycle (TPLC) [10]. The draft guidance outlines a continuous AI lifecycle approach with recurring real-world performance assessments, as devices with AI have the potential for continuous adjustments based on live data. Similar to Maaß et al., the FDA also discusses the need for alternatives to RCTs to demonstrate the pre-market safety and effectiveness of medical devices [10].

The presented innovative approaches are a welcome step in regulating and evaluating medical apps in the future. They take into account the dynamic nature of these apps while aiming to ensure safety and efficacy.

**Also Read:** [AI-Based Symptom Checkers in Medical Self-Diagnosis](../12/ai-based-symptom-checkers-in-medical-self-diagnosis.md)

References

1. Gregor-Haack J. Erstattung von Health-Apps durch die gesetzliche Krankenversicherung. [Reimbursement of health apps by the German statutory health insurance]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2018;61:328–33. doi:10.1007/s00103-018-2689-z.

2. Timmers T, Janssen L, Pronk Y, van der Zwaard BC, Koëter S, van Oostveen D, et al. Assessing the Efficacy of an Educational Smartphone or Tablet App With Subdivided and Interactive Content to Increase Patients’ Medical Knowledge: Randomized Controlled Trial. JMIR Mhealth Uhealth. 2018;6:e10742. doi:10.2196/10742.

3. Agarwal P, Gordon D, Griffith J, Kithulegoda N, Witteman HO, Sacha Bhatia R, et al. Assessing the quality of mobile applications in chronic disease management: a scoping review. NPJ Digit Med. 2021;4:46. doi:10.1038/s41746-021-00410-x.

4. Maaß L, Hrynyschyn R, Lange M, Löwe A, Burdenski K, Butten K, et al. Challenges and Alternatives to Evaluation Methods and Regulation Approaches for Medical Apps as Mobile Medical Devices: International and Multidisciplinary Focus Group Discussion. J Med Internet Res. 2024;26:e54814. doi:10.2196/54814.

5. Maaß L, Freye M, Pan C-C, Dassow H-H, Niess J, Jahnel T. The Definitions of Health Apps and Medical Apps From the Perspective of Public Health and Law: Qualitative Analysis of an Interdisciplinary Literature Overview. JMIR Mhealth Uhealth. 2022;10:e37980. doi:10.2196/37980.

6. Hariton E, Locascio JJ. Randomised controlled trials – the gold standard for effectiveness research. BJOG. 2018;125:1716. doi:10.1111/1471-0528.15199.

7. Alibhai SMH, Papadopoulos E, Durbano S, Tomlinson G, Mina DS, Ritvo P, et al. Preference-based versus randomized controlled trial in prostate cancer survivors: Comparison of recruitment, adherence, attrition, and clinical outcomes. Front Oncol. 2022;12:1033229. doi:10.3389/fonc.2022.1033229.

8. Omerovic E, Petrie M, Redfors B, Fremes S, Murphy G, Marquis-Gravel G, et al. Pragmatic randomized controlled trials: strengthening the concept through a robust international collaborative network: PRIME-9-Pragmatic Research and Innovation through Multinational Experimentation. Trials. 2024;25:80. doi:10.1186/s13063-024-07935-y.

9. Bitkina OV, Park J, Kim HK. Application of artificial intelligence in medical technologies: A systematic review of main trends. Digit Health. 2023;9:20552076231189331. doi:10.1177/20552076231189331.

10. Food and Drug Administration (FDA). Artificial Intelligence-Enabled Device Software Functions: Lifecycle Management and Marketing Submission Recommendations: Draft Guidance for Industry and Food and Drug Administration Staff 07.01.2025.





#### Related Articles

- [AI-Based Clinical Decision Support Systems for Antimicrobial Resistance](../12/ai-based-clinical-decision-support-systems-for-antimicrobial-resistance.md)
- [AI-Based Symptom Checkers in Medical Self-Diagnosis](../12/ai-based-symptom-checkers-in-medical-self-diagnosis.md)
- [The Potential of AI-Based Mobile Tailored Interventions in Addressing Nurse Burnout: Evidence from South Korea](../../../2024/12/18/the-potential-of-ai-based-mobile-tailored-interventions-in-addressing-nurse-burnout-evidence-from-south-korea.md)


**Categories:** AI, Apps

## Images on this page

- Logikmodell.png: ../../../../../../1/assets/bilder/wp-content/uploads/2025/02/Logikmodell.png
- shutterstock_1654888882.jpg: ../../../../../../1/assets/bilder/wp-content/uploads/2024/02/shutterstock_1654888882.jpg

---
This page is optimised for AI systems. Human-readable version: [Regulation and Evaluation of Medical Apps: Alternatives Needed?](../../../../../../1/en/blog/2025/02/27/regulation-and-evaluation-of-medical-apps-alternatives-needed-2/)
