Korean J Women Health Nurs.  2023 Sep;29(3):190-199. 10.4069/kjwhn.2023.06.20.

Quality evaluation of pregnancy-related mobile applications in South Korea: a descriptive study

• Cho H
• Yi F
• Ahn S

• KMID: 2547154
• DOI: http://doi.org/10.4069/kjwhn.2023.06.20

Abstract

Purpose
This study aimed to describe the characteristics of mobile applications (apps) related to pregnancy in South Korea and evaluate their quality. Methods: We conducted a systematic search for pregnancy-related apps available in Korea in two app stores as of April 29, 2022. The quality of apps was assessed using the Korean translation of the Mobile Application Rating Scale for objective quality with four subdomains (engagement, function, aesthetics, and information) and four items for subjective quality. Results: In total, 163 apps were selected and reviewed. Both the objective and subjective quality of the apps were found to be desirable, with scores exceeding 3 out of 5 (range, 34–82). All subdomain scores in the objective quality assessment were also desirable. Among the four objective quality subdomains, aesthetics received the highest scores, followed by information, function, and engagement. In terms of subjective quality, the scores for a comprehensive overall evaluation, continuous use, and recommendation exceeded 3 out of 5, with the exception of payment. Only a small number of apps (n=4, 2.9%) were backed by a reliable authority, such as an expert review. Significant differences were observed in the objective quality of apps across different content categories (F=3.86, p=.003). Conclusion: Most pregnancy-related apps had desirable levels of objective and subjective quality. However, app content experts seldom provide reviews. It is crucial for nurses to recommend apps to expectant mothers that offer dependable content, regularly updated with the latest information.

Keyword

Mobile applications; Program evaluation; Pregnancy; Quality improvement

Figure

• 

  Figure 1. Flow sheet for the application (app) selection process.

Reference

References

1. Turchioe MR, Myers A, Isaac S, Baik D, Grossman LV, Ancker JS, Creber RM. A systematic review of patient-facing visualizations of personal health data. Appl Clin Inform. 2019; 10(4):751–770. https://doi.org/10.1055/s-0039-1697592.

2. Kwon JY, Choi KK, Jo IY. Analysis of ICT-based smart fitness service user experience. Korean J Sport Sci. 2021; 30(4):289–309. https://doi.org/10.35159/kjss.2021.8.30.4.289.

3. Byun H, Jeon SW, Yi ES. A study on the current situation and trend analysis of the elderly healthcare applications using big data analysis. J Korea Converg Soc. 2022; 13(5):313–325. https://doi.org/10.15207/JKCS.2022.13.05.313.

4. Kim BC, Choi MI, Jang GY. Perceptual differences of internet health information use between physicians and patients: empirical test of coorientation model. Korean J Advert. 2012; 23(5):63–84.

5. Bol N, Helberger N, Weert JC. Differences in mobile health app use: a source of new digital inequalities? Inform Soc. 2018; 34(3):183–193. https://doi.org/10.1080/01972243.2018.1438550.

6. Lee M, Lee H, Kim Y, Kim J, Cho M, Jang J, Jang H. Mobile app-based health promotion programs: a systematic review of the literature. Int J Environ Res Public Health. 2018; 15(12):2838. https://doi.org/10.3390/ijerph15122838.

7. Tripp N, Hainey K, Liu A, Poulton A, Peek M, Kim J, et al. An emerging model of maternity care: smartphone, midwife, doctor? Women Birth. 2014; 27(1):64–67. https://doi.org/10.1016/j.wombi.2013.11.001.

8. Henriksson P, Sandborg J, Blomberg M, Alexandrou C, Maddison R, Silfvernagel K, et al. A smartphone app to promote healthy weight gain, diet, and physical activity during pregnancy (HealthyMoms): protocol for a randomized controlled trial. JMIR Res Protoc. 2019; 8(3):e13011. https://doi.org/10.2196/13011.

9. Tinius RA, Blankenship MM, Colao AM, Hawk GS, Perera M, Schoenberg NE. A pilot study on the impact of the BumptUp® mobile app on physical activity during and after pregnancy. Sustainability. 2022; 14(19):12801. https://doi.org/10.3390/su141912801.

10. Guerra-Reyes L, Christie VM, Prabhakar A, Harris AL, Siek KA. Postpartum health information seeking using mobile phones: experiences of low-income mothers. Matern Child Health J. 2016; 20(Suppl 1):13–21. https://doi.org/10.1007/s10995-016-2185-8.

11. Muñoz-Mancisidor A, Martin-Payo R, Gonzalez-Mendez X, Fernández-Álvarez MD. Content, behavior change techniques, and quality of pregnancy apps in Spain: systematic search on app stores. JMIR Mhealth Uhealth. 2021; 9(11):e27995. https://doi.org/10.2196/27995.

12. Hayman MJ, Alfrey KL, Waters K, Cannon S, Mielke GI, Keating SE, et al. Evaluating evidence-based content, features of exercise instruction, and expert involvement in physical activity apps for pregnant women: systematic search and content analysis. JMIR Mhealth Uhealth. 2022; 10(1):e31607. https://doi.org/10.2196/31607.

13. Musgrave LM, Kizirian NV, Homer CSE, Gordon A. Mobile phone apps in Australia for improving pregnancy outcomes: systematic search on app stores. JMIR Mhealth Uhealth. 2020; 8(11):e22340. https://doi.org/10.2196/22340.

14. Bert F, Gualano MR, Brusaferro S, De Vito E, de Waure C, La Torre G, et al. Pregnancy e-health: a multicenter Italian cross-sectional study on internet use and decision-making among pregnant women. J Epidemiol Community Health. 2013; 67(12):1013–1018. https://doi.org/10.1136/jech-2013-202584.

15. Lagan BM, Sinclair M, Kernohan WG. Internet use in pregnancy informs women's decision making: a web-based survey. Birth. 2010; 37(2):106–115. https://doi.org/10.1111/j.1523-536X.2010.00390.x.

16. Lagan S, Aquino P, Emerson MR, Fortuna K, Walker R, Torous J. Actionable health app evaluation: translating expert frameworks into objective metrics. NPJ Digit Med. 2020; 3:100. https://doi.org/10.1038/s41746-020-00312-4.

17. Brown HM, Bucher T, Collins CE, Rollo ME. A review of pregnancy apps freely available in the Google Play Store. Health Promot J Austr. 2020; 31(3):340–342. https://doi.org/10.1002/hpja.270.

18. Lupton D, Pedersen S, Thomas GM. Parenting and digital media: from the early web to contemporary digital society. Sociol Compass. 2016; 10(8):730–743.

19. Bendal L, Timothy C. Ryan J. The peer evaluation enhancement resource (PEER): a new app for automating peer evaluation. Paper presented at: 2021 19th International Conference on Information Technology Based Higher Education and Training (ITHET). Sydney: IEEE, 2021. p. 1-3. https://doi.org/10.1109/ITHET50392.2021.9759657.

20. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015; 3(1):e27. https://doi.org/10.2196/mhealth.3422.

21. Zhang H, Gil TS, Kang E. A feasibility study of Korean Mobile Application Rating Scale (MARS) for evaluating the quality of blood pressure management apps. Korean J Health Educ Promot. 2018; 35(3):41–51. https://doi.org/10.14367/kjhep.2018.35.3.41.

22. Fijačko N, Masterson Creber R, Gosak L, Kocbek P, Cilar L, et al. A review of mortality risk prediction models in smartphone applications. J Med Syst. 2021; 45(12):107. https://doi.org/10.1007/s10916-021-01776-x.