Healthc Inform Res.  2019 Apr;25(2):73-81. 10.4258/hir.2019.25.2.73.

Evaluation of User Experience of New Defense Medical Information System

• Ryu H
• Kim J

• KMID: 2445003
• DOI: http://doi.org/10.4258/hir.2019.25.2.73

Abstract

OBJECTIVES
This study aimed to investigate the user experience (UX) of the New Defense Medical Information System (N-DEMIS), which was introduced in 2012 as part of an effort to improve the old system of armed forces hospitals and ultimately bring their standards up to those of civilian hospitals.
METHODS
In this study, the dependent variable was the UX of N-DEMIS and was composed of usability, affect, and user value. The questionnaire comprised 41 questions: nine on general characteristics, 20 on usability, four on affect, and eight on user value. The data collection period was from April 15 to April 30, 2018. Overall, 85 responses were received; of these, three insincere responses were excluded, and the remaining 82 responses were used in the analysis.
RESULTS
The overall value of Cronbach's alpha was 0.917, indicating an overall high-reliability. There was a significant difference between user value and usability, but there was no significant differences between the other pairs. We observed a significant effect on UX for length of time working in an armed forces hospital and employment type.
CONCLUSIONS
The results of our survey showed an even distribution of scores across the three elements of UX, showing that no particular aspect of N-DEMIS is superior to the others in terms of user satisfaction. However, the overall UX score of around 60% indicates the need for future improvements. Rather than focusing improvements on a specific area, improvements should be spread across usability, affect, and user value.

Keyword

Personal Satisfaction; User-Computer Interface; Hospital Information Systems; Electronic Health Records; Attitude

MeSH Terms

Arm
Data Collection
Electronic Health Records
Employment
Hospital Information Systems
Information Systems*
Personal Satisfaction
User-Computer Interface

Figure

• 

  Figure 1 Distribution of scores in each element of user experience.

Reference

1. Rhee C, Burkom H, Yoon CG, Stewart M, Elbert Y, Katz A, et al. Syndromic surveillance system for Korea-US joint biosurveillance portal: design and lessons learned. Health Secur. 2016; 14(3):152–160.

2. Desmet P, Hekkert P. Framework of product experience. Int J Des. 2007; 1(1):57–66.

3. Law EL, Van Schaik P. Modelling user experience: an agenda for research and practice. Interact Comput. 2010; 22(5):313–322.

4. Lee K, Lee I, Jun S, Yang S, Choi GW, Kim J, et al. How to measure the user experience? In : Proceedings of HCI Society of Korea; 2008 Feb 13–15; Pyungchang, Korea. p. 851–856.

5. Lee SM. On the UX of social commerce shopping application. Illus Forum. 2014; 39:5–14.

6. Norman D, Nielsen J. The definition of user experience (UX) [Internet]. San Diego (CA): Nielsen Norman Group;c2019. cited at 2019 Apr 19. Available from: https://www.nngroup.com/articles/definition-userexperience/.

7. Kim HK, Han SH, Park J, Park W, Park YS, Cho Y, et al. The definition of user experience through a literature survey. In : Proceedings of the 2009 Fall Conference of the Korean Institute of Industrial Engineers; 2009 Oct 9; Yongin, Korea. p. 305–309.

8. Hassenzahl M, Tractinsky N. User experience-a research agenda. Behav Inf Technol. 2006; 25(2):91–97.

9. Thuring M, Mahlke S. Usability, aesthetics and emotions in human–technology interaction. Int J Psychol. 2007; 42(4):253–264.

10. Park J, Han SH, Kim HK, Cho Y, Park W. Developing elements of user experience for mobile phones and services: survey, interview, and observation approaches. Hum Factors Ergon Manuf Serv Ind. 2013; 23(4):279–293.

11. Hong SW. A methodology for modelling and analyzing user's affective satisfaction toward consumer electronic products [dissertation]. Pohang, Korea: Pohang University of Science and Technology;2005.

12. Kim MH, Park H, Park EC, Park K. Attitude and knowledge of physicians about cancer pain management: young doctors of South Korea in their early career. Jpn J Clin Oncol. 2011; 41(6):783–791.

13. Staggers N, Jennings BM, Lasome CE. A usability assessment of AHLTA in ambulatory clinics at a military medical center. Mil Med. 2010; 175(7):518–524.

14. Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med. 2011; 8(1):e1000387.

15. Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006; 144(10):742–752.

16. Blumenthal D, Glaser JP. Information technology comes to medicine. N Engl J Med. 2007; 356(24):2527–2534.

17. Ayatollahi H, Bath PA, Goodacre S. Factors influencing the use of IT in the emergency department: a qualitative study. Health Informatics J. 2010; 16(3):189–200.

18. Stevenson JE, Nilsson GC, Petersson GI, Johansson PE. Nurses' experience of using electronic patient records in everyday practice in acute/inpatient ward settings: a literature review. Health Informatics J. 2010; 16(1):63–72.

19. Heponiemi T, Hypponen H, Vehko T, Kujala S, Aalto AM, Vanska J, et al. Finnish physicians' stress related to information systems keeps increasing: a longitudinal three-wave survey study. BMC Med Inform Decis Mak. 2017; 17(1):147.

20. Burkhard R, Fruhling A, Djamasbi S. Introduction to user experience (UX) in information systems (IS) for health and wellness minitrack. In : Proceedings of the 50th Hawaii International Conference on System Sciences; 2017 Jan 4–7; Hilton Waikoloa Village, HI.

21. Staggers N, Xiao Y, Chapman L. Debunking health IT usability myths. Appl Clin Inform. 2013; 4(2):241–250.

22. Russell JA. Core affect and the psychological construction of emotion. Psychol Rev. 2003; 110(1):145–172.

23. Hassenzahl M. The thing and I: understanding the relationship between user and product. In : Blythe MA, Overbeeke K, Monk AF, editors. Funology. Dordrecht: Springer;2003. p. 31–42.

24. Lee SK. A study on the user satisfaction of the DEMIS [dissertation]. Seoul, Korea: Yonsei University;2001.

25. Khalifa M, Alswailem O. Hospital information systems (HIS) acceptance and satisfaction: a case study of a tertiary care hospital. Procedia Comput Sci. 2015; 63:198–204.

26. Park DE. Nursing work environment, job satisfaction, and turnover intention of military nursing officer in armed forces hospital [dissertation]. Seoul, Korea: Seoul National University;2014.

27. Jung HE. The determinants of inpatients' satisfaction at military hospitals in Korea [dissertation]. Seoul, Korea: Yonsei University;2005.

28. Yoo MR, Jung YM, Kim SY, Kim MJ. Re-employment experiences of retired nurse officers. J Mil Nurs Res. 2012; 30(2):16–30.

29. Yoo MR, Choi YJ, Yoo JA. The study on competency of junior nursing officers. J Mil Nurs Res. 2010; 28(2):29–44.