Healthc Inform Res.  2017 Apr;23(2):101-108. 10.4258/hir.2017.23.2.101.

Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems

• Moghaddasi H
• Rabiei R
• Asadi F
• Ostvan N

• KMID: 2378518
• DOI: http://doi.org/10.4258/hir.2017.23.2.101

Abstract

OBJECTIVES
As the largest group providing healthcare services, nurses require well-designed information systems in their practice. This study aims to evaluate the usability of nursing information systems (NIS).
METHODS
This cross-sectional survey was conducted in 2015. The settings of the study consisted of four hospitals affiliated with three medical universities in Tehran (Iran). The subjects of the study included nurses who had access to and used a NIS developed by four major software companies. The data were collected using a modified version of a usability questionnaire known as IsoMetrics, based on the International Standard ISO 9241, Part 11. The questionnaire is composed of 35 questions divided into seven general criteria. The validity of the questionnaire was determined by experts in the field, and the reliability was checked using Cronbach's alpha (α = 0.91). The questionnaire was then distributed to 184 nurses.
RESULTS
The response rate was 64.6%. Among the seven ISO usability criteria, suitability for the task (3.10 ± 1.24) and suitability for learning (3.10 ± 1.27) had the highest mean value. The lowest mean value (2.37 ± 1.29) was related to the suitability for individualization.
CONCLUSIONS
Addressing issues related to individualization and self-descriptiveness could improve the usability of nursing systems. Considering usability requirements in the design of a NIS will lead to the efficient and effective use of these systems.

Keyword

Information Systems; Hospital Information Systems; Evaluation Studies; Nursing Informatics; Nursing

MeSH Terms

Cross-Sectional Studies
Delivery of Health Care
Hospital Information Systems
Information Systems*
Learning
Nursing Informatics
Nursing*

Figure

• 

  Figure 1 Mean scores of seven ISO 9241 criteria for the systems under study.

Reference

1. Su KW, Liu CL. A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J Med Syst. 2012; 36(3):1139–1153.

2. Kern R, Haase R, Eisele JC, Thomas K, Ziemssen T. Designing an electronic patient management system for multiple sclerosis: building a next generation multiple sclerosis documentation system. Interact J Med Res. 2016; 5(1):e2.

3. Kahouei M, Molanoroozi Z, Habibiyan M, Sedghi S. Health information technology in the knowledge management of health care organizations. Middle East J Rehabil Health. 2015; 2(3):e29229.

4. Rachmawaty R. The development of the electronic nursing record system (ENRS) in the hospital setting: an integrative literature review. Am J Health Sci. 2015; 6(1):1–6.

5. Kimiafar K, Sadoughi F, Sheikhtaheri A, Sarbaz M. Prioritizing factors influencing nurses' satisfaction with hospital information systems: a fuzzy analytic hierarchy process approach. Comput Inform Nurs. 2014; 32(4):174–181.

6. Nakate G, Dahl D, Drake KB, Petrucka P. Knowledge and attitudes of select ugandan nurses towards documentation of patient care. Afr J Nurs Midwifery. 2015; 2(1):56–65.

7. Xu WL, Yang LQ, Zhang HY. Nursing informatics in clinical practice in China. Comput Inform Nurs. 2013; 31(5):214–218.

8. Alkouri O, AlKhatib AJ, Kawafhah M. Importance and implementation of nursing documentation: review study. Eur Sci J. 2016; 12(3):101–106.

9. Schiza EC, Neokleous KC, Petkov N, Schizas CN. A patient centered electronic health: eHealth system development. Technol Health Care. 2015; 23(4):509–522.

10. Janols R, Lind T, Göransson B, Sandblad B. Evaluation of user adoption during three module deployments of region-wide electronic patient record systems. Int J Med Inform. 2014; 83(6):438–449.

11. Kushniruk AW, Borycki EM, Anderson J, Anderson M, Nicoll J, Kannry J. Using clinical and computer simulations to reason about the impact of context on system safety and technology-induced error. Stud Health Technol Inform. 2013; 194:154–159.

12. van Engen-Verheul MM, Peute LW, de Keizer NF, Peek N, Jaspers MW. Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: a mixed method usability approach. Int J Med Inform. 2016; 87:15–26.

13. Cipriano PF, Hamer S. Special report: nursing, technology and information system. Am Nurse Today. 2013; 8(11):1–19.

14. Issa T, Turk A. Applying usability and HCI principles in developing marketing websites. Int J Comput Inf Syst Ind Manag Appl. 2012; 4:76–82.

15. Freire LL, Arezes PM, Campos JC. A literature review about usability evaluation methods for e-learning platforms. Work. 2012; 41:Suppl 1. 1038–1044.

16. Viitanen J, Kuusisto A, Nykanen P. Usability of electronic nursing record systems: definition and results from an evaluation study in Finland. Stud Health Technol Inform. 2011; 164:333–338.

17. Rogers ML, Sockolow PS, Bowles KH, Hand KE, George J. Use of a human factors approach to uncover informatics needs of nurses in documentation of care. Int J Med Inform. 2013; 82(11):1068–1074.

18. Georgsson M, Staggers N. Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics. J Am Med Inform Assoc. 2016; 23(1):5–11.

19. Hamborg KC, Vehse B, Bludau HB. Questionnaire based usability evaluation of hospital information systems. Electron J Inf Syst Eval. 2004; 7(1):21–30.

20. International Organization for Standardization. Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability. Geneva, Switzerland: International Organization for Standardization;1998. (ISO 9241-11:1998).

21. Shojaei S, Farzianpour F, Arab M, Rahimi Foroushani A. An Investigation on the Status of Implementation of Communications and Information Management System (MCI) in Khorasan Razavi Hospitals. Glob J Health Sci. 2015; 8(5):110–119.

22. Kahouei M, Zadeh JM, Roghani PS. The evaluation of the compatibility of electronic patient record (EPR) system with nurses' management needs in a developing country. Int J Med Inform. 2015; 84(4):263–270.

23. Nabovati E, Vakili-Arki H, Eslami S, Khajouei R. Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system. J Med Syst. 2014; 38(4):35.

24. Jayawardena AS. The electronic hospital information system implemented at the District General Hospital Trincomalee: an experience of business process reengineering. J Community Med Health Educ. 2014; S2:001.

25. Karimi F, Poo DC, Tan YM. Clinical information systems end user satisfaction: the expectations and needs congruencies effects. J Biomed Inform. 2015; 53:342–354.

26. Farzandipour M, Sadoughi F, Meidani Z. Hospital information systems user needs analysis: a vendor survey. J Health Inform Dev Ctries. 2011; 5(1):147–154.

27. Birjandi F, Gharehbaghian A, Delavari A, Rezaie N, Maghsudlu M. Blood donor deferral pattern in Iran. Arch Iran Med. 2013; 16(11):657–660.

28. Jahanbakhsh M, Ehteshami A, Shafiei A. Assessment of the hospital information system in compliance with certification commission for healthcare information technology standard at Isfahan University of Medical Sciences' academic hospitals. Int J Educ Psychol Res. 2016; 2(2):105–110.

29. Ahmadi M, Shahmoradi L, Barabadi M, Hoseini F. A survey of usability of hospital information systems from the perspective of nurses, department secretaries, and paraclinic users in selected hospitals: 2009. J Health Adm. 2011; 14(44):11–20.

30. Rafique I, Weng J, Wang Y, Abbasi MQ, Lew P. Software learnability evaluation: an overview of definitions and evaluation methodologies for GIS applications. In : Proceedings of the 7th International Multi-Conference on Computing in the Global Information Technology (ICCGI); 2012 Jun 24-29; Venice, Italy.