Annals of Tropical Medicine and Public Health

ORIGINAL ARTICLE
Year
: 2017  |  Volume : 10  |  Issue : 6  |  Page : 1579--1586

Evaluation of key capabilities for hospital information system: A milestone for meaningful use of information technology


Mehrdad Farzandipour1, Zahra Meidani1, Hamidreza Gilasi2, Raziyeh Dehghan3,  
1 Associate professor of Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran
2 Assistant professor of Epidemiology, School of Health, Kashan University of Medical Sciences, Kashan, Iran
3 Department of Management of Information Technology and Statistics, Hormozgan University of Medical Sciences, Bandar Abbas, Iran

Correspondence Address:
Zahra Meidani
Associate professor of Health Information Management Research Center; Kashan University of Medical Sciences, Kashan
Iran

Abstract

Objective: In line with socio-technical approach, evaluation of successful adoption of hospital information systems (HISs) is associated with several factors including operational, organizational, technical, managerial, legal, and social factors. This study attempts to evaluate these systems in five areas of technical, functionality, usability, and vendors' capabilities, and care quality provided by HIS vendors. Materials and Methods: Through a cross-sectional study, the key HIS capabilities were evaluated in Iran. The key capabilities/requirements for HIS were specified by expert panel focus group meeting through the idea webbing and review of related literature. Modified Delphi technique was employed to collect and analyze data. The expert panels express their view on each of the HIS key capabilities on a 5-point scale from “strongly agree” to “strongly disagree.” Checklist was designed based on expert panels' viewpoints and employed for evaluating HIS capabilities. Results: Technical requirements with 68.3% and vendors' capability requirements scored the highest marks (68%) while improved quality of patient care requirements scored the lowest mark (24.8%). Functional requirement of the studied eight departments showed that financial department scored the highest (71.6%) while nutrition department scored the lowest marks (22.8%). Results on the evaluation of technical requirements showed that response time scored the highest (75%) while communication services scored the lowest marks (59.7%). Conclusion: The favorable status of Iran's HISs in technical area, their poor performance on the requirements of quality patient care place emphasis on financial and reimbursement objective, and neglect of Systemized Nomenclature of Medicine-Clinical Terms as a basis to support quality of patient care requirements endorse the fact that Iran's current HIS is still in its infancy. To narrow the variability and diversity in structure and requirements of HIS vendors, reducing the gap between required and adopted HIS functions, and moving toward “meaningful use of HIS,” well-organized actions at the level of Iran Ministry of Health appear essential.



How to cite this article:
Farzandipour M, Meidani Z, Gilasi H, Dehghan R. Evaluation of key capabilities for hospital information system: A milestone for meaningful use of information technology.Ann Trop Med Public Health 2017;10:1579-1586


How to cite this URL:
Farzandipour M, Meidani Z, Gilasi H, Dehghan R. Evaluation of key capabilities for hospital information system: A milestone for meaningful use of information technology. Ann Trop Med Public Health [serial online] 2017 [cited 2021 Jan 18 ];10:1579-1586
Available from: https://www.atmph.org/text.asp?2017/10/6/1579/222676


Full Text



 Introduction



Hospital information system (HIS) supports functional requirements of users in terms of data management, collection, storage, processing, and exchange.[1] Health-care ISs are considered a tool for improving efficiency and efficacy, and reducing the cost of care.[2],[3],[4],[5] Accordingly, adoption rate of ISs is on the rise in health-care system.[6] The growth rate is estimated at 6.6% in European countries, Africa, and Latin America, 7.6% in Asia Pacific region, and 9.7% in North America.[7] In some aspects of information and communications technology (ICT), the growth rate is anticipated to reach 85% by 2014.[6] However, the design and development of ISs is highly expensive.[8] Evidence shows that nearly 2.6%–6% of health budget is allocated to ICT.[9] The overall market for such systems is increasing from $15.5 billion in 2010 to $19.7 billion in the coming years.[7] Despite the growing use of ISs, positive results from implementation of such tools in health care are still vague.[8] Investigations suggest that ISs have been unsuccessful in meeting the demands and requirements of clinical processes for which they were designed.[10] Whereas HISs among organizations are developed by a vast and diverse range of users and beneficiaries and their success is associated with several factors including operational, organizational, technical, managerial, legal, and social factors.[11],[12],[13],[14] In this context, studies indicate doctors' concern about the technical aspects of ISs including security and confidentiality of information, which is considered one of the reasons for their failure.[15] Nonetheless, usability is one of the reasons for their success.[16],[17],[18] In terms of social aspects, successful implementation of an IS depends on users' attitude and satisfaction.[19] Thus, design and implementation of ISs is a difficult process which often fails.[11] A study in America showed that more than half of the IS design projects fail and 70% of them fail to satisfy users.[20] A study conducted in 2007 on 217 information technology projects showed that, in 35% of cases, failures were due to neglecting technical requirements.[21] In addition to imposing heavy costs on organizations, failure of these systems adversely affects patient care and staff and is considered as “social leprosy.”[22] Therefore, careful assessment of ISs forms an inseparable part of successful implementation of these tools. Whereas ISs are an integral part of organizational structure and processes, and it is necessary to address technical, human, organizational, and user interface issues of these systems.[23],[24] Thus, careful assessment of ISs requires something beyond primary and technical aspects but should be performed with an emphasis on socio-technical approach [25] and providing organizational objectives and users' expectations in terms of assessment of requirements and capabilities of HISs. Results of such assessments can ensure success of ISs and also help organizations choose the right system appropriate to their users' needs and work processes. They can also identify the strengths and weaknesses of ISs, provide the possibility of comparison and benchmarking different vendors, and provide the context for improving design and development of these systems according to standard capabilities and requirements.[9],[26] In line with socio-technical evaluation of HISs, this study attempts to evaluate these systems in five areas of technical, functionality, usability, and vendors' capabilities, and care quality provided by HIS vendors.

 Materials and Methods



Setting

This descriptive cross-sectional study was conducted in 2013. The study setting comprised public and private hospitals in Iran and the study population consisted of HIS vendors.

Determining the main capabilities/requirements of hospital information systems

Holding a specialized meeting with experts

At this stage, a panel of experts was formed consisting of 25 users and designers of HIS. This meeting was held with the aim to identify every aspect associated with HIS in the context of hospital, irrespective of the study objectives. Brainstorming was applied to identify aspects associated with HIS and to collect ideas, and idea webbing techniques were used to organize ideas [Figure 1]. At this stage, aspects and features associated with HIS were categorized into two groups of inherent features of HIS and health-care enterprise features. Inherent features of HIS address issues associated with hardware and software components and implementation and health-care enterprise features related to organization, its users, and its processes. Following identification of important aspects in view of users and designers of HIS, the second stage of the study was conducted as a review of relevant literature to factors affecting satisfaction and success of ISs.{Figure 1}

Review of literature and classification of ideas

This stage was conducted as library research, and relevant articles were collected and examined in a nonsystematic method

The DeLone and McLean (D and M) model of IS including model of IS success, Human Organization and Technology-fit (HOT-fit), Technology Acceptance Model (TAM), Expectation–Confirmation model, and Task Technology Fit (TTF)[27],[28],[29],[30],[31]Factors affecting users' satisfactionOperational aspects and functional capabilities of ISs [32],[33],[34],[35],[36],[37]Barriers to implementation of ISs.

Summarizing and categorizing information to determine functional capabilities of hospital information system

At this stage, experts' ideas were re-classified according to information found in review of literature. [Figure 1] shows classification of information and the relationship between two stages. [Table 1] presents the details of participating experts in focus group meeting.{Table 1}

In [Figure 1], cases outside the rectangle form the final areas of capabilities and requirements of HIS, which have been classified according to the summary into five main areas of technical, usability, care quality, vendor services and capabilities, and functional features. Other aspects associated with user characteristics including computer literacy, computer anxiety, and computer self-efficacy were not considered in this study because of irrelevance to inherent HIS capabilities. Focus group meeting was held to agree upon a main framework for the assessment of five areas of HIS capabilities, and a consensus of panel of experts was reached using modified Delphi method. For this, the results of the first and second phases are provided in [Figure 2] and examined through the modified Delphi technique. Focus group was conducted under the supervision of trained moderator (researcher) during 2 h meeting. The data were transcribed and entered into NUD ⋆ IST, a qualitative data software package. A preliminary questionnaire was designed based on qualitative data analysis of HIS capabilities. The expert panels express their views on each of the HIS key capabilities on a 5-point scale from “strongly agree” to “strongly disagree,” and consensus was set a level of 70% for each requirement. [Figure 2] shows all primary and secondary areas of main capabilities of HIS.{Figure 2}

Data sampling and collection

First, a list of all HIS vendors was prepared, and 19 vendors with a minimum of 5 years of experience in software implementation in hospitals were selected. Considering operational software programs in hospitals, one hospital was selected using convenient random method from among hospitals implementing each software. A total of 19 hospitals were determined throughout Iran and the final checklist was designed based on the five main HIS areas to collect the data vendors' key capabilities [Figure 2].[26,32-40] A trained person was appointed to collect data throughout the 19 hospitals.

Analysis of data

Data were analyzed using descriptive statistics, with Statistical Package for the Social Sciences (SPSS) software by IBM, USA. A yes/no scale was used for scoring software programs so that the presence of a scale scored 1 and its absence scored 0. After assessment and scoring of questions in each area, results of assessment of HIS capabilities were classified in five levels: 0–20 as very poor, 20–40 as poor, 40–60 as medium, 60–80 as good, and 80–100 as very good.

 Results



The results showed that HIS key capabilities scored 57.7 in total. Among the requirements studied, technical requirements with 68.3% and vendors' capability requirements scored the highest marks (68%), and improved quality of patient care requirements scored the lowest mark (24.8%) [Table 2].{Table 2}

The results on the study about functional requirements showed that, of the eight departments studied, functional requirements of financial department including creating standard and ad hoc reports for financial decision-making, automatic generation of administrative and financial data from clinical record, rules-driven financial and administrative coding assistance, and capturing the episode and encountering information to pass to administrative or financial processes scored the highest (71.6%), and functional requirements of nutrition department including documentation of nutritional regimens, recommendations about nutrition, entry of nutritional status based on patient's clinical and physiologic data (e.g., weight, appetite, and activity), etc., scored the lowest marks (22.8%) [Table 3].{Table 3}

Based on the results of technical requirements' evaluation, “response time” including processing time and response time to users request scored the highest (75%), and “communication services” including using content and data exchange standards, e.g., HL7،Œ ISO13606،Œ DICOM and electronic communication scored the lowest marks (59.7%) [Table 4].{Table 4}

 Discussion



This study was conducted with the aim to assess HIS capabilities in five areas of technical, usability, care quality, vendor services, and functionality in Iran. Results obtained favorable performance in technical requirements. Technical aspects were one of the first causes of HIS failures in the early 1970s to mid-1980s.

[41] Accordingly, the role of technical factors has been emphasized in many studies on the success and failure of ISs.[42] In many recent studies, technical aspects were also considered as one of the important criteria in ISs. In a study by Brender (2006) aiming to determine the causes of success and failure of HIS, technical aspects were also identified as an important factor in the success of ISs. In their study, Hubner-Bloder (2009) to determine the main capabilities of HIS considered three aspects of technical quality, software quality, and architecture and interface quality.[26] Many studies attribute sluggish and delayed growth of electronic health record (EHR) systems in health care to technical barriers and inappropriate design elements. Thus, accounting for technical aspects of ISs is considered an important capability in the assessment of these systems.[43],[44],[45] this study results showed that requirements of vendor companies was another favorable aspect in HIS assessment. The growing trend of using HIS has created a competitive atmosphere among HIS vendors, and the role and services provided by vendors are considered a key factor in the success of these systems.[46] [Figure 3] Services provided by vendors, from training users to operation support and bug fixing management, emphasize vendors' role change from nonmember to stakeholders.[47],[48] Today, vendor's service support role has been proven in the successful implementation of ISs and greater satisfaction of users in health care.[49] Studies indicate that quality of services provided by IT software vendors affects users' satisfaction with ISs.[50],[51],[52] Accordingly, the role of IT support is considered in the construct of many successful IS models including D and M,[27] HOT-fit,[29] TAM,[28] and TTF.[30] According to evidence, the quality of IT services affects perceived ease of use, perceived efficiency, and users' satisfaction with these systems.[19],[28] Thus, close collaboration and interaction of users with IT team, both inside and outside organization, will ensure successful implementation of ISs in health care, and how these services are provided should be assessed as a capability of HIS.[53] This study results indicated an unfavorable status of HIS in the requirements of improved quality of patient care. Yet, improved quality of care is among the ultimate goals of health-care ISs.[2],[3],[4] Yoo (2013) revealed that enhanced ISs' capabilities in line with improved quality of care and patient safety are considered among the main priorities of all health-care professionals.[54] Previous literature indicated that 84% of EHR adopters of use of EHR can provide clinical benefits for patients and 71% believe that it can help improve patient care.[55] In Australia, more than 90% of general practitioners use computerized clinical packages which support functions associated with patient safety including medication safety and drug–drug interactions.[56] Many studies showed that use of these systems has played an effective role in reducing medication errors and improving patient care. Computerized physicians order entry (CPOE) is another system that can improve patient care.[57],[58] Doctors and nurses believe that CPOE can affect efficacy, clinical processes, and drug safety.[59] In fact, HIS can play a highly effective role in improving patient care through equipping with CPOE and clinical decision support systems (CDSSs).[60] Many physicians believed that improved quality of care in ISs can be realized through CDSSs.[61] However, the use of CDSSs is subject to use of clinical terminologies.[62] Use of data exchange standards and standard terminologies such as Systemized Nomenclature of Medicine-Clinical Terms (SNOMED-CT) and International Classification of Disease (ICD) is considered an essential infrastructure in electronic systems.[63] Results of the current study showed that all systems studied in communication areas were only equipped with administrative terminology such as ICD which rather deals with disease management, reimbursement, monitoring of incidence and prevalence of diseases, and health-care policymaking. Yet, SNOMED-CT is used in more than fifty countries as the basic standard in electronic medical record (EMR)/EHR design.[64] In addition to sharing and reuse of data such as retrieval of clinical findings, improved perceived patient care and access to information sources of patient care SNOMED-CT also play a vital role in the application of expert systems. Although studies conducted in US confirm that currently SNOMED-CT is only implemented in 33% of EMR/EHR.[65] Aspects of patient care quality should address through functional capabilities of various units of nursing, radiology, pharmacy, and laboratory. However, results of studies conducted in Iran confirm that IS capabilities less focus on the requirements that support quality of care.{Figure 3}

 Conclusion



The favorable status of Iran's Health Information Systems in technical area as an elementary factor in the success of ISs, their poor performance in requirements of quality of patient care, and application of administrative terminologies to provide financial and reimbursement goals such as ICD, alienation of these systems with SNOMED-CT as the professional system infrastructure, and improved quality of patient care are indicative of the fact that Iran's current HIS still emphasizes on the primary goals of HIS. Variability and diversity in structure and requirements of HIS vendors are among the challenges to the future development of these systems. Thus, to move toward next generation of HIS, with emphasis on quality of care, helping care organizations in selecting and evaluating quality of HIS, reducing the gap between required and adopted HIS functions, and moving toward “meaningful use of HIS,” the following actions are essential:

Deciding priorities and objectives of HIS, including improved quality of patient safety and care, increased efficacy and access to services, and countrywide patient-oriented participation by the Ministry of HealthDetermining requirements and capabilities of HIS to realize the above objectivesStaging and determining realization of requirements of HIS in every stageAssessing and accrediting the existing nationwide ISs according to predetermined requirementsProviding feedback to HIS vendors to reduce variability in performance, and issuing certificates to authorized vendors based on the Ministry of Health requirements.

Clinical relevance statement

Iranians' HIS capabilities are restricted to technical requirements and neglect requirements for quality of patient careThere is variability and diversity in structure and requirements of HIS vendorsNarrowing the gap between required and adopted HIS functions, and “meaningful use of HIS,” necessitates intervention of Iran Ministry of Health.

Protection of human and animal subjects

The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects, and was reviewed by Institutional Ethics Review Board (Ethics code 4266- 6-2-2013).

Acknowledgments

We wish to express our sincere gratitude for your generous assistance in data collection and financial support.

Financial support and sponsorship

This work was supported by the Kashan University Vice Chancellor of Research and Technology [grant number 91120].

Conflicts of interest

There are no conflicts of interest.

References

1Ratnaningtyas DD, Surendro K. Information quality improvement model on hospital information system using six sigma. Procedia Technol 2013;9:1166-72.
2Fichman RG, Kohli R, Krishnan R. The role of information systems in healthcare: Current research and future trends. Inf Syst Res 2011;22:419-28.
3Sultan F, Aziz MT, Khokhar I, Qadri H, Abbas M, Mukhtar A, et al. Development of an in-house hospital information system in a hospital in Pakistan. Int J Med Inform 2014;83:180-8.
4Ammenwerth E, Ehlers F, Hirsch B, Gratl G. HIS-monitor: An approach to assess the quality of information processing in hospitals. Int J Med Inform 2007;76:216-25.
5Borzekowski R. Measuring the cost impact of hospital information systems: 1987-1994. J Health Econ 2009;28:938-49.
6Chiang MF, Boland MV, Brewer A, Epley KD, Horton MB, Lim MC, et al. Special requirements for electronic health record systems in ophthalmology. Ophthalmology 2011;118:1681-7.
7Nguyen L, Bellucci E, Nguyen LT. Electronic health records implementation: An evaluation of information system impact and contingency factors. Int J Med Inform 2014;83:779-96.
8Lapointe L, Mignerat M, Vedel I. The IT productivity paradox in health: A stakeholder's perspective. Int J Med Inform 2011;80:102-15.
9Ammenwerth E, Gräber S, Herrmann G, Bürkle T, König J. Evaluation of health information systems-problems and challenges. Int J Med Inform 2003;71:125-35.
10Horsky J, McColgan K, Pang JE, Melnikas AJ, Linder JA, Schnipper JL, et al. Complementary methods of system usability evaluation: Surveys and observations during software design and development cycles. J Biomed Inform 2010;43:782-90.
11Brender J, Ammenwerth E, Nykänen P, Talmon J. Factors influencing success and failure of health informatics systems – A pilot Delphi study. Methods Inf Med 2006;45:125-36.
12Tung FC, Chang SC, Chou CM. An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry. Int J Med Inform 2008;77:324-35.
13Palm JM, Colombet I, Sicotte C, Degoulet P. Determinants of user satisfaction with a clinical information system. AMIA Annu Symp Proc 2006;614-8.
14Han H, Lopp L. Writing and reading in the electronic health record: An entirely new world. Med Educ Online 2013;18:1-7.
15Joos D, Chen Q, Jirjis J, Johnson KB. An electronic medical record in primary care: Impact on satisfaction, work efficiency and clinic processes. AMIA Annu Symp Proc 2006;394-8.
16Nabovati E, Vakili-Arki H, Eslami S, Khajouei R. Usability evaluation of laboratory and radiology information systems integrated into a hospital information system. J Med Syst 2014;38:35.
17Aggelidis VP, Chatzoglou PD. Hospital information systems: Measuring end user computing satisfaction (EUCS). J Biomed Inform 2012;45:566-79.
18Lin TC. Mobile nursing information system utilization: The task-technology fit perspective. Comput Inform Nurs 2014;32:129-37.
19Chow SK, Chin WY, Lee HY, Leung HC, Tang FH. Nurses' perceptions and attitudes towards computerization in a private hospital. J Clin Nurs 2012;21:1685-96.
20Heeks R. Health information systems: Failure, success and improvisation. Int J Med Inform 2006;75:125-37.
21Kaplan B, Harris-Salamone KD. Health IT success and failure: Recommendations from literature and an AMIA workshop. J Am Med Inform Assoc 2009;16:291-9.
22Beynon-Davies P, Lloyd-Williams M. When health information systems fail. Top Health Inf Manage 1999;20:66-79.
23Yusof MM, Papazafeiropoulou A, Paul RJ, Stergioulas LK. Investigating evaluation frameworks for health information systems. Int J Med Inform 2008;77:377-85.
24Ammenwerth E, Brender J, Nykänen P, Prokosch HU, Rigby M, Talmon J, et al. Visions and strategies to improve evaluation of health information systems. Reflections and lessons based on the HIS-EVAL Workshop in Innsbruck. Int J Med Inform 2004;73:479-91.
25Berg M. Patient care information systems and health care work: A sociotechnical approach. Int J Med Inform 1999;55:87-101.
26Hübner-Bloder G, Ammenwerth E. Key performance indicators to benchmark hospital information systems – A Delphi study. Methods Inf Med 2009;48:508-18.
27Petter S, DeLone W, McLean E. Measuring information systems success: Models, dimensions, measures, and interrelationships. Eur J Inf Syst 2008;17:236-63.
28Chen RF, Hsiao JL. An investigation on physicians' acceptance of hospital information systems: A case study. Int J Med Inform 2012;81:810-20.
29Yusof MM, Kuljis J, Papazafeiropoulou A, Stergioulas LK. An evaluation framework for health information systems: Human, organization and technology-fit factors (HOT-fit). Int J Med Inform 2008;77:386-98.
30Goodhue Dale L, Thompson Ronald L. Task-technology fit and individual performance. MIS Q 1995;19:213-36.
31Thonga JY, Se-Joon H, Tama KY. The effects of post-adoption beliefs on the expectation-confirmation model for information technology continuance. Int J Hum Comput Stud 2006;64:799-810.
32Health Level Seven. HL7 EHR System Functional Model: A Major Development towards Consensus on Electronic Health Record System Functionality; 2004. Available from: http://www.hl7.org. [Last accessed on 2013 Sep].
33OntarioMD Inc. 2011. Electronic Medical Records Specification. Available from: https://www.ontariomd.ca. [Last accessed on 2013 Sep].
34Mestler JD, Bishop S, Perkins R, Celingant C. Electronic Health Records/Clinical Research EHR/CR User Requirements Document; February 24, 2008. Available from: http://www.eurorec.org. [Last accessed on 2013 Sep].
35Bowes WA. Assessing readiness for meeting meaningful use: Identifying electronic health record functionality and measuring levels of adoption. AMIA Annu Symp Proc 2010;2010:66-70.
36Brender J, Ammenwerth E, Nykänen P, Talmon J. Factors influencing success and failure of health informatics systems – A pilot Delphi study. Methods Inf Med 2006;45:125-36.
37Center for Enterprise Modernization. National Institutes of Health National Center for Research Resources Electronic Health Records Overview; April, 2006. Available from: http://www.himss.org. [Last accessed on 2013 Sep].
38Ludwick DA, Doucette J. Adopting electronic medical records in primary care: Lessons learned from health information systems implementation experience in seven countries. Int J Med Inform 2009;78:22-31.
39Simpson RL. Nurses – Yes, nurses – Improve physician order entry. Nurs Manage 2000;31:20-3.
40Lee TT, Mills ME, Lu MH. The multimethod evaluation of a nursing information system in Taiwan. Comput Inform Nurs 2009;27:245-53.
41Ganni Tulusan J. Perspectives of Success and Failure in Healthcare Information Systems: An Evaluation of Existing Theories and Models; 2007. Available from: http://www.lse.ac.uk. [Last accessed on 2013 Sep].
42Goldfinch S. Pessimism, computer failure, and information systems development in the public sector. Public Adm Rev 2007;67:917-29.
43Vest JR. More than just a question of technology: Factors related to hospitals' adoption and implementation of health information exchange. Int J Med Inform 2010;79:797-806.
44DesRoches CM, Campbell EG, Rao SR, Donelan K, Ferris TG, Jha A, et al. Electronic health records in ambulatory care – A national survey of physicians. N Engl J Med 2008;359:50-60.
45O'Malley AS, Grossman JM, Cohen GR, Kemper NM, Pham HH. Are electronic medical records helpful for care coordination? Experiences of physician practices. J Gen Intern Med 2010;25:177-85.
46Anderson JG. Social, ethical and legal barriers to e-health. Int J Med Inform 2007;76:480-3.
47Al-Nashmi M. The Role of Vendors in Health Information Systems Implementation: Assessing the Perception of Healthcare Executives and Vendors. PhD Dissertation University of Pittsburgh; 2003. p. 191.
48Khalifa M. Barriers to health information systems and electronic medical records implementation. A field study of Saudi Arabian Hospitals. Proc Comput Sci 2013;21:335-42.
49Aggelidis VP, Chatzoglou PD. Hospital information systems: Measuring end user computing satisfaction (EUCS). J Biomed Inform 2012;45:566-79.
50Kekre S, Krishnan MS, Srinivasan K. Drivers of customer satisfaction for software products: Implications for design and service support. Manage Sci 1995;41:1456-70.
51Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: Toward a unified view. MIS Q 2003;27:425-78.
52Palvia PC, Palvia SC. An examination of the IT satisfaction of small-business users. Inf Manage 1999;35:127-37.
53Smith D, Morris A, Janke J. Nursing satisfaction and attitudes with computerized software implementation: A quasi-experimental study. Comput Inform Nurs 2011;29:245-50.
54Yoo S, Kim S, Lee S, Lee KH, Baek RM, Hwang H, et al. A study of user requests regarding the fully electronic health record system at Seoul National University Bundang hospital: Challenges for future electronic health record systems. Int J Med Inform 2013;82:387-97.
55Jamoom E, Patel V, Furukawa M, King J. EHR adopters vs. non-adopters: Impacts of, barriers to, and federal initiatives for EHR adoption. Healthcare 2014;2:33-9.
56Cripps H, Standing C. The implementation of electronic health records: A case study of bush computing the Ngaanyatjarra lands. Int J Med Inform 2011;80:841-8.
57Dobrev A, Stroetmann KA, Stroetmann VN, Artman J, Jones T, Hammerschmidt R. The Conceptual Framework of Interoperable Electronic Health Record and ePrescribing Systems. EHR Impact; 2008. Available from: http://www.ehr-impact.eu. [Last accessed on 2013 Sep].
58Porterfield A, Engelbert K, Coustasse A. Electronic prescribing: Improving the efficiency and accuracy of prescribing in the ambulatory care setting. Perspect Health Inf Manag 2014;11:1g.
59Khajouei R, Wierenga PC, Hasman A, Jaspers MW. Clinicians satisfaction with CPOE ease of use and effect on clinicians' workflow, efficiency and medication safety. Int J Med Inform 2011;80:297-309.
60Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of healthcare: A systematic overview. PLoS Med 2011;8:e1000387.
61Boas S, Bishop T, Ryan A, Shih S, Casalino L. Electronic health records and technical assistance to improve quality of primary care: Lessons for regional extension centers. Healthcare 2014;2:103-6.
62Shahpori R, Doig C. Systematized nomenclature of medicine-clinical terms direction and its implications on critical care. J Crit Care 2010;25:364.e1-9.
63Lee D, Cornet R, Lau F, de Keizer N. A survey of SNOMED CT implementations. J Biomed Inform 2013;46:87-96.
64Bakken S, Warren JJ, Lundberg C, Casey A, Correia C, Konicek D, et al. An evaluation of the usefulness of two terminology models for integrating nursing diagnosis concepts into SNOMED clinical terms. Int J Med Inform 2002;68:71-7.
65Giannangelo K, Fenton SH. SNOMED CT survey: An assessment of implementation in EMR/EHR applications. Perspect Health Inf Manag 2008;5:7.