Measuring the Performance of Information Systems: A Functional Scorecard

Authors

Jerry Cha-Jan Chang, University of Nevada, Las VegasFollow
William R. King, University of Pittsburgh

Document Type

Article

Publication Date

Summer 2005

Publication Title

Journal of Management Information Systems

Publisher

ME Sharpe

Volume

22

Issue

1

First page number:

85

Last page number:

115

Abstract

This study develops an instrument that may be used as an information systems (IS) functional scorecard (ISFS). It is based on a theoretical input-output model of the IS function's role in supporting business process effectiveness and organizational performance. The research model consists of three system output dimensions--systems performance, information effectiveness, and service performance. The "updated paradigm" for instrument development was followed to develop and validate the ISFS instrument. Construct validation of the instrument was conducted using responses from 346 systems users in 149 organizations by a combination of exploratory factor analysis and structural equation modeling using LISREL. The process resulted in an instrument that measures 18 unidimensional factors within the three ISFS dimensions. Moreover, a sample of 120 matched-paired responses of separate CIO and user responses was used for nomological validation. The results showed that the ISFS measure reflected by the instrument was positively related to improvements in business processes effectiveness and organizational performance. Consequently, the instrument may be used for assessing IS performance, for guiding information technology investment and sourcing decisions, and as a basis for further research and instrument development.

Keywords

Computer systems – Evaluation; Functional scorecard; Information systems performance measurement; Instrument development; Information technology; Methodology; Structural equation modeling

Disciplines

Business | Community-Based Research | Computer Sciences | Databases and Information Systems | Systems and Communications

Permissions

Use Find in Your Library, contact the author, or use interlibrary loan to garner a copy of the article. Publisher copyright policy allows author to archive post-print (author’s final manuscript). When post-print is available or publisher policy changes, the article will be deposited

Repository Citation

Chang, J. C., King, W. R. (2005). Measuring the Performance of Information Systems: A Functional Scorecard. Journal of Management Information Systems, 22(1), 85-115.