580 California St., Suite 400
San Francisco, CA, 94104
Key research themes
1. How can the DeLone and McLean IS Success Model be applied and extended to measure Information Systems success across different contexts?
This research theme centers on the application, empirical testing, and extension of the widely-cited DeLone and McLean (D&M) model of Information Systems (IS) success. The D&M model conceptualizes IS success through interrelated constructs such as system quality, information quality, service quality, use, user satisfaction, and net benefits. Understanding how these constructs interact in individual and organizational contexts, and how they can be measured reliably, is critical for organizations to assess IS effectiveness beyond financial metrics. Researchers have focused on validating the model in diverse environments, respecifying constructs alignment, and examining quality dimensions, as well as studying emerging contexts and software types.
Key finding: This comprehensive qualitative literature review of 180 studies (1992–2007) consolidates the D&M IS success model's six dimensions and examines 15 pairwise associations, confirming its validity in both individual and... Read more
Key finding: Using field data from a mandatory IS, the study empirically tests the original D&M model, finding that perceived system quality and information quality significantly predict user satisfaction and system use, but only user... Read more
Key finding: This study respecifies the D&M model by integrating perceived quality based on social exchange theory and perceived value, testing it using end-user accounting software self-developed by firms. It reveals that perceived... Read more
Key finding: Analyzing 169 SMEs in Mexico through PLS and Multi-Group Analysis, this empirical study finds that while users report satisfaction with IS quality, this satisfaction does not translate into enhanced use or perceived... Read more
Measuring the performance of business information systems: Pilot study in Saudi business environment
Key finding: Pilot data from Saudi firms applying the D&M success model confirm that system quality and user satisfaction are major contributors to perceived net benefits, while not all dimensions fully satisfy net benefit expectations.... Read more
2. What usability evaluation methodologies provide the most comprehensive assessment of Information Systems' user experience?
This research emphasis lies in categorizing, comparing, and synthesizing usability evaluation methodologies to effectively assess Information Systems’ user experience and interaction quality. Beyond traditional binary usability, contemporary studies recognize usability as a continuum contributing to user experience encompassing emotional, cognitive, and contextual factors. Methodologies span empirical and analytical approaches including tests, inquiries, inspections, experiments, heuristic evaluations, cognitive walkthroughs, and think-aloud protocols. An improved understanding of these methods’ strengths, weaknesses, and complementary combinations is pivotal for designing assessments that capture both functional performance and user satisfaction holistically.
Key finding: Based on a systematic review of over 2,100 studies, this work classifies usability evaluation methods into empirical and analytical types, finding that inquiry methods are most prevalent followed by testing, inspection, and... Read more
Key finding: This comparative study applies a structured multi-criteria approach to evaluate four popular usability evaluation methods (heuristic evaluation, cognitive walkthroughs, think-aloud protocol, co-discovery learning) against an... Read more
Key finding: Exploring the interface of technology adoption in evaluation, this work employs Multi-Attribute Measures of Innovation Adoption (MAMIA) to identify key technological tools evaluators use and the factors driving adoption like... Read more
3. How can tailored evaluation frameworks incorporating stakeholder perspectives and contextual factors improve Information Systems evaluation?
This theme investigates the integration of multi-stakeholder viewpoints and contextual intricacies into IS evaluation frameworks to derive holistic assessment approaches. Traditional financial, functional, and technical measures often neglect qualitative, organizational, social, and cultural dimensions. Using theories such as stakeholder theory, soft systems methodology, process thinking, and organizational learning, these frameworks aim to embed participatory evaluation processes, address ‘soft’ human factors, and adapt models for complex domains like e-Government or healthcare. The frameworks facilitate adaptive, reflective evaluations supporting continuous improvement and alignment with strategic goals.
Key finding: By blending stakeholder and process theory, this empirical study proposes a process framework that engages diverse IS/IT stakeholder expectations iteratively throughout system development. It demonstrates that involving... Read more
Key finding: This paper develops an 'e-government balanced scorecard' framework synthesizing software project management, e-government-specific measures, and benchmarking indices. It captures multi-dimensional evaluation criteria... Read more
Key finding: Addressing the particularities of healthcare IS, this framework integrates healthcare-specific requirements with IS evaluation models, accommodating non-causal impactful relationships and cross-cultural variables. It... Read more
Key finding: This positioning paper proposes an integrative methodology combining Information Systems methodologies (hard and soft systems), organizational learning, and knowledge management to evaluate e-government systems... Read more
A Study on Information Systems Success: Examining User Satisfaction of Accounting Information System
Key finding: Using modified D&M constructs in Indonesian local government accounting systems, this empirical study highlights that system, information, and service quality significantly affect user satisfaction, which is critical to... Read more