MITS Advanced Research Techniques: Mobile App User Experience Metrics

This research report, conducted at the Victorian Institute of Technology, focuses on developing metrics to quantify user experience satisfaction in mobile applications. It explores the use of the GQM model to create usability metrics and determine customer satisfaction levels. The report reviews existing literature on usability metrics, including user performance, temporal efficiency, and task effectiveness, and highlights the SUMI model for measuring satisfaction. It details the qualitative and quantitative methodologies used in the research, emphasizing the importance of usability in ensuring application accuracy and user safety. The study analyzes various metrics and standards, including ISO 9241, and discusses the role of tools like log processors in calculating key performance indicators. The research aims to provide a comprehensive understanding of how to measure and improve user experience in mobile apps, addressing challenges related to mobile device features and usability measurement models.

MITS Advanced Research Techniques
Research Report
Candidate:
Student Name
Higher Education Department
Victorian Institute of Technology
Report Title:
The development of metrics for proper quantification of user experience satisfaction of
mobile applications.
Abstract
The paper mainly reflects on proper development of metrics that are helpful in quantifying the
customer satisfaction experience on mobile apps. The main aim of the research is to use GQM
model that is helpful in proper development of usability metrics that further helps in determining
the level of satisfaction that the customer gets by using the mobile app. The paper reflects on the
entire steps that are mainly utilized in order to conduct the literature review effectively. From the
literature that is reviewed, it is analyzed that usability metrics mainly include a user performance
measure, temporal efficiency, length of proportion as well as effectiveness of task. In addition to
this, the paper also reflects on the SUMI model for showcase five different metrics of usability
that will be helpful in measuring the satisfaction level of the customers. Furthermore, proper
qualitative as well as quantitative methodology that is mainly used in order to conduct the
research quite effectively.

Introduction
The main focus of the paper is on the development of metrics for proper quantification of
user experience satisfaction of mobile applications. It is found that usability is one of the metrics
and its measurement can be considered as one of the most important tasks that is helpful in
ensuring that the application that is used is quite accurate and have sufficient speed. Moreover, it
also helps in ensuring that safety of the various users who uses the mobile app from injury as
well as other type of strain. The enhancing number of mobile phone related users have mainly
deployed mobile app for gaining proper competitive advantages in the market [3]. It is found that
the paper generally attempts for reviewing a number of existing metrics for various types of
desktop-based computing and for subsequently developing proper conceptual model that is
helpful in evaluating the mobile app. Furthermore, the model mainly consists of a number of
usability-based metrics for evaluating the mobile application [1].
It is found that usability generally refers to one of the methods that generally helps in
improving the ease of use during the early process of design. By effectively focusing on the user
experience as well as usability, one can be able to properly create high quality applications [4].
However, it is found that there are clear guidelines about different types of definitions that are
associated with the various usability factor, criteria as well as rules for measuring the usability of
the mobile app. Moreover, some of the developers generally employed a number of usability
methods. Furthermore, it is found that a number of novelties based mobile applications and their
unique features can be considered as the main challenges that are associated with the usability
measurement related activity for the mobile devices [2]. It is found that a number of features off
mobile devices can be effectively explored that further include limited bandwidth, charging
mobile as well as limited memory quite effectively.

It is identified that a number of usability measurement related models are present. The
Metrics for usability standards generally reflected that usability metrics mainly include a user
performance measure, temporal efficiency, length of proportion as well as effectiveness of task.
Additionally, it is identified that performance related view of usability does not generally reflect
other aspects of usability including learnability as well as user satisfaction [6]. Furthermore,
Software Usability Measurement Inventory (SUMI) was generally developed for providing
proper measures of global satisfaction based on five different topic areas that mainly includes
efficiency, control, effectiveness as well ae learnability [7]. The project generally concerns about
the analysis of the user-based evaluation as well as delivery of data to the appropriate party.
Furthermore, the log processor is considered as one of the tools that helps in properly calculating
snag, task time, relative efficiency as well as effectiveness. Furthermore, for analyzing the
usability measurement dimension, it is found that the highest characteristic in usability
evaluation in effectiveness is around 62%, in efficiency it is around 33% as well as satisfaction
will be around 20% and these three characteristics generally helps in reflecting ISO 9241
standard as they generally helps in measuring attributes for that standards quite effectively [5].

Bibliography
[1].Sauro, J. and Lewis, J.R. Quantifying the user experience: Practical statistics for user
research. Morgan Kaufmann, 2016.
[2].Georgsson, M. and Staggers, N. Quantifying usability: an evaluation of a diabetes
mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user
characteristics. Journal of the American Medical Informatics Association, 23(1), pp.5-11,
2016.
[3].Lachner, F., Naegelein, P., Kowalski, R., Spann, M. and Butz, A. Quantified ux: Towards
a common organizational understanding of user experience. In Proceedings of the 9th
Nordic conference on human-computer interaction (pp. 1-10), 2016.
[4].Riegler, A. and Holzmann, C. Measuring visual user interface complexity of mobile
applications with metrics. Interacting with Computers, 30(3), pp.207-223, 2018.
[5].Olubusola, A.O. User satisfaction in mobile applications. Research Paper at School of
Computer Science, University of Birmingham. Retrieved from, 2015.
[6].Shin, D.H. Conceptualizing and measuring quality of experience of the internet of things:
Exploring how quality is perceived by users. Information & Management, 54(8), pp.998-
1011, 2017.
[7].Li, D., Guo, B., Shen, Y., Li, J. and Huang, Y. The evolution of open‐source mobile
applications: An empirical study. Journal of software: Evolution and process, 29(7),
p.e1855, 2017.