Attitudes towards user experience (UX) measurement

Hdl Handle:
http://hdl.handle.net/10149/304974
Title:
Attitudes towards user experience (UX) measurement
Authors:
Law, E. L. (Effie Lai-Chong); van Schaik, P. (Paul) ( 0000-0001-5322-6554 ) ; Roto, V. (Virpi)
Affiliation:
Teesside University. Social Futures Institute.
Citation:
Law, E. L., van Schaik, P., Roto, V. (2014) 'Attitudes towards user experience (UX) measurement' International Journal of Human-Computer Studies; 72(6): 526-541
Publisher:
Elsevier
Journal:
International Journal of Human-Computer Studies
Issue Date:
2014
URI:
http://hdl.handle.net/10149/304974
DOI:
10.1016/j.ijhcs.2013.09.006
Additional Links:
http://linkinghub.elsevier.com/retrieve/pii/S1071581913001304
Abstract:
User Experience (UX), as a recently established research area, is still haunted by the challenges of defining the scope of UX in general and operationalising experiential qualities in particular. To explore the basic question whether UX constructs are measurable, we conducted semi-structured interviews with ten UX researchers from academia and one UX practitioner from industry where a set of questions in relation to UX measurement were explored (Study 1). The interviewees expressed scepticism as well as ambivalence towards UX measures and shared anecdotes related to such measures in different contexts. Interestingly, the results suggested that design-oriented UX professionals tended to be sceptical about UX measurement. To examine whether such an attitude prevailed in the HCI community, we conducted a survey - UX Measurement Attitudes Survey (UXMAS) - with essentially the same set of 13 questions used in the interviews (Study 2). Specifically, participants were asked to rate a set of five statements to assess their attitude towards UX measurement, to identify (non)measurable experiential qualities with justifications, and to discuss the topic from the theoretical, methodological and practical perspective. The survey was implemented in a paper-based and an online format. Altogether, 367 responses were received; 170 of them were valid and analysed. The survey provided empirical evidence on this issue as a baseline for progress in UX measurement. Overall, the survey results indicated that the attitude towards UX measurement was more positive than that identified in the interviews, and there were nuanced views on details of UX measurement. Implications for enhancing the acceptance of UX measures and the interplay between UX evaluation and system development are drawn: UX modelling grounded in theories to link experiential qualities with outcomes; the development of UX measurement tools with good measurement properties, and education within the HCI community to disseminate validated models, and measurement tools as well as their successful applications. Mutual recognition of the value of objective measures and subjective accounts of user experience can enhance the maturity of this area.
Type:
Article
Language:
en
Keywords:
user experience; UX measurement
ISSN:
10715819
Rights:
Author can archive post-print (ie final draft post-refereeing). For full details see http://www.sherpa.ac.uk/romeo [Accessed: 05/11/2013]

Full metadata record

DC FieldValue Language
dc.contributor.authorLaw, E. L. (Effie Lai-Chong)en_GB
dc.contributor.authorvan Schaik, P. (Paul)en_GB
dc.contributor.authorRoto, V. (Virpi)en_GB
dc.date.accessioned2013-11-05T12:33:01Zen
dc.date.available2013-11-05T12:33:01Zen
dc.date.issued2014en
dc.identifier.citationInternational Journal of Human-Computer Studies; 72(6): 526-541en_GB
dc.identifier.issn10715819en
dc.identifier.doi10.1016/j.ijhcs.2013.09.006en
dc.identifier.urihttp://hdl.handle.net/10149/304974en
dc.description.abstractUser Experience (UX), as a recently established research area, is still haunted by the challenges of defining the scope of UX in general and operationalising experiential qualities in particular. To explore the basic question whether UX constructs are measurable, we conducted semi-structured interviews with ten UX researchers from academia and one UX practitioner from industry where a set of questions in relation to UX measurement were explored (Study 1). The interviewees expressed scepticism as well as ambivalence towards UX measures and shared anecdotes related to such measures in different contexts. Interestingly, the results suggested that design-oriented UX professionals tended to be sceptical about UX measurement. To examine whether such an attitude prevailed in the HCI community, we conducted a survey - UX Measurement Attitudes Survey (UXMAS) - with essentially the same set of 13 questions used in the interviews (Study 2). Specifically, participants were asked to rate a set of five statements to assess their attitude towards UX measurement, to identify (non)measurable experiential qualities with justifications, and to discuss the topic from the theoretical, methodological and practical perspective. The survey was implemented in a paper-based and an online format. Altogether, 367 responses were received; 170 of them were valid and analysed. The survey provided empirical evidence on this issue as a baseline for progress in UX measurement. Overall, the survey results indicated that the attitude towards UX measurement was more positive than that identified in the interviews, and there were nuanced views on details of UX measurement. Implications for enhancing the acceptance of UX measures and the interplay between UX evaluation and system development are drawn: UX modelling grounded in theories to link experiential qualities with outcomes; the development of UX measurement tools with good measurement properties, and education within the HCI community to disseminate validated models, and measurement tools as well as their successful applications. Mutual recognition of the value of objective measures and subjective accounts of user experience can enhance the maturity of this area.en_GB
dc.language.isoenen
dc.publisherElsevieren_GB
dc.relation.urlhttp://linkinghub.elsevier.com/retrieve/pii/S1071581913001304en_GB
dc.rightsAuthor can archive post-print (ie final draft post-refereeing). For full details see http://www.sherpa.ac.uk/romeo [Accessed: 05/11/2013]en_GB
dc.subjectuser experienceen_GB
dc.subjectUX measurementen_GB
dc.titleAttitudes towards user experience (UX) measurementen
dc.typeArticleen
dc.contributor.departmentTeesside University. Social Futures Institute.en_GB
dc.identifier.journalInternational Journal of Human-Computer Studiesen_GB
or.citation.harvardLaw, E. L., van Schaik, P., Roto, V. (2014) 'Attitudes towards user experience (UX) measurement' International Journal of Human-Computer Studies; 72(6): 526-541en
All Items in TeesRep are protected by copyright, with all rights reserved, unless otherwise indicated.