Please report any queries concerning the funding data grouped in the sections named "Externally Awarded" or "Internally Disbursed" (shown on the profile page) to
your Research Finance Administrator. Your can find your Research Finance Administrator at https://www.ucl.ac.uk/finance/research/rs-contacts.php by entering your department
Please report any queries concerning the student data shown on the profile page to:
Email: portico-services@ucl.ac.uk
Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Email: portico-services@ucl.ac.uk
Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Publication Detail
Understanding engagement through search behaviour
-
Publication Type:Conference
-
Authors:Zhuang M, Demartini G, Toms EG
-
Publisher:ACM
-
Publication date:06/11/2017
-
Pagination:1957, 1966
-
Published proceedings:International Conference on Information and Knowledge Management, Proceedings
-
Volume:Part F131841
-
ISBN-13:9781450349185
-
Status:Published
-
Name of conference:CIKM '17 Proceedings of the 2017 ACM on Conference on Information and Knowledge Management
-
Conference place:Singapore
-
Conference start date:06/11/2017
-
Conference finish date:10/11/2017
Abstract
© 2017 Copyright held by the owner/author(s). Publication rights licensed to Association. Evaluating user engagement with search is a critical aspect of understanding how to assess and improve information retrieval systems. While standard techniques for measuring user engagement use questionnaires, these are obtrusive to user interaction, and can only be collected at acceptable intervals. The problem we address is whether there is a less obtrusive and more automatic way to assess how users perceive the search process and outcome. Log files collect behavioural signals (e.g., clicks, queries) from users on a large scale. In this paper, we investigate the potential to predict how users perceive engagement with search by modelling behavioural signals from log files using supervised learning methods.We focus on different engagement dimensions (Perceived Usability, Felt Involvement, Endurability and Novelty) and examine how 37 behavioural features can inform these dimensions. Our results, obtained from 377 in-lab participants undergoing goal-based search tasks, support the connection between perceived engagement and search behaviour. More specifically, we show that time-and query-related features are best suited for predicting user perceived engagement, and suggest that different behavioural features better reflect specific dimensions. We demonstrate the possibility of predicting user-perceived engagement using search behavioural features.
› More search options
UCL Researchers