Development of a User Experience Evaluation Framework for Intelligent IoT Services

Abstract

Background As Internet of Things (IoT) systems and services are widely used across industries, IoT has evolved by integrating with various technologies. Among these, research on Intelligent IoT, which considers multiple situations and contexts through the combination of artificial intelligence, is actively underway. However, most studies focus on algorithm or functionality improvements for the systems or service design at the stage based on user needs. Moreover, there has been a lack of research on the development of evaluation frameworks for IoT systems and services, particularly those that consider both user situations and contexts. Based on this, a framework for evaluating the user experience of intelligent IoT services is proposed. Methods A literature review on intelligent IoT was conducted to derive evaluation indicators. The literature review involved collecting guidelines related to IoT, design, and user evaluation through a chain sampling method, and setting keywords focused on the characteristics of IoT to perform a systematic literature review and a structured article sampling process. The indicators collected through this process were then used to establish an initial set of indicators through affinity diagramming and workshops. Subsequently, the preliminary evaluation indicators were reviewed ...