The Vilans Observation Tool for Human-Technology Interaction
A Blended Observation System for Interactions with Socially Assistive Technologies
DOI:
https://doi.org/10.21467/ijm.4.1.10215Abstract
The increasing development and adoption of gerontechnology, which are assistive technologies designed to support older adults’ independence, well-being, and social connection, underscore the critical need for robust methods to assess their real-world impact. While observational tools are essential for this purpose, existing methods often present a trade-off between efficiency and depth. Rating scales are simple to use but lack the temporal and behavioural granularity needed to analyse interaction processes, while detailed behavioural coding schemes are resource-intensive and inflexible. This paper addresses a significant gap by introducing the Vilans Observation Tool for Human-Technology Interaction (VOTHI) framework, a novel, low-threshold, hybrid observational tool. Developed through a literature analysis of existing instruments, VOTHI combines the structural clarity of rating scales with the temporal sensitivity of coding schemes, organized in a modular structure to adapt to various research contexts and technologies. The framework’s design principles emphasise the holistic capture of interactional dynamics, including verbal, non-verbal, affective, and contextual cues, focusing on the process of interaction rather than just the outcome. Pilot-testing demonstrates VOTHI’s capacity to provide a comprehensive, adaptable, and practical method for researchers to analyse human-technology interactions. The tool serves as a valuable solution for capturing subtle, dynamic, and process-oriented aspects of engagement, particularly in gerontechnological contexts.
Keywords:
Human-Technology Interaction, Observational tools, GerontechnologyDownloads
References
WHO, ‘Ageing and health’. Accessed: Aug. 06, 2025. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/ageing-and-health
M. Ienca et al., ‘Intelligent Assistive Technology for Alzheimer’s Disease and Other Dementias: A Systematic Review’, J. Alzheimer’s Dis., vol. 56, no. 4, pp. 1301–1340, Feb. 2017, doi: 10.3233/JAD-161037.
W. Q. Koh et al., ‘Bridging gaps in the design and implementation of socially assistive technologies for dementia care: the role of occupational therapy’, Disabil. Rehabil. Assist. Technol., vol. 19, no. 3, pp. 595–603, Apr. 2024, doi: 10.1080/17483107.2022.2111610.
W. Q. Koh, S. A. Felding, K. B. Budak, E. Toomey, and D. Casey, ‘Barriers and facilitators to the implementation of social robots for older adults and people with dementia: a scoping review’, BMC Geriatr., vol. 21, no. 1, p. 351, Jun. 2021, doi: 10.1186/s12877-021-02277-9.
G. Cortellessa, R. De Benedictis, F. Fracasso, A. Orlandini, A. Umbrico, and A. Cesta, ‘AI and robotics to help older adults: Revisiting projects in search of lessons learned’, Paladyn J. Behav. Robot., vol. 12, no. 1, pp. 356–378, Aug. 2021, doi: 10.1515/pjbr-2021-0025.
N. Gasteiger et al., ‘Older adults’ experiences and perceptions of living with Bomy, an assistive dailycare robot: a qualitative study’, Assist. Technol., vol. 34, no. 4, pp. 487–497, Jul. 2022, doi: 10.1080/10400435.2021.1877210.
B. M. Hofstede et al., ‘A field study to explore user experiences with socially assistive robots for older adults: emphasizing the need for more interactivity and personalisation’, Front. Robot. AI, vol. 12, p. 1537272, Mar. 2025, doi: 10.3389/frobt.2025.1537272.
S. Suijkerbuijk, L. Cornelisse, S. Van Der Weegen, and H. H. Nap, ‘Technologie implementeren met het honingraatmodel’, TVZ - Verpleegkd. Prakt. En Wet., vol. 131, no. 4, pp. 14–17, Aug. 2021, doi: 10.1007/s41184-021-1016-6.
M. Drummond, R. Tarricone, and A. Torbica, ‘European union regulation of health technology assessment: what is required for it to succeed?’, Eur. J. Health Econ., vol. 23, no. 6, pp. 913–915, Aug. 2022, doi: 10.1007/s10198-022-01458-6.
H. S. M. Kort, ‘Criteria and assessment of assistive technologies for ageing-in-place’, Gerontechnology, vol. 23, no. s, pp. 1–1, Jul. 2024, doi: 10.4017/gt.2024.23.s.1131.1.sp.
WHO, ‘Health technology assessment - Global’. Accessed: Aug. 06, 2025. [Online]. Available: https://www.who.int/health-topics/health-technology-assessment
J. Bidonde, M. Vanstone, L. Schwartz, and J. Abelson, ‘An institutional ethnographic analysis of public and patient engagement activities at a national health technology assessment agency’, Int. J. Technol. Assess. Health Care, vol. 37, no. 1, p. e37, Jan. 2021, doi: 10.1017/S0266462321000088.
S. Singh, ‘What is Ethnographic Research? Methods and Examples | Researcher Life’. Accessed: Aug. 06, 2025. [Online]. Available: https://researcher.life/blog/article/what-is-ethnographic-research-methods-and-examples/
S. Ilha, F. Casarin, B. Huppes, D. P. Gautério-Abreu, F. Fernandes, and O. L. Munhoz, ‘Gerontechnologies to Support Family Caregivers of Elderly Individuals with Alzheimer’s Disease: a strategic action research study’, Rev. Enferm., vol. 32, 2024, doi: 10.12957/reuerj.2024.84101.
K. G. Madsø, E. Flo-Groeneboom, N. A. Pachana, and I. H. Nordhus, ‘Assessing Momentary Well-Being in People Living With Dementia: A Systematic Review of Observational Instruments’, Front. Psychol., vol. 12, Nov. 2021, doi: 10.3389/fpsyg.2021.742510.
G. Perugia, R. van Berkel, M. Díaz-Boladeras, A. Català-Mallofré, M. Rauterberg, and E. Barakova, ‘Understanding Engagement in Dementia Through Behavior. The Ethographic and Laban-Inspired Coding System of Engagement (ELICSE) and the Evidence-Based Model of Engagement-Related Behavior (EMODEB)’, Front. Psychol., vol. 9, 2018, doi: 10.3389/fpsyg.2018.00690.
L. M. Pirborj, C. Mills, R. Gorkin, and Karthick Thiyagarajan, ‘Tactile Interaction with Socially Assistive Robots for Children with Physical Disabilities’, Sensors, vol. 25, no. 13, pp. 4215–4215, 2025, doi: 10.3390/s25134215.
S. Qiu, P. An, K. Kang, J. Hu, T. Han, and M. Rauterberg, ‘A Review of Data Gathering Methods for Evaluating Socially Assistive Systems’, Sensors, vol. 22, no. 1, p. 82, 2022, doi: 10.3390/s22010082.
J. Cohen-Mansfield et al., ‘The Comprehensive Process Model of Engagement’, Am. J. Geriatr. Psychiatry, vol. 19, no. 10, pp. 859–870, 2011, doi: 10.1097/jgp.0b013e318202bf5b.
J. Cohen-Mansfield, M. Dakheel-Ali, and M. S. Marx, ‘Engagement in Persons With Dementia: The Concept and Its Measurement’, Am. J. Geriatr. Psychiatry, vol. 17, no. 4, pp. 299–307, 2009, doi: 10.1097/jgp.0b013e31818f3a52.
C. Jones, B. Sung, and W. Moyle, ‘Engagement of a Person with Dementia Scale: Establishing content validity and psychometric properties’, J. Adv. Nurs., vol. 74, no. 9, pp. 2227–2240, 2018, doi: 10.1111/jan.13717.
K. S. Judge, C. J. Camp, and S. Orsulic-Jeras, ‘Use of Montessori-based activities for clients with dementia in adult day care: Effects on engagement’, Am. J. Alzheimers Dis., vol. 15, no. 1, pp. 42–46, 2000, doi: 10.1177/153331750001500105.
M. P. Lawton, K. Van Haitsma, and J. Klapper, ‘Observed Affect in Nursing Home Residents with Alzheimer’s Disease’, J. Gerontol. B. Psychol. Sci. Soc. Sci., vol. 51B, no. 1, pp. P3–P14, 1996, doi: 10.1093/geronb/51b.1.p3.
Y. Feng, G. Perugia, S. Yu, E. I. Barakova, J. Hu, and W. Matthias, ‘Context Enhanced Human Robot Interaction: Exploring the Role of System Interactivity and Multimodal Stimuli on the Engagement of People with Dementia’, Int. J. Soc. Robot., vol. 14, no. 3, pp. 807–826, 2022, doi: 10.1007/s12369021008234.
A. Tanner, A. Urech, H. Schulze, and T. Manser, ‘Older Adults’ Engagement and Mood During Robot-Assisted Group Activities in Nursing Homes: Development and Observational Pilot Study’, JMIR Rehabil. Assist. Technol., vol. 10, pp. e48031–e48031, 2023, doi: 10.2196/48031.
W.-L. Chang, S. Sabanovic, and L. Huber, ‘Observational study of naturalistic interactions with the socially assistive robot PARO in a nursing home’, Robot Hum. Interact. Commun., 2014, doi: 10.1109/roman.2014.6926268.
H. Yoon, G. Shim, H. Lee, M.-G. Kim, and S. Kim, ‘Observation of Human–Robot Interactions at a Science Museum: A Dual-Level Analytical Approach’, Electronics, vol. 14, no. 12, p. 2368, 2025, doi: 10.3390/electronics14122368.
A. Andrés, D. E. Pardo, M. Díaz, and C. Angulo, ‘New instrumentation for human robot interaction assessment based on observational methods’, J. Ambient Intell. Smart Environ., vol. 7, no. 4, pp. 397–413, 2015, doi: 10.3233/ais-150331.
A. L. Snow et al., ‘Development of a New Tool for Systematic Observation of Nursing Home Resident and Staff Engagement and Relationship’, The Gerontologist, vol. 58, no. 2, pp. e15–e24, 2018, doi: 10.1093/geront/gnw255.
J. W. Creswell and C. N. Poth, Qualitative Inquiry and Research Design: Choosing Among Five Approaches. SAGE Publications, 2016.
J. W. Creswell and J. D. Creswell, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications, 2017.
A. A. Abdelrahman, D. Strazdas, A. Khalifa, J. Hintz, T. Hempel, and A. Al-Hamadi, ‘Multimodal Engagement Prediction in Multiperson Human–Robot Interaction’, IEEE Access, vol. 10, pp. 61980–61991, 2022, doi: 10.1109/ACCESS.2022.3182469.
R. Bakeman and J. M. Gottman, Observing Interaction: An Introduction to Sequential Analysis. Cambridge University Press, 1997.
S. Pink and V. Fors, ‘Ethnography, Stakeholders, and Audiences: Toward Openness and Inclusivity’, Sociol. Res. Online, vol. 22, no. 4, pp. 169–173, Dec. 2017, doi: 10.1177/1360780417746029.
A. Tausch, A. Kluge, and L. Adolph, ‘Psychological Effects of the Allocation Process in Human–Robot Interaction – A Model for Research on ad hoc Task Allocation’, Front. Psychol., vol. 11, Sep. 2020, doi: 10.3389/fpsyg.2020.564672.
M. D. LeCompte and J. J. Schensul, Designing & conducting ethnographic research: an introduction, Second edition. in The ethnographer’s toolkit, no. 1. Lanham, Md: AltaMira Press, 2010.
A. Dang and T. Manjunath, ‘The value of observational study data in healthcare decision making: An Indian perspective’, Int. J. Med. Public Health, vol. 6, no. 1, p. 53, 2016, doi: 10.4103/2230-8598.179778.
M. B. Happ, ‘Mixed Methods in Gerontological Research: Do the Qualitative and Quantitative Data “Touch”?’, Res. Gerontol. Nurs., vol. 2, no. 2, pp. 122–127, Apr. 2009, doi: 10.3928/19404921-20090401-06.
Downloads
Published
Issue
Section
How to Cite
License
Copyright (c) 2026 Eniko Agotai, Bob M Hofstede
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
