Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

What can you see? Identifying cues on internal states from the movements of natural social interactions

Tools
- Tools
+ Tools

Bartlett, M., Edmunds, Charlotte, Belpaeme, Tony, Thill, Serge and Lemaignan, Severin (2019) What can you see? Identifying cues on internal states from the movements of natural social interactions. Frontiers in Robotics and AI, 6 . 49. doi:10.3389/frobt.2019.00049

[img]
Preview
PDF
WRAP-what-can-you-see-identifying-cues-internal-states-movements-natural-social-interactions-Edmunds-2019.pdf - Published Version - Requires a PDF viewer.
Available under License Creative Commons Attribution 4.0.

Download (789Kb) | Preview
[img] PDF
WRAP-what-can-you-see-identifying-cues-internal-states-movements-natural-social-interactions-Edmunds-2019.pdf - Accepted Version
Embargoed item. Restricted access to Repository staff only - Requires a PDF viewer.

Download (221Kb)
Official URL: https://doi.org/10.3389/frobt.2019.00049

Request Changes to record.

Abstract

In recent years, the field of Human-Robot Interaction (HRI) has seen an increasing demand for technologies that can recognize and adapt to human behaviors and internal states (e.g. emotions and intentions). Psychological research suggests that human movements are important for inferring internal states. There is, however, a need to better understand what kind of information can be extracted from movement data, particularly in unconstrained, natural interactions. The present study examines which internal states and social constructs humans identify from movement in naturalistic social interactions. Participants either viewed clips of the full scene or processed versions of it displaying 2D positional data. Then, they were asked to fill out questionnaires assessing their social perception of the viewed material. We analyzed whether the full scene clips were more informative than the 2D positional data clips. First, we calculated the inter-rater agreement between participants in both conditions. Then, we employed machine learning classifiers to predict the internal states of the individuals in the videos based on the ratings obtained. Although we found a higher inter-rater agreement for full scenes compared to positional data, the level of agreement in the latter case was still above chance, thus demonstrating that the social constructs under study were identifiable in both conditions. A factor analysis run on participants’ responses showed that participants identified the constructs interaction imbalance, interaction valence and engagement regardless of video condition. The machine learning classifiers achieved a similar performance in both conditions, again supporting the idea that movement alone carries relevant information. Overall, our results suggest it is reasonable to expect a machine learning algorithm, and consequently a robot, to successfully decode and classify a range of social situations using low-dimensional data (such as the movements and poses of observed individuals) as input.

Item Type: Journal Article
Divisions: Faculty of Social Sciences > Warwick Business School > Behavioural Science
Faculty of Social Sciences > Warwick Business School
Journal or Publication Title: Frontiers in Robotics and AI
Publisher: Frontiers Research Foundation
ISSN: 2296-9144
Official Date: 26 June 2019
Dates:
DateEvent
26 June 2019Published
6 June 2019Accepted
Volume: 6
Article Number: 49
DOI: 10.3389/frobt.2019.00049
Status: Peer Reviewed
Publication Status: Published
Access rights to Published version: Open Access
Related URLs:
  • Publisher

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item
twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us