Graphics & Geometry Group

ICSPACE: Intelligent Coaching Space

In the ICSPACE project we explore how to provide intelligent coaching in sports training, motor skill learning, or physical rehabilitation. The goal is to develop a VR-based "Intelligent Coaching Space" that enables novel ways of adaptive, online feedback in a closed-loop interaction and training system. Leveraging fundamental cognitive principles, perceptual processing, and movement understanding, ICSPACE combines state-of-the-art motion tracking and analysis, neuro-cognitive diagnosis, and multi-sensory feedback in various forms, including virtual mirrors, online verbal feedback, or instructions and demonstrations by a virtual coach.

This novel approach combines two key ingredients of successful coaching:
  • A deep grounding of intelligent coaching in fundamental cognitive principles, perceptual processing, and movement understanding;
  • Adaptive support in an online, closed-loop sensorimotor learning and interaction system.
ICSPACE

We aim to investigate the sensorimotor, cognitive, and social mechanisms underlying successful coaching, and to explore how cognitive interaction technology can provide coaching assistance that achieves, and perhaps even exceeds, the efficacy and acceptance of human coaching.

To advance the use of Cognitive Interaction Technology in effective coaching and deep assistance applications, we are creating the Intelligent Coaching Space, which supports human trainees in learning and practicing sensorimotor skills through adaptive and personalized instruction and tutoring in an online, closed-loop sensorimotor learning and interaction system.

ICSPACE News

icspace 01.10.2013: Official start of the ICSPACE project!
CAVE 07/2015: Our two-sided CAVE goes operational, featuring stereo back-projection on front wall and floor.
MoCap 12/2015: Our OptiTrack motion capture system arrived, enabling full-body motion tracking in the CAVE.
workshop1 13.02.2015: First ICSPACE milestone workshop is held in CITEC.
workshop2 11.02.2016: Second ICSPACE milestone workshop is held in CITEC.
press-release 11.02.2016: ICSPACE is featured in a press release of Bielefeld University.
research_tv 11.02.2016: ICSPACE features are nicely shown in a research_tv video (also shown below).
nw 12.02.2016: The ICSPACE project is featured in nice articles in Neue Westfälische and Westfalenblatt.
wdr 02.03.2016: The ICSPACE project is featured in a short TV spot of WDR Lokalzeit.
wunderwelt-wissen 25.07.2016: The ICSPACE project is featured in an article of Wunderwelt Wissen .
E and T 26.07.2016: The ICSPACE project is featured in an article of E&T 11(7).

Project Structure

The ICSPACE project is structured into six work packages, each of which will address a main component of the targeted intelligent coaching environment:

The internal structure of the project is organized along four milestone demonstrators, for which the intermediate results of each work package will be integrated and interwoven:

Figure 1: The first prototype (Milestone 1) of the ICSPACE system: A template avatar replicates the motions of the trainee in real-time.
Figure 2: The second prototype (Milestone 2) of the ICSPACE system: A personalized avatar mirrors the motions, the virtual coach gives instructions and feedback.
Video: Video by research_tv describing the ICSPACE project, featuring virtual mirror and virtual coach.

Related Publications

[1]
Dialogue Structure of Coaching Sessions
Iwan de Kok, Julian Hough, Cornelia Frank, David Schlangen, Stefan Kopp
Proceedings of SemDial Workshop on the Semantics and Pragmatics of Dialogue, 2014, pp. 167-169.
[PDF] 
[2]
Perceptual-cognitive monitoring in real world and virtual reality
Cornelia Frank, Thomas Schack
Proceedings of the 14th European Congress of Sport Psychology, 2014, pp. 128-129.
[PDF] 
[3]
Analogous motion illusion in audition and vision
Irene Senna, Cesare Parise, Marc O. Ernst
Poster presented at the 15th International Multisensory Research Forum, 2014.
[PDF] 
[4]
Temporal frequency modulates auditory speed perception
Irene Senna, Cesare Parise, Marc O. Ernst
Poster presented at the 16th International Multisensory Research Forum, 2015.
[PDF] 
[5]
Demonstrating the Dialogue System of the Intelligent Coaching Space
Iwan de Kok, Julian Hough, Felix Hülsmann, Thomas Waltemate, Mario Botsch, David Schlangen, Stefan Kopp
Proceedings of SemDial (GODIAL), 2015, pp. 168-169.
[PDF] 
[6]
Timing and Grounding in Motor Skill Coaching Interaction: Consequences for the Information State
Julian Hough, Iwan de Kok, David Schlangen, Stefan Kopp
Proceedings of SemDial Workshop on the Semantics and Pragmatics of Dialogue, 2015, pp. 86-94
[PDF] 
[7]
Multi-Level Analysis of Motor Actions as a Basis for Effective Coaching in Virtual Reality
Felix Hülsmann, Cornelia Frank, Thomas Schack, Stefan Kopp, Mario Botsch
International Symposium on Computer Science in Sport, 2015.
[PDF] 
[8]
Motor Performance and Interaction - Building Blocks in Brain and Technology
Thomas Schack
Invited Keynote Lecture at the International Symposium on Computer Science in Sport, 2015.
[9]
A Multimodal System for Real-Time Action Instruction in Motor Skill Learning
Iwan de Kok, Julian Hough, Felix Hülsmann, Mario Botsch, David Schlangen, Stefan Kopp
Proceedings of ACM International Conference on Multimodal Interaction, 2015.
[PDF] 
[10]
Hearing in slow-motion: Humans underestimate the speed of moving sounds
Irene Senna, Cesare Parise, Marc O. Ernst
Scientific Reports 5, 2015.
[PDF] 
[11]
Accurate Face Reconstruction through Anisotropic Fitting and Eye Correction
Jascha Achenbach, Eduard Zell, Mario Botsch
Proceedings of Vision, Modeling and Visualization, 2015.
[PDF] 
[12]
Realizing a Low-latency Virtual Reality Environment for Motor Learning
Thomas Waltemate, Felix Hülsmann, Thies Pfeiffer, Stefan Kopp, Mario Botsch
Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST), 2015.
[13]
Cornelia Frank, William Marshall Land, Thomas Schack
Perceptual-cognitive changes during motor learning: The influence of mental and physical practice on mental representation, gaze behavior, and the performance of a complex action
Frontiers in Psychology: Movement Science and Sport Psychology (6), 2016.
[PDF] 
[14]
Cornelia Frank, Irene Senna, Felix Hüsmann, Marc Ernst, Mario Botsch, Stefan Kopp, Thomas Schack
Imagery and observation research in virtual reality environments
Annual meeting of the Research on Imagery and Observation (RIO) group, 2016.
[15]
Felix Hüsmann, Thomas Waltemate, Thies Pfeiffer, Mario Botsch, Stefan Kopp
The ICSPACE Platform: A Virtual Reality Setup for Experiments in Motor Learning
Poster presented at Virtual Environments: Current Topics in Psychological Research (VECTOR), 2016.
[PDF] 
[16]
Cornelia Frank, Iwan de Kok, Irene Senna, Thomas Waltemate, Felix Hüsmann, Thies Pfeiffer, Marc Ernst, Stefan Kopp, Mario Botsch, Thomas Schack
Latency, sensorimotor feedback and virtual agents: Feedback channels for motor learning using the ICSPACE platform
Poster presented at Virtual Environments: Current Topics in Psychological Research (VECTOR), 2016.
[PDF] 

Involved People

Steering Committee
Postdoctoral Researchers
Ph.D. Students
Student Researchers
Angelika Maier
Lina Varonina
Yvonne Ritter