This paper presents a general decision theoretic model of interactions between users and cognitive assistive technologies for various tasks of importance to the elderly population. The model is a partially observable Markov decision process (POMDP) whose goal is to work in conjunction with a user towards the completion of a given activity or task. This requires the model to monitor and assist the user, to maintain indicators of overall user health, and to adapt to changes. The key strengths of the POMDP model are that it is able to deal with uncertainty, it is easy to specify, it can be applied to different tasks with little modification, and it is able to learn and adapt to changing tasks and situations. This paper describes the model, gives a general learning method which enables the model to be learned from partially labeled data, and shows how the model can be applied within our research program on technologies for wellness. In particular, we show how the model is used in three tasks: assisted handwashing, health and safety monitoring, and wheelchair mobility. The paper gives an overview of ongoing work into each of these areas, and discusses future directions.
|
720
|
Pfinder: Realtime tracking of the human body
– Wren, Azarbayejani, et al.
- 1997
|
|
297
|
High resolution maps from wide angle sonar
– Moravec, Elfes
- 1985
|
|
143
|
A survey of algorithmic methods for partially observed Markov decision processes”, Annals of Operations Research
– Lovejoy
- 1991
|
|
77
|
Learning and Inferring Transportation Routines
– Liao, Fox, et al.
- 2004
|
|
68
|
Input-output HMM’s for sequence processing
– Bengio, Frasconi
- 1996
|
|
60
|
Experiences with a mobile robotic guide for the elderly
– Montemerlo, Pineau, et al.
- 2002
|
|
39
|
Using real-time stereo vision for mobile robot navigation
– Murray, Little
|
|
37
|
Layered representations for human activity recognition
– Oliver, Horvitz, et al.
- 2002
|
|
32
|
Bayesian Q-Learning
– Dearden, Friedman, et al.
- 1998
|
|
23
|
W (2000) Increasing the opportunities for aging in place
– ED, Essa, et al.
|
|
23
|
VDCBPI: an approximate scalable algorithm for large scale POMDPs
– Poupart, Boutilier
- 2004
|
|
21
|
A decision-theoretic approach to task assistance for persons with dementia
– Boger, Poupart, et al.
- 2005
|
|
18
|
Recognising and Monitoring High-Level Behaviours in Complex Spatial Environments
– Nguyen, Bui, et al.
- 2003
|
|
18
|
A Robotic Wheelchair System: Indoor Navigation and User Interface
– Yanco
- 1998
|
|
15
|
Sphinx-4: A flexible open source framework for speech recognition,” Sun Microsystems
– Walker, Lamere, et al.
- 2004
|
|
14
|
Partially Observable Markov Decision Processes with Continuous Observations for Dialog Management
– Williams, Poupart, et al.
- 2005
|
|
13
|
Assistive Technology for Cognitive Rehabilitation State of the Art. Neuropsychological Rehabilitation 14(1/2):5–39
– LoPresti, Mihailidis, et al.
- 2004
|
|
12
|
ARGMode – activity recognition using graphical models
– Hamid, Huang, et al.
- 2003
|
|
11
|
Solving POMDPs with continuous or large discrete observation spaces
– Hoey, Poupart
- 2005
|
|
9
|
Learning models of human behaviour with sequential patterns
– Guralnik, Haigh
- 2002
|
|
9
|
Representing hierarchical POMDPs as DBNs for multi-scale robot localization
– THEOCHAROUS, MURPHY, et al.
- 2004
|
|
8
|
Using sparse visual data to model human activities in meetings
– Rybski, Veloso
- 2004
|
|
7
|
The Use of Computer Vision in an Intelligent Environment to Support Agingin-Place
– Mihailidis, Carmichael, et al.
|
|
6
|
σmcl: Monte-carlo localization for mobile robots with stereo vision
– Elinas, Little
- 2005
|
|
5
|
The efficacy of an intelligent cognitive orthosis to facilitate handwashing by persons with moderate-to-severe dementia
– Mihailidis, Barbanel, et al.
- 2002
|
|
5
|
Adaptive Cognitive Orthotics: Combining Reinforcement Learning and Constraint-based Temporal Reasoning
– Rudary, Singh, et al.
- 2004
|
|
4
|
A planning system based on markov decision processes to guide people with dementia through activities of daily living
– Boger, Hoey, et al.
- 2005
|
|
4
|
Planning under uncertainty for reliable health care robotics
– Roy, Gordon, et al.
- 2003
|
|
2
|
Value-directed learning of gestures and facial displays
– Hoey, Little
- 2004
|
|
2
|
Semi-supervised learning of a pomdp model of patientcaregiver interactions. unpublished manuscript
– Hoey, Poupart, et al.
- 2005
|
|
1
|
An intelligent emergency response system
– Lee, Mihailidis
- 2005
|
|
1
|
Context-aware assistive devices for older adults with dementia. Gerontechnology 2:173
– Mihailidis, Fernie
- 2002
|
|
1
|
An intelligent health monitoring and emergency response system
– Mihailidis, Tam, et al.
- 2005
|
|
1
|
autonomy for wheel chair control: Attempts to assess the user’s autonomy
– Shared
|
