Results 1 - 10
of
119
A Survey of Mobile Phone Sensing
, 2010
"... Mobile phones or smartphones are rapidly becoming the central computer and communication device in people’s lives. Application delivery channels such as the Apple AppStore are transforming mobile phones into App Phones, capable of downloading a myriad of applications in an instant. Importantly, toda ..."
Abstract
-
Cited by 209 (7 self)
- Add to MetaCart
Mobile phones or smartphones are rapidly becoming the central computer and communication device in people’s lives. Application delivery channels such as the Apple AppStore are transforming mobile phones into App Phones, capable of downloading a myriad of applications in an instant. Importantly, today’s smartphones are programmable and come with a growing set of cheap powerful embedded sensors, such as an accelerometer, digital compass, gyroscope, GPS, microphone, and camera, which are enabling the emergence of personal, group, and communityscale sensing applications. We believe that sensor-equipped mobile phones will revolutionize many sectors of our economy, including business, healthcare, social networks, environmental monitoring, and transportation. In this article we survey existing mobile phone sensing algorithms, applications, and systems. We discuss the emerging sensing paradigms, and formulate an architectural framework for discussing a number of the open issues and challenges emerging in the new area of mobile phone sensing research.
SoundSense: Scalable Sound Sensing for People-Centric Applications on Mobile Phones
"... Top end mobile phones include a number of specialized (e.g., accelerometer, compass, GPS) and general purpose sensors (e.g., microphone, camera) that enable new people-centric sensing applications. Perhaps the most ubiquitous and unexploited sensor on mobile phones is the microphone – a powerful sen ..."
Abstract
-
Cited by 139 (10 self)
- Add to MetaCart
(Show Context)
Top end mobile phones include a number of specialized (e.g., accelerometer, compass, GPS) and general purpose sensors (e.g., microphone, camera) that enable new people-centric sensing applications. Perhaps the most ubiquitous and unexploited sensor on mobile phones is the microphone – a powerful sensor that is capable of making sophisticated inferences about human activity, location, and social events from sound. In this paper, we exploit this untapped sensor not in the context of human communications but as an enabler of new sensing applications. We propose SoundSense, a scalable framework for modeling sound events on mobile phones. SoundSense is implemented on the Apple iPhone and represents the first general purpose sound sensing system specifically designed to work on resource limited phones. The architecture and algorithms are designed for scalability and SoundSense uses a combination of supervised and unsupervised learning techniques to classify both general sound types (e.g., music, voice) and discover novel sound events specific to individual users. The system runs solely on the mobile phone with no back-end interactions. Through implementation and evaluation of two proof of concept peoplecentric sensing applications, we demostrate that SoundSense is capable of recognizing meaningful sound events that occur in users ’ everyday lives. Categories and Subject Descriptors
PEIR: the personal environmental impact report, as a platform for participatory sensing systems research
- in Proc. ACM/USENIX Int. Conf. Mobile Systems, Applications, and Services (MobiSys) Krakow
, 2009
"... PEIR, the Personal Environmental Impact Report, is a participatory sensing application that uses location data sampled from everyday mobile phones to calculate personalized estimates of environmental impact and exposure. It is an example of an important class of emerging mobile systems that combine ..."
Abstract
-
Cited by 101 (3 self)
- Add to MetaCart
(Show Context)
PEIR, the Personal Environmental Impact Report, is a participatory sensing application that uses location data sampled from everyday mobile phones to calculate personalized estimates of environmental impact and exposure. It is an example of an important class of emerging mobile systems that combine the distributed processing capacity of the web with the personal reach of mobile technology. This paper documents and evaluates the running PEIR system, which includes mobile handset based GPS location data collection, and server-side processing stages such as HMM-based activity classification (to determine transportation mode); automatic location data segmentation into “trips”; lookup of traffic, weather, and other context data needed by the models; and environmental impact and exposure calculation using efficient implementations of established models. Additionally, we describe the user interface components of PEIR and present usage statistics from a two month snapshot of system use. The paper also outlines new algorithmic components developed based on experience with the system and undergoing testing for integration into PEIR, including: new map-matching and GSM-augmented activity classification techniques, and a selective hiding mechanism that generates believable proxy traces for times a user does not want their real location revealed.
Discovery of activity patterns using topic models
- In Proc. Ubiquitous computing
, 2008
"... In this work we propose a novel method to recognize daily routines as a probabilistic combination of activity patterns. The use of topic models enables the automatic discovery of such patterns in a user’s daily routine. We report experimental results that show the ability of the approach to model an ..."
Abstract
-
Cited by 95 (2 self)
- Add to MetaCart
(Show Context)
In this work we propose a novel method to recognize daily routines as a probabilistic combination of activity patterns. The use of topic models enables the automatic discovery of such patterns in a user’s daily routine. We report experimental results that show the ability of the approach to model and recognize daily routines without user annotation. ACM Classification Keywords
The Mobile Sensing Platform: An Embedded Activity Recognition System
, 2008
"... The MSP is a small wearable device designed for embedded activity recognition with the aim of broadly supporting context-aware ubiquitous computing applications. ..."
Abstract
-
Cited by 93 (4 self)
- Add to MetaCart
The MSP is a small wearable device designed for embedded activity recognition with the aim of broadly supporting context-aware ubiquitous computing applications.
Energyaccuracy trade-off for continuous mobile device location.
- In MobiSys,
, 2010
"... ABSTRACT Mobile applications often need location data, to update locally relevant information and adapt the device context. While most smartphones do include a GPS receiver, its frequent use is restricted due to high battery drain. We design and prototype an adaptive location service for mobile dev ..."
Abstract
-
Cited by 60 (4 self)
- Add to MetaCart
(Show Context)
ABSTRACT Mobile applications often need location data, to update locally relevant information and adapt the device context. While most smartphones do include a GPS receiver, its frequent use is restricted due to high battery drain. We design and prototype an adaptive location service for mobile devices, a-Loc, that helps reduce this battery drain. Our design is based on the observation that the required location accuracy varies with location, and hence lower energy and lower accuracy localization methods, such as those based on WiFi and cell-tower triangulation, can sometimes be used. Our method automatically determines the dynamic accuracy requirement for mobile search-based applications. As the user moves, both the accuracy requirements and the location sensor errors change. ALoc continually tunes the energy expenditure to meet the changing accuracy requirements using the available sensors. A Bayesian estimation framework is used to model user location and sensor errors. Experiments are performed with Android G1 and AT&T Tilt phones, on paths that include outdoor and indoor locations, using war-driving data from Google and Microsoft. The experiments show that a-Loc not only provides significant energy savings, but also improves the accuracy achieved, because it uses multiple sensors.
A new probabilistic plan recognition algorithm based on string rewriting
- In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS
, 2008
"... This document formalizes and discusses the implementation of a new, more efficient probabilistic plan recognition algorithm called Yet Another Probabilistic Plan Recognizer, (Yappr). Yappr is based on weighted model counting, building its models using string rewriting rather than tree adjunction or ..."
Abstract
-
Cited by 50 (7 self)
- Add to MetaCart
(Show Context)
This document formalizes and discusses the implementation of a new, more efficient probabilistic plan recognition algorithm called Yet Another Probabilistic Plan Recognizer, (Yappr). Yappr is based on weighted model counting, building its models using string rewriting rather than tree adjunction or other tree building methods used in previous work. Since model construction is often the most computationally expensive part of such algorithms, this results in significant reductions in the algorithm’s runtime.
Unstructured Human Activity Detection from RGBD Images
"... Abstract — Being able to detect and recognize human activities is essential for several applications, including personal assistive robotics. In this paper, we perform detection and recognition of unstructured human activity in unstructured environments. We use a RGBD sensor (Microsoft Kinect) as the ..."
Abstract
-
Cited by 50 (9 self)
- Add to MetaCart
(Show Context)
Abstract — Being able to detect and recognize human activities is essential for several applications, including personal assistive robotics. In this paper, we perform detection and recognition of unstructured human activity in unstructured environments. We use a RGBD sensor (Microsoft Kinect) as the input sensor, and compute a set of features based on human pose and motion, as well as based on image and pointcloud information. Our algorithm is based on a hierarchical maximum entropy Markov model (MEMM), which considers a person’s activity as composed of a set of sub-activities. We infer the two-layered graph structure using a dynamic programming approach. We test our algorithm on detecting and recognizing twelve different activities performed by four people in different environments, such as a kitchen, a living room, an office, etc., and achieve good performance even when the person was not seen before in the training set. 1 I.
Cenceme - injecting sensing presence into social networking applications
- in EuroSSC, ser. Lecture Notes in Computer Science
, 2007
"... Abstract. We present the design, prototype implementation, and evaluation of CenceMe, a personal sensing system that enables members of social networks to share their sensing presence with their buddies in a secure manner. Sensing presence captures a user’s status in terms of his activity (e.g., sit ..."
Abstract
-
Cited by 44 (10 self)
- Add to MetaCart
(Show Context)
Abstract. We present the design, prototype implementation, and evaluation of CenceMe, a personal sensing system that enables members of social networks to share their sensing presence with their buddies in a secure manner. Sensing presence captures a user’s status in terms of his activity (e.g., sitting, walking, meeting friends), disposition (e.g., happy, sad, doing OK), habits (e.g., at the gym, coffee shop today, at work) and surroundings (e.g., noisy, hot, bright, high ozone). CenceMe injects sensing presence into popular social networking applications such as Facebook, MySpace, and IM (Skype, Pidgin) allowing for new levels of “connection ” and implicit communication (albeit non-verbal) between friends in social networks. The CenceMe system is implemented, in part, as a thin-client on a number of standard and sensor-enabled cell phones and offers a number of services, which can be activated on a per-buddy basis to expose different degrees of a user’s sensing presence; these services include, life patterns, my presence, friend feeds, social interaction, significant places, buddy search, buddy beacon, and “above average?” 1
Human activity detection from RGBD images
- In AAAI workshop on Pattern, Activity and Intent Recognition (PAIR
, 2011
"... Being able to detect and recognize human activities is important for making personal assistant robots useful in performing assistive tasks. The challenge is to develop a system that is low-cost, reliable in unstructured home settings, and also straightforward to use. In this paper, we use a RGBD sen ..."
Abstract
-
Cited by 38 (6 self)
- Add to MetaCart
(Show Context)
Being able to detect and recognize human activities is important for making personal assistant robots useful in performing assistive tasks. The challenge is to develop a system that is low-cost, reliable in unstructured home settings, and also straightforward to use. In this paper, we use a RGBD sensor (Microsoft Kinect) as the input sensor, and present learning algorithms to infer the activities. Our algorithm is based on a hierarchical maximum entropy Markov model (MEMM). It considers a person’s activity as composed of a set of sub-activities, and infers the two-layered graph structure using a dynamic programming approach. We test our algorithm on detecting and recognizing twelve different activities performed by four people in different environments, such as a kitchen, a living room, an office, etc., and achieve an average performance of 84.3% when the person was seen before in the training set (and 64.2 % when the person was not seen before).