Jacob, R. J. Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. 151--190.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....is very simple: track the movements of the user s eyes and note what the pupils are doing. Eye gaze systems, i.e. systems that measure the users eye movements when he or she observes a computer screen or a blackboard, allow people who have no use of their hands to operate a personal computer [12] [13] [14] Many different technologies [15] have been applied to the problem of eye tracking, even if some are more suited to laboratory experiments or medical diagnosis than usercomputer dialogues. One of the least expensive and simplest eye tracking technologies, for example, consists in recording ....

R. J. K. Jacob, "Eye movement-based human-computer interaction techniques: Toward non-command interfaces", in D. Hartson, and Hix (eds.), Advances in Human-Computer Interaction, vol 4, Ablex: Norwood, NJ, pp. 151-180, 1993.

....This chapter summarizes the research papers on multimodal interaction techniques that belong to this dissertation. Often the concept of an interaction technique is assumed to be self evident. Most researchers who discuss these techniques do not define the concept at all. A definition by Robert Jacob [1993] is by no means exhaustive, but in my opinion it captures the essence of the concept of an interaction technique well: An interaction technique represents an abstraction of some common class of interactive task, for example, choosing one of several objects shown on a display screen. Research ....

Robert J. K. Jacob, Eye movement-based human-computer interaction techniques: toward non-command interfaces. In: Advances in Human-Computer Interaction, Vol. 4, H. R. Hartson and D. Hix (Eds.), Ablex Publishing, 1993, 151-190.

.... non WIMP interfaces are common to a more general class of emerging usercomputer environments, including new types of games, musical accompaniment systems, intelligent agent interfaces, interactive entertainment media, pen based interfaces, eye movement based interfaces, and ubiquitous computing [29] [12] They share a higher degree of interactivity than previous interfaces: continuous input output exchanges occurring in parallel, rather than one single thread, discrete event dialogue. These interaction techniques rely upon asynchronous, parallel, and continuous user computer interaction ....

R.J.K. Jacob, "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces," in Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood,N.J., 1993.

....infer user intentions and interests from user actions. Given the highly visual nature of windows based interfaces, gaze direction has been identified as an excellent source for determining user interest. Gaze movement data has led to two very different types of interfaces: command and non command [2], 8] Command based interfaces use gaze location to directly issue commands to the system. For example, gaze can be used to type on a graphical keyboard [10] or select icons or menu items [3] In contrast, non command interfaces use gaze information to indirectly tune the system to the user s ....

....fixations, which are studied for their physiological and psychological relevance by vision scientists and psychologists. Low level intentional events are the smallest coherent units of movement that the user is aware of during visual activity, which include sustained fixations and revisits (e.g. [2]) For example, users are aware of gazing at the cursor and then at an item on the menu bar, but they are not aware of briefly fixating on two other menu items before finding the desired one. Similar to both approaches is that of synthesizing higher order intentions with low level events. For ....

[Article contains additional citation context not shown here]

Jacob, R. J. K. (1993). Eye movement-based humancomputer interaction techniques: Toward non-command interfaces. In Hartson, D. & Hix, (Eds.)., Advances in Human-Computer Interaction, Vol 4, pp. 151-180. Ablex: Norwood, NJ.

....interfaces (a) monitor user behavior, b) model user goals and interests, c) anticipate user needs, and (d) provide users with information, and (e) interact with users. User behavior might be monitored, for example, by video cameras to watch for certain sorts of user actions such eye movements [5,14] or hand gestures [1] by microphones to listen for speech or other sounds [10] or by a computer s operating system to track keystrokes, mouse input, and application use [4,6,7] User goals and interests might be modeled using Bayesian networks [4] predefined knowledge structures [11] or ....

.... modeled using Bayesian networks [4] predefined knowledge structures [11] or heuristics [7] User needs might be anticipated by modeling task demands [11] Information might be delivered to users by speech or by text [7,10] and users might interact directly through eye gaze, gestures or speech [1,5,12,14]. Attentive user interfaces are related to perceptual user interfaces (PUI) which incorporate multimodal input, multimedia output, and human like perceptual capabilities to create systems with natural human computer interactions [10 ,13] Whereas the emphasis of PUI is on coordinating perception ....

Jacob, R. J. K. (1993). Eye movement-based human-computer interaction techniques: Toward non-command interfaces. In Hartson, D. & Hix, (Eds.)., Advances in Human-Computer Interaction, Vol 4, pp. 151-180. Ablex: Norwood, NJ.

.... microphone arrays: acoustic beamforming to localize a speaker in a room and to remove noise is more accurate if aided by visual information from the face tracker[72] Second, gaze information has been used for selection and manipulation of objects, equivalent to mouse click and dragging operations [139, 191, 396]. Third, eye fixations have been used to resolve object references, e.g. in multimodal interactions with a map [210] ffl Combining Speech Input with Speech Synthesis or Face Synthesis: Speech input has been combined with speech synthesis in two domains: first, a multitude of so called dialogue ....

....24 recognition and tracking of faces and other facial features either as necessary first step for lipreading and speechreading systems (which will be reported later on in this chapter in Section 4. 4) or as additional input modality, for example, for eye movement based human computer interaction [191]. This section first provides a cursory review of face recognition and tracking (based mainly on material from [326, 329] then of recognition and tracking of other facial features, in particular lips and gaze. Samal [329] identified five basic problems in face recognition: representation of ....

R.J.K. Jacob. Eye-movement based human-computer interaction techniques: Toward non-command interfaces. In H.R. Hartson and D. Hix, editors, Advances in Human-Computer Interaction, volume 4, pages 151--189. Ablex Publishing, 1993.

....be used is well established now. Also, it has been demonstrated that interfaces utilizing eye tracking are efficient and favored by users at least in some special circumstances [10, 12, 13] We have examples of systems where Gaze input is useful and some general reasoning on why this is the case [2]. However, there is still a lot of room for experimentation. We propose that the use of off screen targets may alleviate some problems encountered in traditional eye tracker based text input methods. Text input with eye gaze is and most likely will never be a mainstream activity. In comparison to ....

....user applications according to the keyboard focus mechanism. Thus, our system can be used as a keyboard replacement in all Windows compatible applications with normal keyboard message handling. The partly non conscious mechanism that controls our eyes tends to direct them towards visible features [2]. Therefore it is very difficult to focus our gaze on a point in space especially if there are visible objects next to it. We found it unnecessarily difficult to look at a point on the side of the display that is not actually visible. To make the targets visible, we used strips of paper that had ....

R. J. K. Jacob. Eye Movement-Based Human-computer Interaction Techniques: Toward Non-Command Interfaces, in H. R. Hartson and D. Hix, editors, Advances in HumanComputer Interaction, pages 151 -- 190, Ablex Publishing Co.,: Norwood, N.J., 1993.

.... microphone arrays: acoustic beamforming to localize a speaker in a room and to remove noise is more accurate if aided by visual information from the face tracker[59] Second, gaze information has been used for selection and manipulation of objects, equivalent to mouse click and dragging operations [115, 154, 335]. Third, eye fixations have been used to resolve object references, e.g. in multimodal interactions with a map [171] ffl Combining Speech Input with Speech Synthesis or Face Synthesis: Speech input has been combined with speech synthesis in two domains: first, a multitude of so called dialogue ....

....to recognition and tracking of faces and other facial features either as necessary first step for lipreading and speechreading systems (which will be reported later on in this chapter in Section 4. 4) or as additional input modality, for example, for eye movement based human computer interaction [154]. This section first provides a cursory review of face recognition and tracking (based mainly on material from [273, 276] then of recognition and tracking of other facial features, in particular lips and gaze. Samal [276] identified five basic problems in face recognition: representation of ....

R.J.K. Jacob. Eye-movement based human-computer interaction techniques: Toward non-command interfaces. In H.R. Hartson and D. Hix, editors, Advances in Human-Computer Interaction, volume 4, pages 151--189. Ablex Publishing, 1993.

.... Mikaelian, 1987; LC Technologies, 1993; James E. Chapman, 1991; Gips, Olivieri, Tecce, 1993; Smyth et al. 1994) but it can also be processed further, using the knowledge of the connection between eye gaze and interest described in section 3. 4 on page 19 (Starker Bolt, 1990; Nielsen, 1993; Jacob, 1993, 1995) The main reason for the great success of the mouse as a pointing device combined with direct manipulation interfaces is the fact that it is based on human abilities. Through thousands of years man has developed the skill of grabbing and moving objects with his hands and working on them, ....

....manipulate anything in the display; the eye gaze equipment cannot distinguish when you are performing intentional manipulatory looking (cf. page 21) solely on the basis of the gaze pattern. Thus, there is a need for some sort of iclutchj to engage and disengage the intentional manipulatory looking (Jacob, 1993, p. 164) 3. The human eye gaze pattern is not calm and controlled like the movement of the mouse (Yarbus, 1967) The eyes dart rapidly from spot to spot, and keeping your eyes xed on a speci c point is unnatural and can perhaps be a strain. 4. It can be diOEcult to point at a blank area of the ....

[Article contains additional citation context not shown here]

Jacob, R. J. K. (1993). Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. In Hartson, H. R., & Hix, D.

....attribute of a person in laboratory studies. As such devices become more robust, they may be used as practical medical instruments outside the laboratory. As they become convenient, non invasive, and inexpensive, they may find use as future computer input devices. The eye tracker is such an example[3]; other physiological monitoring devices may also follow this progression. It is also interesting to note that, with the current state of the art, computer input and output are somewhat asymmetric. The bandwidth from computer to user is typically far greater than that from user to computer. ....

R.J.K. Jacob, "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces," in Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood, N.J., 1993. http://www.eecs.tufts.edu/jacob/papers/hartson.txt [ASCII]; http://www.eecs.tufts.edu/jacob/papers/hartson.ps [Postscript].

....measure some physical attribute of a person. As such devices become more robust, they may be used as practical medical instruments outside the laboratory. As they become convenient, non invasive, and inexpensive, they may find use as future computer input devices. The eye tracker is such an example[11]; the physiological monitoring devices discussed may well also turn out to follow this progression. In each of these cases, from relatively mundane use of context, behavior and simple passive measurement to notions that sound like science fiction, all of these lightweight or passive interface ....

R.J.K. Jacob, "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces," in Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood, N.J., 1993. http://www.eecs.tufts.edu/~jacob/papers/hartson.txt [ASCII]; http://www.eecs.tufts.edu/~jacob/papers/hartson.ps

No context found.

JACOB, R. J. K. 1993c. Eye movement-based human-computer interaction techniques: Toward non-command interfaces. In Advances in Human-Computer Interaction, Vol. 4, ed. H. R. Hartson and D. Hix, Ablex Publishing Co., Norwood, N.J., 151-190.

....finely tuned computer architecture that recognizes meaningful eye gazes in real time, and appropriate interaction techniques that are convenient to use. In previous research, we developed a basic testbed system configured with a commercial eye tracker to investigate interfaces operated by eye gaze [9, 10, 11, 12, 13, 14]. We designed a number of interaction techniques and tested them through informal trial and error evaluation. We learned that people prefer techniques that use natural not deliberate eye movements. Observers found our demonstration eye gaze interface fast, easy, and intuitive. In fact, when our ....

....interaction object associated with it that translates fixations into the higher unit of gazes. This approach is more than an efficiency. It reflects that the eye does not remain still but changes the point of fixation around the area of interest. Further details on the software are found in [13]. STUDY OF EYE GAZE VERSUS MOUSE SELECTION In developing our demonstration system, we have been struck by how fast and effortless selecting with the eye can be. We developed the interaction techniques and software system after much studying, tinkering, and informal testing. The next step was to ....

Jacob, R. J. K. Eye movement-based human-computer interaction techniques: Toward non-command interfaces. In Advances in Human-Computer Interaction, Vol. 4, ed. H. R. Hartson and D. Hix, Ablex Publishing Co. (1993), Norwood, N.J., 151-190.

No context found.

JACOB, R. J. K. 1993c. Eye movement-based human-computer interaction techniques: Toward non-command interfaces. In Advances in Human-Computer Interaction, Vol. 4, ed. H. R. Hartson and D. Hix, Ablex Publishing Co., Norwood, N.J., 151-190.

No context found.

Jacob,.R.J.K. Jacob, "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces," in Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood, N.J., 1993.

No context found.

Jacob, R. J. Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. 151--190.

No context found.

Robert J.K. Jacob. "EyeMovement-BasedHuman-Computer Interaction Techniques: Toward Non-Command Interfaces". Human-Computer Interaction Lab. Naval Research

No context found.

Jacob, R.K. "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces", In Advances in Human-Computer Interaction, pp. 150-190, Vol. 4, 1993.

No context found.

R.J.K. Jacob, "Eye movement-based human-computer interaction techniques: toward non-command interfaces", Advances in Human-Computer Interaction, Vol. 4, Ablex Publishing Co., Norwood, N.J., 1993. Three-dimensional PC: toward novel forms of human-computer interaction, in Three-Dimensional Video and Display: Devices and Systems SPIE CR76 30

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC