Maybury, M. T. 1991. Planning multimedia explanations using communicative acts. In Proceedings of the Ninth National ConferenceonArti#cial Intelligence, 61#66.  Home/Search   Document Not in Database   Summary   Related Articles   Check

....distinction for centering theory are discussed in [Grosz et a1.1983] lAppelt and Kronfeld1987] provides a formal theory that derives the effects of referring actions. Previous . integrated text and graphi c generation systems, e.g. Fasciano and Lapaline1996, Feiner and McKeown1 991, Maybury1991, Wahlster et al. 1993] have not attempted to perform task based design of graphics as in our. approach. Previous work .on natural language reference in .multimedia generation. Andre and Rist1994, McKeown et al. 1992] has focused on coordination of pictoria and textual references.to concrete ....

Mark T. Maybury. 1991. Planning multimedia explanations using communicative acts. In .Proceedings of the Ninth National Conference on Artificial Intelligence pages 61-66, July.

....system only allows simple query answer cycles. The concepts of speech acts in combination with RST are used in several multimedia presentation systems. Among the first systems following this approach were the WIP system developed at DFKI (see Andr6 and Rist (1993) and the system developed by Maybury (1991). However, neither the WIP project nor Maybury s system use highlevel dialogue structures. As pointed out in Arens et al. 1993) global structures are necessary for establish ing overall coherence in the context of multimedia inter faces. COR tL.qT takes this into account. It focuses on Natural ....

Mark T. Maybury. Planning Multimedia Expla- nations Using Communicative Acts. InProc. of the 9th National Conference on Artificial Intelligence [AAAI'9$). pages 61-66, AAAI Press/MIT Press, Anaheim, California, 1991

....7o, P ( o ) Figure 1: A model for the Request Communicative Act media. The specification by means of rules will make future modifications easier. The second mode of merging concerns the dialogue acts labelled as requests. It is based on a representation of CA as plan operators [5, 15, 16, 21]. Dialogue acts as well as the tactile acts are considered as low level plan operatom. Whilst merging, we solve tactile and linguistic co references [3, 8] For example, Figure 1 shows a model of the CA REQUEST for the completive mode where a tactile event and a dialogue act have to be merged. ....

Maybury M.T. Planning Multimedia Explanations Using Communicative Acts. Proceedings of the Ninth National Conference on Artificial [ulelligence, AAAI 91, Anaheim, CA, July, 14-19, 1991.

....about abstract objects and relations. This research led to their COMET system, which generates text and 3D graphics on the fly [Feiner and McKeown, 1998] Similarly, Maybury s TEXTPLAN generated multimedia explanations, tailoring these explanations based on the type of communicative act required [Maybury, 1998]. Similar to TEXTPLAN, Wahlster s WIP model stressed the idea that the various constituents of a multimodal presentation should be generated from a common representation of what is to be conveyed [Wahlster et al. 1993] This is an important point because it stresses the importance of correctly ....

Maybury, M. Planning Multimedia Explanations Using Communicative Acts. In Readings in Intelligent User Interfaces. Ed. M. Maybury and W. Wahlster. 1998. San Francisco: Morgan Kaufmann. pp. 99-106.

....7o, P ( o ) Figure 1: A model for the Request Communicative Act media. The specification by means of rules will make future modifications easier. The second mode of merging concerns the dialogue acts labelled as requests. It is based on a representation of CA as plan operators [5, 15, 16, 21]. Dialogue acts as well as the tactile acts are considered as low level plan operators. Whilst merging, we solve tactile and linguistic co references [3, 8] For example, Figure i shows a model of the CA REQUEST for the completive mode where a tactile event and a dialogue act have to be merged. ....

Maybury M.T. Planning Multimedia Explanations Using Communicative Acts. Proceedings of the Ninth National Conference on Artificial Intelligence, AAAI 91, Anaheim, CA, July, 14-19, 1991.

....in conveying information about ab stract objects and relations. This research led to their COMET system generates text and 3D graphics on the fly [8] Similarly, Maybury s TEXTPLAN generates multimedia explanations, tailoring these explanations based on the type of communicative act required [15]. Taking these principles to the next level means replacing graphical representations with the physical objects themselves. To do so involves immersing the interface in a shared reality, as a kiosk, and using an ECA to reference objects in the real world using natural language and gesture. 2.2 ....

M. Maybury, "Planning Multimedia Explanations Using Communicative Acts," in Readings in Intelligent User Interfaces, M. Maybury and W. Wahlster, Eds. San Francisco: Morgan Kaufman, 1998, pp. 99-106.

....areas have formalised human machine interaction as a set of communicative acts (CAs) and rules for monitoring these acts in order to achieve communicative goals. For example, Baker [1] defines the main negotiative CA and presents a model of negotiation in teaching learning dialogues. Maybury [10] describes a plan based communicative act approach for generating multimedia explanations. In STyLE OLM the communicative acts are the minimal units of interaction. We consider a communication language based on a graphical representation of conceptual graphs that allows the system and the learner ....

....learning environment. Some of the problems it indicated were taken into account in the design of the CGs communication language. STyLE OLM provides a multimodal communication environment combining graphics, text, and some interface widgets such as menus and buttons. Following Maybury s taxonomy [10] we distinguish between graphical and linguistic acts in a multimodal communication. The former concern manipulating in a graphical medium (pointing, adding, moving, deleting, etc. and the latter are the main dialogue moves and relate to speech acts in linguistic communication [14] The dialogue ....

M. Maybury, Planning Multimedia Explanations Using Communicative Acts, In: M. Maybury (ed.) Intelligent Multimedia Interfaces, AAAI Press / The MIT Press, California, 1993.

.... arguments in italics) ffl describe (process ROM) ffl (persuade Speaker Hearer (GOAL Hearer Eventually (Done Hearer replace setqwith setf) Moore 89] ffl (believe hearer (already done action1) ffl how it works (warning device) Cawsey 89] ffl Identify (System User # Karl Marx Stadt ) Maybury 91] ffl Account (Storage capacitor 1 charge 5) Suthers 91] 3 Problems with the classical operators representation This way of planning the content of an explanation is very attractive, mainly because it allows the explanation to be constructed dynamically. In that way, contextual information can ....

Maybury M. T., "Planning multimedia explanations using communicative acts", in Proceedings of the 9th AAAI Conference, Anaheim, USA, July 1991, p. 61--66.

....language generators. To 3 Application Sample Systems report generation MAGIC [23] PostGraphe [29] SAGE [43] RoCCo [6] technical documentation COMET [30] IDAS [60] PPP [10] Visual Repair [31] and WIP [5] route directions MOSES [48] mission planning and situation monitoring AIMI [51], CUBRICON [57] FLUIDS [36] project management EDWARD [17] IGING [26] business forms XTRA [3] configuration of computer networks MMI 2 [70] education and training PEA [54] MAGPIE [34] Herman the Bug [66] COSMO [45] Steve [62] information kiosks ALFRESCO [65] ILEX [44] PEBA II ....

....(cf. 53] which enable more local revisions by explicitly representing the effects of each section of the presentation. In the last few years, extensions of operator based approaches have become increasingly popular for the generation of multimedia presentations, too. Examples include AIMI [51], FLUIDS [36] MAGIC [23] MAGPIE [34] PPP [9] WIP [5] and a recent extension of SAGE [43] The main idea behind these systems is to generalize communicative acts to multimedia acts and to formalize them as operators of a planning system. The effect of a planning operator refers to a complex ....

[Article contains additional citation context not shown here]

M. T. Maybury. Planning Multimedia Explanations Using Communicative Acts. In Proc. of AAAI-91, pages 61--66, Anaheim, CA, 1991.

.... none given Link next prev buttons central node consistent links hiding page index Content icons and labels for link starting points consistent fields pruning Since a hypermedia presentation is a form of communication, it can be broken down into a collection of communicative acts [12]. Furthermore, communicative devices exist that can be used in hypermedia presentations for conveying rhetoric. Understanding these hypermedia communicative devices is useful not just for analysis but also the synthesis of hypermedia presentations. This section describes some hypermedia ....

....established for comic strips [7] 13] but this media has received comparatively little attention. Research has been done, however, on the use of comic strip presentation devices for other aspects of multimedia, such as spatial layout [19] Communicative devices have been established for hypermedia [12], as have rhetoric based guidelines for human authors of hypermedia [10] Hypermedia, and in particular synthesized hypermedia, is distinguished from the other media by the following characteristics: Interaction . Adaptivity . Temporal and Spatial Structure The hypertext community has ....

[Article contains additional citation context not shown here]

Maybury, M.T. "Planning Multimedia Explanations Using Communicative Acts", in Intelligent Multimedia Interfaces (ed. Maybury, M.T.), AAAI Press / The MIT Press, 1993, pp. 60-74.

....coordination and layout of information in a multi media presentation has recently received greater attention. The majority of notable approaches employ theoretical frameworks of human communication to structure multi media presentations. Examples include the use of communicative acts by Maybury [May91] and the speech theoretic approach taken by the WIP system, of Rist et al. [RA93] WIP considers the generation of a multi media document as an act sequence which aims to achieve certain goals. Recently Graf [Gra95] has proposed a framework for WIP speci cally to address multi media layout. This ....

M T Maybury. Planning multimedia explanations using communicative acts. In Proceedings AAAI'91, pages 61-66, 1991.

....between realizing some piece of information via, for example, natural language or a map, the issues we have discussed should arise. Computational methods for synthesising multimodal presentations have been investigated by Feiner and McKeown (1990) Marks and Reiter (1990) Badler et al. 1991) Maybury (1991), Roth et al. 1991) and Wahlster et al. 1991) issues concerning declarative knowledge about presentation modalities have been investigated by Arens and Hovy (1990) and Hovy and Arens (1991) In this area, is acknowledged that the actual task which the information s end user is supposed to be ....

Maybury, M. (1991). Planning Multimedia Explanations Using Communicative Acts. In Proceedings of the Ninth National Conference on Artificial Intelligence, Anaheim, Ca., July 14--19, 1991, pp61--66.

.... automatic document generation is usually performed through a multistep, pipeline process that starts from a complex communicative goal, to establish: the information to be transmitted in the message and the media with which each information item has to be transmitted (discourse planning) [14, 24, 23, 1, 9]; the way that the overall plan has to be revised and refined so as to avoid repetitions, add empathy to discourse or refine the style (sentence planning) 20, 31] and, finally the way that every information item may be rendered by the specific media envisaged for it: for instance, ....

M. Maybury. Planning multimedia explanations using communicative acts. In M. Maybury, editor, Intelligent Multimedia Interfaces. Cambridge AAAI Press, 1993.

.... information depending on their needs [Bareiss et al. 1993] To make information presentation in a hypermedia environment effective and its management efficient, it is necessary that text, graphics, and images are properly coordinated [Hekmatpour 1995] Some researchers, e.g. Feiner et al. 1991] [Maybury 1991] have investigated the automatic generation of coordinated multimedia; Carver et al. 1996] for instance have proposed (and implemented) a system for generating personalized hypermedia course presentations depending on the student s learning style, rather than based on the student s ....

Maybury, M.T. (1991). Planning Multimedia Explanation Using Communicative Acts. Proceedings of AAAI-91, pp. 61--66.

....For instance, as shown in Figure 4, SET KEY LTERM is a Linguistic Term (LTERM) with role:identifies and scope: naming. The SET KEY POS item is a POSITION INDICATOR with role:indicates and scope:position. Information categories, such as LTERM and POSITION INDICATOR, correspond to rhetorical acts [Mayb93][Andre93] The intentions of presenting items that belong in these categories are identical to the intentions of the corresponding acts. Information categories suitable for technical documentation have been identified in [Vou99a] These correspond to Rhetorical Structure Theory relations ....

M.T.Maybury, "Planning Multimedia Explanations Using Communicative Acts", in Intelligent Multy Media Interfaces, M.Maybury (Ed.), 1993.

....a series of similar projects aimed at conceptualizing the design principles of multimedia presentations in a domain independent way. Among the applications previously addressed are instructions for operating physical devices [7, 18] explanations of quantitative models [14] route directions [10], and weather reports [9] The system we are developing is intended to aid users in identifying important information that is contained in large data sets. Our system has neither complete knowledge of the domain, nor complete knowledge of what it is the user needs to know in order to solve the ....

....to their principles, effective multimedia presentation requires models of the following elements: the media; the information to be displayed; the application task and interlocutors goals; the discourse and communicative context; and users goals, interests, and abilities. Like the work of others [7,10,18], these principles ignore the task level, which we find important. Moreover, the application of these principles is not straightforward and requires additional research to specify them at a level where they can be used in real systems. The PostGraphe system of Fasciano and Lapalme [6] generates ....

Maybury, M. T. Planning Multimedia Explanations Using Communicative Acts. In Proc. AAAI-91, July 1991, 6166.

....Their systems search for simple graphical techniques that transform primitives from complex cognitive operations to simple perceptual ones. Zhou and Feiner [14] used a different flavor of visual tasks, which abstract graphical techniques, rather than the exploratory behavior of the user. Maybury [8] does realize some communicative goals in maps, but does not consider using the wide variety and complexity of graphics we are interested in. The limited set of graphical presentations in effect eliminates the need for automated design, making it possible to map communicative goals directly to ....

Maybury, M. T. 1991. Planning Multimedia Explanations Using Communicative Acts. In Proc. AAAI-91, 61-66.

....media communication acts. These are communication acts enriched by semantic logic content, media selection and relations between acts. Communication acts are an extension of speech acts [25] to multimedia communications. For a gross classification of communication acts we refer the reader to [19]. Knowledge server Layout Layer Control layer Media Planning Selection Selection Content Coordination Figure 4: The Content Layer 16 4. LAYERS Content Layer starting from a goal passed by the control layer, the content layer generates media communication acts as an input to the layout layer. The ....

M. T. Maybury. Planning Multimedia Explanations Using Communcative Acts. In M. T. Maybury, editor, Intelligent Multimedia Interfaces, chapter 2. AAAI/The Mit Press, 1993.

....also have knowledge about appropriate discourse cues in order to produce natural sounding language at that future time. This brief example illustrates that content planning for dialog is a complex task involving many different factors. Existing generation systems that perform content planning ([38, 9, 46]) contain models of intentional and rhetorical structure. They use a hierarchical, partial order planner based on [56] They plan multi sentence texts or multi modal presentations. These systems do not model turn taking or grounding behaviors. They are fixed initiative systems. They do not model ....

....and solved in order (so PEA also does not allow for alternative orderings) Optional satellites are only expanded if the system is in verbose mode and they do not duplicate information in the user model. Other systems that model both intentional and rhetorical information include TEXPLAN [38] and EDGE [9] Issues Schemata can be thought of as the result of compiling the planning process [45] Schemata are used to generate text efficiently within specific domains and for specific input types. However, it is not possible to reason directly about the functions of and relationships ....

M. Maybury. Planning multimedia explanations using communicative acts. In M. Maybury, editor, Intelligent Multimedia Interfaces, pages 59--74. MIT Press, Menlo Park, CA, 1993.

.... user [Thies94, Wittburg94] Coordinating text, graphics, and images in a hypermedia environment is very important in effective presentation and management of the subject matter [Feiner90, Augenstein93, Hekmat94] Some researchers have investigated the automatic generation of coordinated multimedia [Feiner91, Maybury91]. Others have studied controlling and managing the different elements composing a 2 Hekmatpour 5 30 95 E 16 multimedia document [Merlet93, Hekmat94] And still others have proposed architectures for adaptive online systems [Kaplan90, Peralta92, Boyle93] Such studies have proved necessary due ....

Maybury M. T., "Planning Multimedia Explanation Using Communicative Acts," Proc. of AAAI--91, pp.61--66.

....distinction for centering theory are discussed in [Grosz et al..1983] Appelt and Kronfeld1987] provides a formal theory that derives the effects of referring actions. Previous integrated text and graphic generation systems, e.g. Fasciano and Lapalme1996, Feiner and McKeown1991, Maybury1991, Wahlster et al..1993] have not attempted to perform taskbased design of graphics as in our approach. Previous work on natural language reference in multimedia generation [Andre and Rist1994, McKeown et al..1992] has focused on coordination of pictorial and textual references to concrete objects ....

Mark T. Maybury. 1991. Planning multimedia explanations using communicative acts. In Proceedings of the Ninth National Conference on Artificial Intelligence, pages 61--66, July.

....with the Application Expert. The output of Goal Refinement and Content Selection is a set of communicative acts and a structural description of the relations that may hold between these acts. Communicative acts are an extension of speech acts [27] to multimedia communications (see also [1,21]) Knowledge Server Design Layer Control Layer Media Goal Selection Allocation Content Ordering Refinement Fig. 5. Content Layer As soon as the communicative acts have been determined, the Media Allocation component decides which modalities and media should be used to convey them. ....

M. T. Maybury. Planning Multimedia Explanations Using Communcative Acts. In Maybury [20], pages 60--74.

No context found.

Maybury, M. T. 1991. Planning multimedia explanations using communicative acts. In Proceedings of the Ninth National ConferenceonArti#cial Intelligence, 61#66.

No context found.

M. T. Maybury. Planning multi-media explanations using communicative acts. In Proceedings of the 9th National Conference on Artificial Intelligence, Anaheim, CA, pages 61--66, 1991.

No context found.

Mark T. Maybury. Planning multimedia explanations using communicative acts. In AAAI-91

First 50 documents

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC