Citation Context

...tion, and two analysts spent more than five months compiling and analyzing the data. These experiences are similar to other field-based methods, which are often costly to implement and analyze, e.g., =-=[12,14]-=-. However, these approaches provide an understanding of users in their own environments and provide clues about critical aspects of the real work situation that can be used to increase the realism and...

Citation Context

...hniques are not used in the actual context of work, it is unclear whether the usability information they provide is valid for real users. Other studies have compared various evaluation methods, e.g., =-=[4,10]-=-. We wish to build on this work by determining how, and if, inspection methods complement field methods for evaluating group software. In particular, we want to determine what kind of usability proble...

Citation Context

...What I See) whiteboard backdrop. “Rooms” in TW provide boundaries for data groupings and user interactions, and provide a metaphor for easing the transitions between synchronous and asynchronous w=-=ork [7]-=-. Occupants organize data spatially within rooms by placing various tools, documents, and graphics on the whiteboard backdrop. Objects and data within the virtual space are persistent between sessions...

Citation Context

...a system is not fully developed. Recently, different types of groupware evaluation methods based on usability inspection techniques that do not utilize a real work situation have been proposed, e.g., =-=[1,6,9]-=-. These techniques are much less costly than field methods, and they can often be used earlier and more frequently in the development cycle. However, since these techniques are not used in the actual ...

Citation Context

...pware has received attention from researchers in the Computer-Supported Cooperative Work (CSCW) and groupware communities, e.g., [1,14,16]. However, evaluation is still considered a difficult problem =-=[8]-=-, and many researchers feel that the only way to get a true picture of a groupware system is to study it in an actual context with real users. Although field methods are able to Copyright 2001 Associa...

Citation Context

...echniques, usage evaluation techniques. INTRODUCTION Evaluation of groupware has received attention from researchers in the Computer-Supported Cooperative Work (CSCW) and groupware communities, e.g., =-=[1,14,16]-=-. However, evaluation is still considered a difficult problem [8], and many researchers feel that the only way to get a true picture of a groupware system is to study it in an actual context with real...

Citation Context

...hniques are not used in the actual context of work, it is unclear whether the usability information they provide is valid for real users. Other studies have compared various evaluation methods, e.g., =-=[4,10]-=-. We wish to build on this work by determining how, and if, inspection methods complement field methods for evaluating group software. In particular, we want to determine what kind of usability proble...

Citation Context

...vide an understanding of users in their own environments and provide clues about critical aspects of the real work situation that can be used to increase the realism and relevance of a usability test =-=[19]-=-. Our user-based study revealed how the welding team members worked together, their patterns of interaction, how meetings were conducted, and how they used the groupware tool to accomplish their work ...

Citation Context

...teboard, on which several tools and datasets have been placed. Participants can draw on the backdrop using drawing tools shown on the left. At the bottom left of the screen is a radar overview, e.g., =-=[17], -=-that shows the entire room and each person’s current viewport into the room. To the right of the radar screen is a chat window where messages can be typed to some or all of the occupants of the room...

Citation Context

...echniques, usage evaluation techniques. INTRODUCTION Evaluation of groupware has received attention from researchers in the Computer-Supported Cooperative Work (CSCW) and groupware communities, e.g., =-=[1,14,16]-=-. However, evaluation is still considered a difficult problem [8], and many researchers feel that the only way to get a true picture of a groupware system is to study it in an actual context with real...

Citation Context

...a system is not fully developed. Recently, different types of groupware evaluation methods based on usability inspection techniques that do not utilize a real work situation have been proposed, e.g., =-=[1,6,9]-=-. These techniques are much less costly than field methods, and they can often be used earlier and more frequently in the development cycle. However, since these techniques are not used in the actual ...

Citation Context

...f evaluators, using the mechanics of collaboration as evaluation criteria. Inspection is a widely-accepted, discount evaluation method used for diagnosing usability problems in user interfaces, e.g., =-=[5]-=-. In this technique, several evaluators examine an interface and judge its compliance with recognized usability principles. Problematic aspects of the interface are identified, as well as, their poten...

Citation Context

...echniques, usage evaluation techniques. INTRODUCTION Evaluation of groupware has received attention from researchers in the Computer-Supported Cooperative Work (CSCW) and groupware communities, e.g., =-=[1,14,16]-=-. However, evaluation is still considered a difficult problem [8], and many researchers feel that the only way to get a true picture of a groupware system is to study it in an actual context with real...

Citation Context

...nalysis. Survey data were examined using statistical analysis to determine trends in satisfaction across the group. The system data was explored using a log visualization tool called the CollabLogger =-=[11]-=- and statistical analysis. Additionally, the chat logs recorded by the system were analyzed to determine major topics of conversation and general communication pathways. Main Findings from the User-ba...

Citation Context

...rue—it appears that a list of usability problems is not a good predictor of a system’s success in a real work setting. This, of course, is what some CSCW researchers have been saying all along, e.=-=g., [13]-=-. Nevertheless, it is useful to take a closer look at why TW was acceptable overall, even though it had several usability problems. There are two main issues related to the work context. First, work p...

Citation Context

...equipment and interfaces can be plugged in and then tested during welding experiments. Analysis of completed welds is performed to verify effective operation of interfaces, equipment, and controllers =-=[15]-=-. Figure 1 shows the welding testbed, featuring the robotic arm with a welding torch and the fixturing table. Figure 1. The remote welding testbed used by the group. The research group consists of fiv...

Citation Context

...ination, interspersed with periods of asynchronous individual activity, and smaller coordination meetings of two or three team members. A more detailed description of the welding scenario is given in =-=[18]-=-. Prior to using the TW groupware system, collaboration in this group was carried out using ad hoc methods. Meetings were often conducted face-to-face, with support for remote team members through tel...

Citation Context

...find that just over half of the issues in one list have an equivalent issue in the other. In particular, both evaluations found that (1) chat-based communication was difficult to initiate and notice, =-=(2)-=- that it was difficult to keep track of who was currently in a room, (3) that the lack of project planning tools made asynchronous work more difficult, (4) that it was difficult to determine what had ...