M. Nick, K.-D. Althoff, and C. Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, Oct. 1999.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....starting point for dealing with the maintenance problem is to integrate EB evaluation and maintenance within one framework. Using goal oriented measurement, in our case the GoalQuestion Metric technique, EBs like other knowledge and or case bases can be evaluated with respect to the defined goals [27]. Based on such an analysis, constructive maintenance techniques can be selected and or developed, for instance, to adaptagivenEBwith respecttonewincomingand orchanging experiences. The paper is structured as follows. Section 2 introduces the contextforourchallengeproblem MaintenanceofExperience ....

....of an EB has the goal of preserving and or improving its value. Toexamine if this goal is reached, wemust find out the value of the EB. To determine the value, we need the evaluation especially from theviewpointof its stakeholders.In[28] it wasshownhow to evaluate an EB systematically. [27] showed how evaluation criteria and metrics (can) change over time. To preserve and or improve its value, we have to do maintenance, that is, populating and improving the EB (i.e. conduct task record , etc. aswellas improving, refining, andadapting initial build up of experience base design ....

[Article contains additional citation context not shown here]

Markus Nick, Klaus-Dieter Althoff, and Carsten Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, October 1999.

No context found.

M. Nick, K.-D. Althoff, and C. Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, Oct. 1999.

....resulting in 77 observations and 57 guidelines on project management. 34 business process descriptions (of approx. 100 planned) were included. Evaluation and User Feedback The acceptance and usage of such a system is crucial because if the EB is not accepted and used, it cannot yield any benefit [10]. q Set up an evaluation program on usage and perceived usefulness In the beginning, an evaluation program should provide quick feedback about the acceptance of the EB. This can be measured through usage and perceived usefulness [11, 13] Examples: For the business process descriptions in ....

....in a query result on a scale of useful , not useful , don t know. q Set up user feedback channels For details, the reader is referred to [3] Example: For the business process descriptions in COIN, we first used a feedback button because a similar feature was very useful in CBR PEB [10]. But this was only scarcely used. IESE members preferred to give feedback directly by phone or eye to eye. Therefore, we now try to get additional feedback in the project analyses by asking questions about the usage and applicability of the respective business processes. Prepare Maintenance q ....

[Article contains additional citation context not shown here]

M. Nick, K.-D. Althoff, and C. Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, Oct. 1999.

....decisions. Source and focus of the evaluation determine, which methods can be applied (i.e. plugged in ) For evaluation focused on value and quality, goal oriented measurement with the Goal Question Metric (GQM) technique is a suitable method, which has been applied successfully to EBs [10]. GQM is actually a framework itself, that is, it provides the organizational context and management of an evaluation program to facilitate evaluation. Stakeholders can be involved in the definition of the evaluation program based on the business needs goals for the EB (i.e. the objectives and ....

.... never ending iteration of GQMwith refinements and roll outs as well as collecting and improving quality models etc. leads to a learning spiral: We learn more and more about evaluation and, thus, improve the evaluation itself. For more in depth information on GQM for EBs, please, have a look at [10]. User feedback is another source for identifying improvement needs. A part of the Organizational Memory Improvement (OMI) method [2] describes when we can get which kind of feedback from the users during a search for, retrieval, and usage of artifacts from of an organizational memory or EB, ....

M. Nick, K.-D. Althoff, and C. Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, Oct. 1999.

.... experience feedback when the same knowledge artifact is retrieved in subsequent consultations (continuous feedback and update) It also serves as a basis for knowledge evaluation and modification, and continuous improvement (see feedback loop depicted at the bottom of the diagram in Figure 6) [18]. There are three different ways in which new knowledge artifacts could be created within the architecture: Lessons learned: On the basis of the knowledge access, application, and annotation patterns, the knowledge evaluation and modification and the continuous feedback and update processes ....

.... On the basis of the knowledge access, application, and annotation patterns, the knowledge evaluation and modification and the continuous feedback and update processes provide facilities to evaluate and subsequently update (modify remove existing or add new) knowledge artifacts to the repository [18]. Knowledge acquisition: Based on established knowledge acquisition, validation, and verification techniques, new knowledge artifacts are elicited from subject matter experts (Domain Experts) and added to the repository. Data mining: Sophisticated data warehousing and data mining ....

[Article contains additional citation context not shown here]

Nick, M., Althoff. K.-D. & Tautz, C. (1999). Facilitating the Practical Evaluation of Organizational Memories Using the Goal-Question-Metric Technique. Accepted for the Twelfth Workshop on Knowledge Acquisition, Modeling and Management (KAW'99), Banff, Oct. 16-21

.... and general information) 12] Using this prototype we learned through goal oriented measurement and usage trials that the quality of the artifacts and the accuracy of their characterizations are essential with respect to the perceived usefulness of the experience provided by the retrieval system [38]. This means that any artifact stored must exhibit a minimal quality (to be defined by the user) and be associated with a complete, correct, and up to date characterization [4] The second prototype, called KM PEB 5 (Knowledge Management Product Experi3 URL: ....

Markus Nick, Klaus-Dieter Althoff, and Carsten Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, October 1999.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC