Results 1 -
8 of
8
Applying System Execution Modeling Tools to Evaluate Enterprise Distributed Real-time and Embedded System QoS
- In Proceedings of the 12th International Conference on Embedded and Real-Time Computing Systems and Applications
, 2006
"... Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new integra-tion problems associated with ..."
Abstract
-
Cited by 32 (22 self)
- Add to MetaCart
(Show Context)
Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new integra-tion problems associated with component configuration and deployment. New research is therefore needed to minimize the gap between the development and deploy-ment/configuration of components, so that deployment and configuration strategies can be evaluated well be-fore system integration. This paper uses an industrial case study from the domain of shipboard computing to show how system execution modeling tools can provide software and system engineers with quantitative esti-mates of system bottlenecks and performance character-istics to help evaluate the performance of component-based enterprise DRE systems and reduce time/effort in the integration phase. The results from our case study show the benefits of system execution modeling tools and pinpoint where more work is needed. 1.
CiCUTS: Combining System Execution Modeling Tools with Continuous Integration Environments
- In Proceedings of the 15th Annual IEEE International Conference and Workshops on the Engineering of Computer Based Systems (ECBS
, 2008
"... System execution modeling (SEM) tools provide an effec-tive means to evaluate the quality of service (QoS) of enter-prise distributed real-time and embedded (DRE) systems. SEM tools facilitate testing and resolving performance is-sues throughout the entire development life-cycle, rather than waiting ..."
Abstract
-
Cited by 8 (4 self)
- Add to MetaCart
(Show Context)
System execution modeling (SEM) tools provide an effec-tive means to evaluate the quality of service (QoS) of enter-prise distributed real-time and embedded (DRE) systems. SEM tools facilitate testing and resolving performance is-sues throughout the entire development life-cycle, rather than waiting until final system integration. SEM tools have not historically focused on effective testing. New techniques are therefore needed to help bridge the gap between the early integration capabilities of SEM tools and testing so developers can focus on resolving strategic integration and performance issues, as opposed to wrestling with tedious and error-prone low-level testing concerns. This paper provides two contributions to research on us-ing SEM tools to address enterprise DRE system integration challenges. First, we evaluate several approaches for com-bining continuous integration environments with SEM tools and describe CiCUTS, which combines the CUTS SEM tool with the CruiseControl.NET continuous integration envi-ronment. Second, we present a case study that shows how CiCUTS helps reduce the time and effort required to man-age and execute integration tests that evaluate QoS met-rics for a representative DRE system from the domain of shipboard computing. The results of our case study show that CiCUTS helps developers and testers ensure the per-formance of an example enterprise DRE system is within its QoS specifications throughout development, instead of waiting until system integration time to evaluate QoS. 1
Unit Testing Non-functional Concerns of Component-based Distributed Systems
"... Unit testing component-based distributed systems traditionally involved testing functional concerns of the application logic throughout the development lifecycle. In contrast, testing non-functional distributed system concerns (e.g., end-to-end response time, security, and reliability) typically has ..."
Abstract
-
Cited by 5 (3 self)
- Add to MetaCart
(Show Context)
Unit testing component-based distributed systems traditionally involved testing functional concerns of the application logic throughout the development lifecycle. In contrast, testing non-functional distributed system concerns (e.g., end-to-end response time, security, and reliability) typically has not occurred until system integration because it requires both a complete system to perform such tests and sophisticated techniques to identify and analyze performance metrics that constitute non-functional concerns. Moreover, in a agile development environment, unit testing non-functional concerns is even harder due to the disconnect between high-level system specification and low-level performance metrics. This paper provides three contributions to research on testing techniques for component-based distributed systems, which is manifested in a technique called Understanding Non-functional Intentions via Testing and Experimentation (UNITE). First, we show how UNITE allows developers to extract arbitrary metrics from log messages using highlevel constructs, such as a human readable expressions that identify variable data. Second, we show how UNITE preserves data integrity and system traces without requiring a globally unique identifier for context identification. Third, we show how developers can formulate equations that represent unit tests of non-functional concerns and then use UNITE to evaluate the equation using metrics extracted from the log messages. The results from applying UNITE to a representative project show that we can unit test nonfunctional properties of a component-based distributed system during the early stages of system development. 1
Evaluating Enterprise Distributed Real-time and Embedded System Quality of Service with System Execution Modeling
- Tools,” Proceedings of the 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications
, 2006
"... Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new system integration problems associate ..."
Abstract
-
Cited by 3 (3 self)
- Add to MetaCart
(Show Context)
Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new system integration problems associated with component configuration and deployment. New research is therefore needed to minimize the gap between the development and deployment/configuration of components, such that deployment and configuration strategies can be evaluated well before system integration. This paper uses an industrial case study from the domain of shipboard computing to show how system execution modeling tools can provide software and system engineers with quantitative estimates of system bottlenecks and performance characteristics to help evaluate quality of service of component-based enterprise DRE systems and reduce time/effort in the integration phase. The results from our case study experiments show the benefits of system execution modeling tools and pinpoint where more work is needed. 1.
Evaluating Quality of Service for Enterprise Distributed Real-time and Embedded Systems
"... This chapter introduces the next generation of system execution modeling tools designed around model-driven engineering (MDE) coupled with domain-specific modeling languages (DSMLs). The authors discuss key design issues involved with implementing a next genera-tion SEM tool and show how they can be ..."
Abstract
-
Cited by 2 (1 self)
- Add to MetaCart
This chapter introduces the next generation of system execution modeling tools designed around model-driven engineering (MDE) coupled with domain-specific modeling languages (DSMLs). The authors discuss key design issues involved with implementing a next genera-tion SEM tool and show how they can be applied to developing service-oriented architecture (SOA)-based applications. Finally, the authors use a real-life case study to illustrate how next generation system execution modeling tools can help understand quality-of-service (QoS) issues earlier in the development lifecycle (i.e., during design-time) instead of waiting until complete system integration.
Abstract
"... Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new integration problems associated with ..."
Abstract
- Add to MetaCart
(Show Context)
Component middleware is popular for enterprise distributed systems because it provides effective reuse of the core intellectual property (i.e., the “business logic”). Component-based enterprise distributed real-time and embedded (DRE) systems, however, incur new integration problems associated with component configuration and deployment. New research is therefore needed to minimize the gap between the development and deployment/configuration of components, so that deployment and configuration strategies can be evaluated well before system integration. This paper uses an industrial case study from the domain of shipboard computing to show how system execution modeling tools can provide software and system engineers with quantitative estimates of system bottlenecks and performance characteristics to help evaluate the performance of componentbased enterprise DRE systems and reduce time/effort in the integration phase. The results from our case study show the benefits of system execution modeling tools and pinpoint where more work is needed. 1.
Integration Challenges of SOA-based Enterprise DRE Systems
"... This chapter introduces the next generation of system execution modeling tools designed around model-driven engineering (MDE) coupled with domain-specific modeling languages (DSMLs). The authors discuss key design issues involved with implementing a next generation SEM tool and show how they can be ..."
Abstract
- Add to MetaCart
This chapter introduces the next generation of system execution modeling tools designed around model-driven engineering (MDE) coupled with domain-specific modeling languages (DSMLs). The authors discuss key design issues involved with implementing a next generation SEM tool and show how they can be applied to developing service-oriented architecture (SOA)-based applications. Finally, the authors use a real-life case study to illustrate how next generation system execution modeling tools can help understand quality-of-service (QoS) issues earlier in the development lifecycle (i.e., during design-time) instead of waiting until complete system integration.
Using Dataflow Models to Evaluate Enterprise Distributed Real-time and Embedded System Quality-of-Service
"... The effort required to evaluate enterprise distribute real-time and embedded (DRE) system qualityof-service (QoS) attributes (such as response-time, latency, and scalability) depends heavily on system complexity and size. As these systems increase in complexity and size, therefore, DRE system develo ..."
Abstract
- Add to MetaCart
(Show Context)
The effort required to evaluate enterprise distribute real-time and embedded (DRE) system qualityof-service (QoS) attributes (such as response-time, latency, and scalability) depends heavily on system complexity and size. As these systems increase in complexity and size, therefore, DRE system developers and testers need improved methods and tools that facilitate QoS evaluation. This article describes a method and tool called Understanding Non-functional Intentions via Testing and Experimentation (UNITE) that evaluates enterprise DRE system QoS attributes using dataflow models to capture how data move through an enterprise DRE system. Empirical results show that although UNITE’s evaluation times depend on the size of the dataflow model, they depend even more on the size of the dataset processed by the dataflow model. Copyright c ○ 2009 John Wiley & Sons, Ltd. Received X August 2009 KEY WORDS: enterprise DRE systems; dataflow models; quality-of-service evaluation; early system integration testing; system execution traces; relational database theory 1.
