Components in the Pipeline

Scientists commonly describe their data-processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply steps to transform the data and create useful results. Although conceptually simple, pipelines often adopt complex topologies and must meet stringent quality-of-service requirements that stress the software infrastructure used to construct the pipeline. The Middleware for Data-Intensive Computing (MeDICi) Integration Framework (MIF) is a component-based framework for constructing complex software pipelines. It supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling the quality of service to meet demanding performance, reliability, and communication requirements.