Not Logged In

Rethinking the Pipeline as Object-Oriented States with Transformations

Full Text: hips04.pdf PDF

The pipeline is a simple and intuitive structure to speed up many problems. Novice parallel programmers are usually taught this structure early on. However, expert parallel programmers typically eschew using the pipeline in coarse–grained applications because it has three serious problems that make it difficult to implement efficiently. First, processors are idle when the pipeline is not full. Second, load balancing is crucial to obtaining good speedup. Third, it is difficult to incrementally incorporate more processors into an existing pipeline. Instead, experts recast the problem as a master/slave structure which does not suffer from these problems. This paper details a transformation that allows programs written in a pipeline style to execute using the master/slave structure. Parallel programmers can benefit from both the intuitive simplicity of the pipeline and the efficient execution of a master/slave structure. This is demonstrated by performance results from two applications.

Citation

S. MacDonald, D. Szafron, J. Schaeffer. "Rethinking the Pipeline as Object-Oriented States with Transformations". High-Level Parallel Programming Models and Supportive Environments, pp 12-21, January 2004.

Keywords:  
Category: In Workshop

BibTeX

@misc{MacDonald+al:High-LevelParallelProgrammingModelsandSupportiveEnvironments04,
  author = {Steve MacDonald and Duane Szafron and Jonathan Schaeffer},
  title = {Rethinking the Pipeline as Object-Oriented States with
    Transformations},
  Pages = {12-21},
  booktitle = {High-Level Parallel Programming Models and Supportive
    Environments},
  year = 2004,
}

Last Updated: December 04, 2006
Submitted by Valerie Dacyk

University of Alberta Logo AICML Logo