Please use this identifier to cite or link to this item: http://hdl.handle.net/1822/42923

TitleTuning pipelined scientific data analyses for efficient multicore execution
Author(s)Pereira, André
Onofre, A.
Proença, Alberto José
KeywordsExecution Efficiency
High Throughput Computing
Pipeline
Scientific Analyses
Task Scheduling
Issue dateSep-2016
PublisherIEEE
Abstract(s)Scientific data analyses often apply a pipelined sequence of computational tasks to independent datasets. Each task in the pipeline captures and processes a dataset element, may be dependent on other tasks in the pipeline, may have a different computational complexity and may be filtered out from progressing in the pipeline. The goal of this work is to develop an efficient scheduler that automatically (i) manages a parallel data reading and an adequate data structure creation, (ii) adaptively defines the most efficient order of pipeline execution of the tasks, considering their inter-dependence and both the filtering out rate and the computational weight, and (iii) manages the parallel execution of the computational tasks in a multicore system, applied to the same or to different dataset elements. A real case study data analysis application from High Energy Physics (HEP) was used to validate the efficiency of this scheduler. Preliminary results show an impressive performance improvement of the pipeline tuning when compared to the original sequential HEP code (up to a 35x speedup in a dual 12-core system), and also show significant performance speedups over conventional parallelization approaches of this case study application (up to 10x faster in the same system).
TypeConference paper
URIhttp://hdl.handle.net/1822/42923
ISBN978-150902088-1
DOI10.1109/HPCSim.2016.7568410
Peer-Reviewedyes
AccessOpen access
Appears in Collections:CAlg - Artigos em livros de atas/Papers in proceedings
CCTC - Artigos em atas de conferências internacionais (texto completo)
LIP - Artigos/papers

Files in This Item:
File Description SizeFormat 
POMCO2016_submitted.pdf711,79 kBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons

Partilhe no FacebookPartilhe no TwitterPartilhe no DeliciousPartilhe no LinkedInPartilhe no DiggAdicionar ao Google BookmarksPartilhe no MySpacePartilhe no Orkut
Exporte no formato BibTex mendeley Exporte no formato Endnote Adicione ao seu ORCID