Please use this identifier to cite or link to this item:

TitleAn RDMA middleware for asynchronous multi-stage shuffling in analytical processing
Author(s)Gonçalves, Rui Carlos Araújo
Pereira, José
Jimenez-Peris, Ricardo
KeywordsDistributed databases
Issue date2016
PublisherSpringer International Publishing AG
JournalLecture Notes in Computer Science
Abstract(s)A key component in large scale distributed analytical processing is shuffling, the distribution of data to multiple nodes such that the computation can be done in parallel. In this paper we describe the design and implementation of a communication middleware to support data shuffling for executing multi-stage analytical processing operations in parallel. The middleware relies on RDMA (Remote Direct Memory Access) to provide basic operations to asynchronously exchange data among multiple machines. Experimental results show that the RDMA-based middleware developed can provide a 75% reduction of the costs of communication operations on parallel analytical processing tasks, when compared with a sockets middleware.
TypeConference paper
AccessRestricted access (UMinho)
Appears in Collections:HASLab - Artigos em atas de conferências internacionais (texto completo)

Files in This Item:
File Description SizeFormat 
  Restricted access
390,88 kBAdobe PDFView/Open

Partilhe no FacebookPartilhe no TwitterPartilhe no DeliciousPartilhe no LinkedInPartilhe no DiggAdicionar ao Google BookmarksPartilhe no MySpacePartilhe no Orkut
Exporte no formato BibTex mendeley Exporte no formato Endnote Adicione ao seu ORCID