BLAST application with data-aware desktop grid middleware

Haiwu He, Gilles Fedak, Bing Tang, Franck Cappello

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

There exists numerous Grid middleware to develop and execute programs on the computational Grid, but they still require intensive work from their users. BitDew is made to facilitate the usage of large scale Grid with dynamic, heterogeneous, volatile and highly distributed computing resources for applications that require a huge amount of data processing. Data-intensive applications form an important class of applications for the e- Science community which require secure and coordinated access to large datasets, wide-area transfers and broad distribution of TeraBytes of data while keeping track of multiple data replicas. In genetic biology, gene sequences comparison and analysis are the most basic routines. With the considerable increase of sequences to analyze, we need more and more computing power as well as efficient solution to manage data. In this work, we investigate the advantages of using a new Desktop Grid middleware BitDew, designed for large scale data management. Our contribution is two-fold: firstly, we introduce a data-driven Master/Slave programming model and we present an implementation of BLAST over BitDew following this model, secondly, we present extensive experimental and simulation results which demonstrate the effectiveness and scalability of our approach. We evaluate the benefit of multi-protocol data distribution to achieve remarkable speedups, we report on the ability to cope with highly volatile environment with relative performance degradation, we show the benefit of data replication in Grid with heterogeneous resource performance and we evaluate the combination of data fault tolerance and data replication when computing on volatile resources.

Original languageEnglish (US)
Title of host publication2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009
Pages284-291
Number of pages8
DOIs
StatePublished - 2009
Externally publishedYes
Event2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009 - Shanghai, China
Duration: May 18 2009May 21 2009

Publication series

Name2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009

Other

Other2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009
Country/TerritoryChina
CityShanghai
Period5/18/095/21/09

Keywords

  • BLAST
  • BitDew
  • Data-aware middleware
  • Desktop grids

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Fingerprint

Dive into the research topics of 'BLAST application with data-aware desktop grid middleware'. Together they form a unique fingerprint.

Cite this