Bisimulation reduction of big graphs on MapReduce

Y. Luo, Y. Lange, de, G.H.L. Fletcher, P.M.E. De Bra, A.J.H. Hidders

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

7 Citaten (Scopus)
4 Downloads (Pure)

Samenvatting

Computing the bisimulation partition of a graph is a fundamental problem which plays a key role in a wide range of basic applications. Intuitively, two nodes in a graph are bisimilar if they share basic structural properties such as labeling and neighborhood topology. In data management, reducing a graph under bisimulation equivalence is a crucial step, e.g., for indexing the graph for efficient query processing. Often, graphs of interest in the real world are massive; examples include social networks and linked open data. For analytics on such graphs, it is becoming increasingly infeasible to rely on in-memory or even I/O-efficient solutions. Hence, a trend in Big Data analytics is the use of distributed computing frameworks such as MapReduce. While there are both internal and external memory solutions for efficiently computing bisimulation, there is, to our knowledge, no effective MapReduce-based solution for bisimulation. Motivated by these observations we propose in this paper the first efficient MapReduce-based algorithm for computing the bisimulation partition of massive graphs. We also detail several optimizations for handling the data skew which often arises in real-world graphs. The results of an extensive empirical study are presented which demonstrate the effectiveness and scalability of our solution.
Originele taal-2Engels
TitelBig Data (29th British National Conference on Databases, BNCOD 2013, Oxford, UK, July 8-10, 2013. Proceedings)
RedacteurenG. Gottlob, G. Grasso, D. Olteanu, C. Schallhart
Plaats van productieBerlin
UitgeverijSpringer
Pagina's189-203
ISBN van geprinte versie978-3-642-39466-9
DOI's
StatusGepubliceerd - 2013

Publicatie series

NaamLecture Notes in Computer Science
Volume7968
ISSN van geprinte versie0302-9743

Vingerafdruk

Duik in de onderzoeksthema's van 'Bisimulation reduction of big graphs on MapReduce'. Samen vormen ze een unieke vingerafdruk.

Citeer dit