ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

DH-Falcon: A language for large-scale graph processing on Distributed Heterogeneous systems

Cheramangalath, Unnikrishnan and Nasre, Rupesh and Srikant, Y N (2017) DH-Falcon: A language for large-scale graph processing on Distributed Heterogeneous systems. In: IEEE International Conference on Cluster Computing (CLUSTER), SEP 05-08, 2017, Honolulu, HI, pp. 439-450.

[img] PDF
IEEE_INT_CON_439_2017.pdf - Published Version
Restricted to Registered users only

Download (292kB) | Request a copy
Official URL: http://doi.org/10.1109/CLUSTER.2017.72

Abstract

Graph models of social information systems typically contain trillions of edges. Such big graphs cannot be processed on a single machine. The graph object must be partitioned and distributed among machines and processed in parallel on a computer cluster. Programming such systems is very challenging. In this work, we present DH-Falcon, a graph DSL (domain-specific language) which can be used to implement parallel algorithms for large-scale graphs, targeting Distributed Heterogeneous (CPU and GPU) clusters. DH-Falcon compiler is built on top of the Falcon compiler, which targets single node devices with CPU and multiple GPUs. An important facility provided by DH-Falcon is that it supports mutation of graph objects, which allows programmer to write dynamic graph algorithms. Experimental evaluation shows that DH-Falcon matches or outperforms state-of-theart frameworks and gains a speedup of up to 13x.

Item Type: Conference Proceedings
Additional Information: Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre: Division of Electrical Sciences > Computer Science & Automation
Depositing User: Id for Latest eprints
Date Deposited: 24 Nov 2017 10:00
Last Modified: 24 Nov 2017 10:00
URI: http://eprints.iisc.ac.in/id/eprint/58326

Actions (login required)

View Item View Item