DH-Falcon: A language for large-scale graph processing on Distributed Heterogeneous systems

Cheramangalath, Unnikrishnan and Nasre, Rupesh and Srikant, Y N (2017) DH-Falcon: A language for large-scale graph processing on Distributed Heterogeneous systems. In: IEEE International Conference on Cluster Computing (CLUSTER), SEP 05-08, 2017, Honolulu, HI, pp. 439-450.

PDF IEEE_INT_CON_439_2017.pdf - Published Version Restricted to Registered users only Download (292kB) | Request a copy

Abstract

Graph models of social information systems typically contain trillions of edges. Such big graphs cannot be processed on a single machine. The graph object must be partitioned and distributed among machines and processed in parallel on a computer cluster. Programming such systems is very challenging. In this work, we present DH-Falcon, a graph DSL (domain-specific language) which can be used to implement parallel algorithms for large-scale graphs, targeting Distributed Heterogeneous (CPU and GPU) clusters. DH-Falcon compiler is built on top of the Falcon compiler, which targets single node devices with CPU and multiple GPUs. An important facility provided by DH-Falcon is that it supports mutation of graph objects, which allows programmer to write dynamic graph algorithms. Experimental evaluation shows that DH-Falcon matches or outperforms state-of-theart frameworks and gains a speedup of up to 13x.

Item Type:	Conference Proceedings
Series.:	IEEE International Conference on Cluster Computing
Additional Information:	Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	24 Nov 2017 10:00
Last Modified:	24 Nov 2017 10:00
URI:	http://eprints.iisc.ac.in/id/eprint/58326

Actions (login required)

View Item