Pipelined Preconditioned Conjugate Gradient Methods for Distributed Memory Systems

Tiwari, M and Vadhiyar, S (2020) Pipelined Preconditioned Conjugate Gradient Methods for Distributed Memory Systems. In: 27th IEEE International Conference on High Performance Computing, Data, and Analytics, HiPC 2020, 16-18 Dec 2020, Pune; India, pp. 151-160.

PDF hipc_2020.pdf - Published Version Restricted to Registered users only Download (410kB) | Request a copy

Abstract

Preconditioned Conjugate Gradient (PCG) method has been one of the widely used methods for solving linear systems of equations for sparse problems. Pipelined PCG (PIPECG) attempts to eliminate the dependencies in the computations in the PCG algorithm and overlap non-dependent computations by reorganizing the traditional PCG code and using non-blocking allreduces. We have developed a novel pipelined PCG algorithm called PIPECG-OATI (One Allreduce per Two Iterations) that provides large overlap of global communication and computations at higher number of cores in distributed memory CPU systems. Our method achieves this overlapping by using iteration combination and by introducing new non-recurrence computations. We compare our method with other pipelined CG methods on a variety of problems and demonstrate that our method always gives the least runtimes. Our method gives up to 3x speedup over PCG method and 1.73x speedup over PIPECG method at large number of cores. © 2020 IEEE.

Item Type:	Conference Paper
Publication:	Proceedings - 2020 IEEE 27th International Conference on High Performance Computing, Data, and Analytics, HiPC 2020
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to Institute of Electrical and Electronics Engineers Inc.
Keywords:	Linear systems; Memory architecture; Pipelines, CPU systems; Distributed Memory; Distributed memory systems; Global communication; Linear systems of equations; Non-blocking; Pcg algorithms; Preconditioned conjugate gradient method, Conjugate gradient method
Department/Centre:	Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited:	04 Aug 2021 06:43
Last Modified:	04 Aug 2021 06:43
URI:	http://eprints.iisc.ac.in/id/eprint/68979

Actions (login required)

View Item