A Soft RISC-V Vector Processor for Edge-AI

Chander, VN and Varghese, K (2022) A Soft RISC-V Vector Processor for Edge-AI. In: 35th International Conference on VLSI Design, VLSID 2022 - held concurrently with 2022 21st International Conference on Embedded Systems, ES 2022, 26 Feb- 2 March 2022, Virtual, Online, pp. 263-268.

PDF VLSID_2022.pdf - Published Version Restricted to Registered users only Download (417kB) | Request a copy

Abstract

Edge computing is the key to unlocking the power of deep neural networks on edge devices. However, deploying power-hungry deep neural network inference on resource-constrained and power-limited devices poses serious challenges in delivering real-time performance. With the advent of RISC-V Vector extension, there has been a renewed interest in vector processors to exploit data-parallel workloads. General purpose processors featuring vector coprocessors are riddled with complex control mechanisms such as instruction schedulers, operand queues, and scoreboards which have largely inhibited their presence in the realm of low-power microcontrollers. This work features a systolic array based vector unit that is closely integrated into the pipeline of a 32-bit, in-order, single-issue RISC-V scalar core that runs at 50 MHz. The robustness of neural networks coupled with the flexibility offered by the RISC-V Vector extension instruction set is used to significantly reduce several architectural complexities of the vector unit. The vector processor is implemented on Xilinx Virtex 7 (XC7VX485T) FPGA. Benchmarking the RISC-V Vector processor shows a speedup of up to 40.7× over the scalar RISC-V core on image recognition tasks at the cost of 1.2× power consumption and 1.8× hardware resources. The soft core vector processor also compares well with similar processors that use data-level parallelism.

Item Type:	Conference Paper
Publication:	Proceedings - 2022 35th International Conference on VLSI Design, VLSID 2022 - held concurrently with 2022 21st International Conference on Embedded Systems, ES 2022
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to Institute of Electrical and Electronics Engineers Inc.
Keywords:	Computing power; Coprocessor; Deep neural networks; Electric power utilization; General purpose computers; Image recognition; Parallel processing systems; Systolic arrays, Data parallel; Edge computing; Limited devices; N/a; Network inference; Parallel workloads; Power; Real time performance; Vector processors; Vector units, Vectors
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	28 Oct 2022 05:02
Last Modified:	28 Oct 2022 05:02
URI:	https://eprints.iisc.ac.in/id/eprint/77684

Actions (login required)

View Item