Reconfigurable multi-access pattern vector memory for real-time orb feature extraction

Ferreira, Lucas; Malkowsky, Steffen; Persson, Patrik; Aström, Karl, et al. (2021). Reconfigurable multi-access pattern vector memory for real-time orb feature extraction 2021 IEEE International Symposium on Circuits and Systems, ISCAS 2021 - Proceedings, 2021-May,. 53rd IEEE International Symposium on Circuits and Systems, ISCAS 2021. Daegu, Korea, Republic of: IEEE - Institute of Electrical and Electronics Engineers Inc.
Download:
DOI:
Conference Proceeding/Paper | Published | English
Authors:
Ferreira, Lucas ; Malkowsky, Steffen ; Persson, Patrik ; Aström, Karl , et al.
Department:
Integrated Electronic Systems
ELLIIT: the Linköping-Lund initiative on IT and mobile communication
Mathematics (Faculty of Engineering)
eSSENCE: The e-Science Collaboration
Research Group:
Integrated Electronic Systems
Abstract:

This work presents an on-chip memory subsystem envisioned for real-time applications performing Oriented FAST and Rotated Brief (ORB) feature extraction for Simultaneous Localization and Mapping (SLAM) systems. For autonomous navigation of battery-powered devices, feature-based SLAM is a computationally frugal alternative to direct methods. This paper thoroughly analyses ORB multiple memory access patterns, exploring possible systematic parallelism and hardware-biased algorithmic enhancements, alleviating requirements on bandwidth and reducing redundant accesses. Enabling those, a suitable multi-bank parallel memory featuring run-time reconfigurable address generation, image allotment, and close-to-memory data-shuffling is proposed. As case study, a 30 Frames-Per-Second (FPS) VGA-resolution ORB-capable 8-bank memory is evaluated using 22 FDX technology, running at 909 MHz, with a negligible area overhead of 0.3%, reducing operand accesses between 54 − 160× relative to Sudoku-like and scalar memories.

Keywords:
Feature extraction ; ORB ; Programmable multiple memory access patterns ; Vision-based SLAM
ISBN:
9781728192017
ISSN:
0271-4310
LUP-ID:
601af2cd-1ad5-4519-8381-0b10f6f35da4 | Link: https://lup.lub.lu.se/record/601af2cd-1ad5-4519-8381-0b10f6f35da4 | Statistics

Cite this