Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Accelerating AI using next-generation hardware : Possibilities and challenges with analog in-memory computing

Ornhag, Marcus Valtonen LU ; Guler, Puren ; Knyaginin, Dmitry and Borg, Mattias LU orcid (2023) 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023 p.488-496
Abstract

Future generations of computing systems need to continue increasing processing speed and energy efficiency in order to meet the growing workload requirements under stringent environmental constraints. As a result, domain-specific hardware accelerators and platforms have become widely used. In addition to the conventional approach, where memory and processing elements are separated, an emerging approach called in-memory computing (IMC) is being actively researched. IMC co-locates memory and processing, which reduces data transfer energy and thus promises to increase energy efficiency. Unlike digital IMC, analog IMC performs operations like multiplication and addition in the analog domain. It may use new types of devices, manufactured... (More)

Future generations of computing systems need to continue increasing processing speed and energy efficiency in order to meet the growing workload requirements under stringent environmental constraints. As a result, domain-specific hardware accelerators and platforms have become widely used. In addition to the conventional approach, where memory and processing elements are separated, an emerging approach called in-memory computing (IMC) is being actively researched. IMC co-locates memory and processing, which reduces data transfer energy and thus promises to increase energy efficiency. Unlike digital IMC, analog IMC performs operations like multiplication and addition in the analog domain. It may use new types of devices, manufactured using new materials that offer higher scalability. Despite being actively researched, limited knowledge is available about their performance on common computing tasks. In this paper, we analyze the per-formance of analog IMC devices on two imaging problems: image denoising and semantic segmentation. In both cases, we use deep learning-based algorithms and show how the performance varies between the applications as well as dis-cuss the effects of internal and external noise sources. Our insights can help to select a suitable application for ana-log IMC devices, reason about their performance, and understand the application-specific requirements for a desired level of performance. Thus, they further function as input to future analog IMC device manufacturers.11This work was partially funded by Swedish Foundation for Strategic Research, project number SM21-0008.

(Less)
Please use this url to cite or link to this publication:
author
; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
host publication
Proceedings - 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023
pages
9 pages
publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
conference name
2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023
conference location
Waikoloa, United States
conference dates
2023-01-03 - 2023-01-07
external identifiers
  • scopus:85148328400
ISBN
9798350320565
DOI
10.1109/WACVW58289.2023.00054
project
Robust neuromorphic computing using ferroelectric memristors
language
English
LU publication?
yes
id
c5f85d1f-e453-4ef0-8fb8-7e28bf0f1ff4
date added to LUP
2023-03-08 09:00:17
date last changed
2023-11-21 05:24:27
@inproceedings{c5f85d1f-e453-4ef0-8fb8-7e28bf0f1ff4,
  abstract     = {{<p>Future generations of computing systems need to continue increasing processing speed and energy efficiency in order to meet the growing workload requirements under stringent environmental constraints. As a result, domain-specific hardware accelerators and platforms have become widely used. In addition to the conventional approach, where memory and processing elements are separated, an emerging approach called in-memory computing (IMC) is being actively researched. IMC co-locates memory and processing, which reduces data transfer energy and thus promises to increase energy efficiency. Unlike digital IMC, analog IMC performs operations like multiplication and addition in the analog domain. It may use new types of devices, manufactured using new materials that offer higher scalability. Despite being actively researched, limited knowledge is available about their performance on common computing tasks. In this paper, we analyze the per-formance of analog IMC devices on two imaging problems: image denoising and semantic segmentation. In both cases, we use deep learning-based algorithms and show how the performance varies between the applications as well as dis-cuss the effects of internal and external noise sources. Our insights can help to select a suitable application for ana-log IMC devices, reason about their performance, and understand the application-specific requirements for a desired level of performance. Thus, they further function as input to future analog IMC device manufacturers.11This work was partially funded by Swedish Foundation for Strategic Research, project number SM21-0008.</p>}},
  author       = {{Ornhag, Marcus Valtonen and Guler, Puren and Knyaginin, Dmitry and Borg, Mattias}},
  booktitle    = {{Proceedings - 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023}},
  isbn         = {{9798350320565}},
  language     = {{eng}},
  pages        = {{488--496}},
  publisher    = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
  title        = {{Accelerating AI using next-generation hardware : Possibilities and challenges with analog in-memory computing}},
  url          = {{http://dx.doi.org/10.1109/WACVW58289.2023.00054}},
  doi          = {{10.1109/WACVW58289.2023.00054}},
  year         = {{2023}},
}