Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Tools in and out of sight : an analysis informed by Cultural-Historical Activity Theory of audio-haptic activities involving people with visual impairments supported by technology

Szymczak, Delphine LU (2023)
Abstract
The main purpose of this thesis is to present a Cultural-Historical Activity Theory (CHAT) based analysis of the activities conducted by and with visually impaired users supported by audio-haptic technology.This thesis covers several studies conducted in two projects. The studies evaluate the use of audio-haptic technologies to support and/or mediate the activities of people with visual impairment. The focus is on the activities involving access to two-dimensional information, such as pictures or maps. People with visual impairments can use commercially available solutions to explore static information (raised lined maps and pictures, for example). Solu-tions for dynamic access, such as drawing a picture or using a map while moving around,... (More)
The main purpose of this thesis is to present a Cultural-Historical Activity Theory (CHAT) based analysis of the activities conducted by and with visually impaired users supported by audio-haptic technology.This thesis covers several studies conducted in two projects. The studies evaluate the use of audio-haptic technologies to support and/or mediate the activities of people with visual impairment. The focus is on the activities involving access to two-dimensional information, such as pictures or maps. People with visual impairments can use commercially available solutions to explore static information (raised lined maps and pictures, for example). Solu-tions for dynamic access, such as drawing a picture or using a map while moving around, are more scarce. Two distinct projects were initiated to remedy the scarcity of dynamic access solutions, specifically focusing on two separate activities.The first project, HaptiMap, focused on pedestrian outdoors navigation through audio feedback and gestures mediated by a GPS equipped mobile phone. The second project, HIPP, focused on drawing and learning about 2D representations in a school setting with the help of haptic and audio feedback. In both cases, visual feedback was also present in the technology, enabling people with vision to take advantage of that modality too.
The research questions addressed are: How can audio and haptic interaction mediate activ-ities for people with visual impairment? Are there features of the programming that help or hinder this mediation? How can CHAT, and specifically the Activity Checklist, be used to shape the design process, when designing audio haptic technology together with persons with visual impairments?
Results show the usefulness of the Activity Checklist as a tool in the design process, and provide practical application examples. A general conclusion emphasises the importance of modularity, standards, and libre software in rehabilitation technology to support the development of the activities over time and to let the code evolve with them, as a lifelong iterative development process. The research also provides specific design recommendations for the design of the type of audio haptic systems involved. (Less)
Please use this url to cite or link to this publication:
author
supervisor
opponent
  • Dr. Sallnäs Pysander, Eva-Lotta, KTH Royal Institute of Technology, Sweden.
organization
publishing date
type
Thesis
publication status
published
subject
keywords
haptic, multimodal, disability, interaction, Cultural Historical Activity Theory, open-source software
pages
183 pages
publisher
Department of Design Sciences, Faculty of Engineering, Lund University
defense location
Lecture Hall Stora hörsalen, IKDC, Sölvegatan 26, Faculty of Engineering LTH, Lund University, Lund. The dissertation will be live streamed, but part of the premises is to be excluded from the live stream. Zoom: https://lu-se.zoom.us/j/67023747253
defense date
2023-04-21 09:15:00
ISBN
978-91-8039-321-8
978-91-8039-320-1
project
HaptiMap - Haptic, Audio and Visual Interfaces for Maps and Location Based Services
HIPP - Haptics in Pedagogical Practice
language
English
LU publication?
yes
id
e9df98a9-e5ec-4c23-9248-8494fa876954
date added to LUP
2022-10-07 15:09:02
date last changed
2023-03-27 13:28:22
@phdthesis{e9df98a9-e5ec-4c23-9248-8494fa876954,
  abstract     = {{The main purpose of this thesis is to present a Cultural-Historical Activity Theory (CHAT) based analysis of the activities conducted by and with visually impaired users supported by audio-haptic technology.This thesis covers several studies conducted in two projects. The studies evaluate the use of audio-haptic technologies to support and/or mediate the activities of people with visual impairment. The focus is on the activities involving access to two-dimensional information, such as pictures or maps. People with visual impairments can use commercially available solutions to explore static information (raised lined maps and pictures, for example). Solu-tions for dynamic access, such as drawing a picture or using a map while moving around, are more scarce. Two distinct projects were initiated to remedy the scarcity of dynamic access solutions, specifically focusing on two separate activities.The first project, HaptiMap, focused on pedestrian outdoors navigation through audio feedback and gestures mediated by a GPS equipped mobile phone. The second project, HIPP, focused on drawing and learning about 2D representations in a school setting with the help of haptic and audio feedback. In both cases, visual feedback was also present in the technology, enabling people with vision to take advantage of that modality too.<br/>The research questions addressed are: How can audio and haptic interaction mediate activ-ities for people with visual impairment? Are there features of the programming that help or hinder this mediation? How can CHAT, and specifically the Activity Checklist, be used to shape the design process, when designing audio haptic technology together with persons with visual impairments?<br/>Results show the usefulness of the Activity Checklist as a tool in the design process, and provide practical application examples. A general conclusion emphasises the importance of modularity, standards, and libre software in rehabilitation technology to support the development of the activities over time and to let the code evolve with them, as a lifelong iterative development process. The research also provides specific design recommendations for the design of the type of audio haptic systems involved.}},
  author       = {{Szymczak, Delphine}},
  isbn         = {{978-91-8039-321-8}},
  keywords     = {{haptic; multimodal; disability; interaction; Cultural Historical Activity Theory; open-source software}},
  language     = {{eng}},
  month        = {{03}},
  publisher    = {{Department of Design Sciences, Faculty of Engineering, Lund University}},
  school       = {{Lund University}},
  title        = {{Tools in and out of sight : an analysis informed by Cultural-Historical Activity Theory of audio-haptic activities involving people with visual impairments supported by technology}},
  url          = {{https://lup.lub.lu.se/search/files/141259967/thesisfinal.pdf}},
  year         = {{2023}},
}