Advanced

MolecularRift, a Gesture Based Interaction Tool for Controlling Molecules in 3-D

Norrby, Magnus LU (2015) MAMM01 20151
Ergonomics and Aerosol Technology
Abstract
Visualization of molecular models is a vital part in modern drug design. Improved visualization methods
increases the conceptual understanding and enables faster and better decision making. The introduction of virtual reality goggles such as Oculus Rift has introduced new opportunities for the capabilities of such visualisations.

A new interactive visualization tool (MolecularRift), which lets the user experience molecular models in a virtual reality environment, was developed in collaboration with AstraZeneca.

In an attempt to create a more natural way to interact with the tool, users can steer and control molecules through hand gestures. The gestures are recorded using depth data from a Mircosoft Kinect v2 sensor and interpreted... (More)
Visualization of molecular models is a vital part in modern drug design. Improved visualization methods
increases the conceptual understanding and enables faster and better decision making. The introduction of virtual reality goggles such as Oculus Rift has introduced new opportunities for the capabilities of such visualisations.

A new interactive visualization tool (MolecularRift), which lets the user experience molecular models in a virtual reality environment, was developed in collaboration with AstraZeneca.

In an attempt to create a more natural way to interact with the tool, users can steer and control molecules through hand gestures. The gestures are recorded using depth data from a Mircosoft Kinect v2 sensor and interpreted using per pixel algorithms, which only focus on the captured frames thus freeing the user from additional devices such as cursor, keyboard, touchpad or even piezoresistive gloves.

MolecularRift was developed from a usability perspective using an iterative developing process and test group evaluations. The iterations allowed an agile process where features easily could be evaluated to monitor behavior and performance, resulting in a user-optimized tool.

We conclude with reflections on virtual reality's capabilities in chemistry and possibilities for future projects. (Less)
Popular Abstract (Swedish)
Virtual reality är framtiden. Nya tekniker utvecklas konstant och parallellt med att datakapaciteten förbättras finner vi nya sätt att använda dem ihop. Vi har utvecklat ett nytt interaktivt visualiserings verktyg (Molecular Rift) som låter användaren uppleva molekylära modeller i en virtuell verklighet. I dagens medicinindustri är man i ständigt behov av nya metoder för att visualisera potentiella läkemedel i 3-D. Det finns flera verktyg idag som används för att visualisera molekyler i 3-D stereo. Våra nyframtagna tekniker inom virtuell verklighet presenterar möjligheter för medicinutvecklare att ”gå in” i de molekylära strukturerna och uppleva dem på ett helt nytt sätt.
Please use this url to cite or link to this publication:
author
Norrby, Magnus LU
supervisor
organization
course
MAMM01 20151
year
type
H2 - Master's Degree (Two Years)
subject
keywords
Kinect, Virtual Reality, Oculus Rift, Gesture Recognition, Visualization, Molecular modeling
language
English
id
7451794
date added to LUP
2015-08-04 15:13:47
date last changed
2016-04-04 09:13:18
@misc{7451794,
  abstract     = {Visualization of molecular models is a vital part in modern drug design. Improved visualization methods
increases the conceptual understanding and enables faster and better decision making. The introduction of virtual reality goggles such as Oculus Rift has introduced new opportunities for the capabilities of such visualisations. 

A new interactive visualization tool (MolecularRift), which lets the user experience molecular models in a virtual reality environment, was developed in collaboration with AstraZeneca. 

In an attempt to create a more natural way to interact with the tool, users can steer and control molecules through hand gestures. The gestures are recorded using depth data from a Mircosoft Kinect v2 sensor and interpreted using per pixel algorithms, which only focus on the captured frames thus freeing the user from additional devices such as cursor, keyboard, touchpad or even piezoresistive gloves. 

MolecularRift was developed from a usability perspective using an iterative developing process and test group evaluations. The iterations allowed an agile process where features easily could be evaluated to monitor behavior and performance, resulting in a user-optimized tool.

We conclude with reflections on virtual reality's capabilities in chemistry and possibilities for future projects.},
  author       = {Norrby, Magnus},
  keyword      = {Kinect,Virtual Reality,Oculus Rift,Gesture Recognition,Visualization,Molecular modeling},
  language     = {eng},
  note         = {Student Paper},
  title        = {MolecularRift, a Gesture Based Interaction Tool for Controlling Molecules in 3-D},
  year         = {2015},
}