Virtual Reality And Virtual Surgery

MAHESH KUMAR IT-A ROLL NO-25 Page 1

What is Virtual Reality? • Definition: An interactive, computer-generated simulation environment or virtual environment. • TYPES    

IMMERSIVE NON-IMMERSIVE AUGUMENTED TEXT BASED VIDEO MAPPING

Page 2

Virtools Media Design

Sound Design

3DS, Maya, Lightwave

.wav, .mp3

Virtools Texture, 2D Interface .jpg, .bmp

Integration tool Behavioral tool

Specific BB, Interface Visual C++

Application Page 3

Immersive VR:

A human user placed in a virtual environment

Components of Immersive VR Motion Tracking System

Motion Tracking Software

Data Acquisition

Simulation Software

Display Device

Motion Device Page 4

Motion Tracking • Captures the user’s motion within a volume of space • Streams data to simulation software • Can tracks any number of objects

Page 5

VR Software

VR Software

Im p o rt R ead e n v ir o n m e n t t r a c k in g o b je c t s s tre a m

R e a d d a t•a EDS Jack a c q u is it io n / – Visual/Ergonomic s im u la t io n evaluation package s tre a m –

Customizable via scripting • Python, TCL, LISP

G e n e ra te d is p la y v ie w ( s ) & fe e b a c k m o t io n

• MPI Vega Prime / CM Labs Vortex

A d ju s t lo c a t io n & o r ie n t a t io n o f o b je c t s

– Efficient display of realistic geometry – Realistic physics and collision detection – Customizable via C++ coding – New version vortex 4.2 is released in 2009

Page 6

VR Software • VR Juggler  C++ based  Cross platform support  OpenGL and OSG based APIs  Simulator mode for use on workstations



Page 7

Motion Base NASA Flight Simulator

Applications of VR Applications Visibility / Ergonomics Ingress / Egress Manufacturing / Building Layout Driving Simulation / Training Advantages Low Cost Fast prototyping

Page 8

Virtual reality in surgery • a beginning to threshold level for using Simulators in Medicine the way that the Aviation industry has been using for past 50 Years — to avoid errors. • instrumentation, visualisation and monitoring have enabled continual growth in the medical field.

Page 9

What is virtual surgery?  The virtual reality simulation is used as an analog for the actual surgery where doctors can practice on a virtual patient before performing the surgery

Page 10

 display 3-D graphics of the organ being operated on.  The user can "perform surgery" upon the virtual organs by manipulating the tools  By inputting data from computerized tomography (CT) and magnetic resonance imaging (MRI) scans the patient can be replicated in virtual environment  The simulator surgery results can be evaluated before the surgery is carried out on real patient

Page 11

3. VIRTUAL REALITY APPLICATIONS IN SURGERY • APPLICATION:-

► Training and Education. ► Surgical Planning.

►Tele-surgery.

Page 12

Training and Education. Computer-based training has many potential advantages

• It is interactive. • An instructor presence is not necessary. • Changes can be made that demonstrate variation in anatomy or disease state.

● “ Fly through organs’’ to examine bodies from inside.

Page 13

Surgical planning

1. Survey, problem specification 2. Modelling, system plans 3. Implementation Session 1 4. Implementation, optimisation

Session 2 Session 3

5. Fine tuning, testing, presentation

Session 4 Session 5

Pert diagram

Dependence

finished sessions current session

Ses1

Feedback

Ses2

Ses3

Ses4

Ses5

future sessions

Page 14

IMAGE GUIDANCE integration of advanced imaging technology, image processing and 3D graphical capabilities has led to great interest in image guided and computeraided surgery

What is computer aided surgery? application of computational algorithm and VR visualization to diagnostic imaging, ■ preoperative surgical planning and interaoperative surgical navigation is referred to as Computer Aided Surgery ■

Page 15

TELESURGERY operate on people who are physically separated from themselves. usually done through a master-slave robot, imaging supplies through video cameras configured to provide a stereoscopic view.

Page 16

4. VIRTUAL SURGERY SIMULATION 1.3D IMAGE SIMULATION

●generate a 3D model of the part of the body that undergo surgery ●Magnetic Resonance Images (MRI), Computed Tomography (CT) or video recording, which are 2D images ●images are segmented

Page 17

2. TOUCH

SIMULATION Physicians rely on their sense of touch ●the brain can be tricked into seeing seamless motion by flipping through 30 or so image per second ●For simulating touch sensation, we have to calculate the forces applied to cut, protuded, puncture the various tissues. ●

Page 18

5. WHAT IS A VIRTUAL SURGER SIMULATOR? • consists of a powerful PC which runs the software and an interfacer- haptic interfacer- for the user to interact with the virtual environment work on the force feedback loop.

Page 19

6. PHANTOM DESKTOP 3D TOUCH SYSTEM- A HAPTIC INTERFACER

Page 20

…now I’m sure I am. …in our virtual hospital. Why not?

© www.ozedweb.com

Page 21

8. CONCLUSION  Medical virtual reality has come a long way in the past 10 years as a result of advances in computer imaging, software, hardware and display  One of the current limitations of VR implementation is shortcomings in the realism of the simulations. The main Impediment to realistic simulators is the cost and processing power of available hardware.  Conflicts between sensory information can result in stimulator sickness, which includes side effects such as eyestrain, nausea, loss of balance a  Despite these concerns, the benefits of VR systems in medicines have clearly been established in several areas, including improved training, better access to services, and increase cost effectiveness and accuracy in performing certain conventional surgical procedures. Page 22

Page 23

Questions ? Page 24