Virtual reality (VR) is a term that applies to computer-simulated environments that can simulate physical presence in places in the real world, as well as in imaginary worlds. Most current virtual reality environments are primarily visual experiences, displayed either on a computer screen or through special stereoscopic displays, but some simulations include additional sensory information, such as sound through speakers or headphones. Some advanced, haptic systems now include tactile information, generally known as force feedback, in medical and gaming applications. Furthermore, virtual reality covers remote communication environments which provide virtual presence of users with the concepts of telepresence and telexistence. or a virtual artifact (VA) either through the use of standard input devices such as a keyboard and mouse, or through multimodal devices such as a wired glove, the Polhemus, and omnidirectional treadmills. The simulated environment can be similar to the real world in order to create a lifelike experience—for example, in simulations for pilot or combat training—or it can differ significantly from reality, such as in VR games. In practice, it is currently very difficult create a high-fidelity virtual reality experience, due largely to technical limitations on processing power, image resolution, and communication bandwidth; however, the technology’s proponents hope that such limitations will be overcome as processor, imaging, and data communication technologies become more powerful and cost-effective over time.
Virtual reality is often used to describe a wide variety of applications commonly associated with immersive, highly visual, 3D environments. The development of CAD software, graphics hardware acceleration, head mounted displays, database gloves, and miniaturization have helped popularize the notion. In the book The Metaphysics of Virtual Reality by Michael R. Heim, seven different concepts of virtual reality are identified: simulation, interaction, artificiality, immersion, telepresence, full-body immersion, and network communication. People often identify VR with head mounted displays and data suits.
Background
Terminology and concepts
The term “artificial reality”, coined by Myron Krueger, has been in use since the 1970s; however, the origin of the term “virtual reality” can be traced back to the French playwright, poet, actor, and director Antonin Artaud. In his seminal book The Theatre and Its Double (1938), Artaud described theatre as “la réalite virtuelle”, a virtual reality “in which characters, objects, and images take on the phantasmagoric force of alchemy’s visionary internal dramas”. It has been used in The Judas Mandala, a 1982 science-fiction novel by Damien Broderick, where the context of use is somewhat different from that defined above. The earliest use cited by the Oxford English Dictionary is in a 1987 article titled “Virtual reality”, but the article is not about VR technology. The concept of virtual reality was popularized in mass media by movies such as Brainstorm and The Lawnmower Man. The VR research boom of the 1990s was accompanied by the non-fiction book Virtual Reality (1991) by Howard Rheingold. The book served to demystify the subject, making it more accessible to less technical researchers and enthusiasts, with an impact similar to that which his book The Virtual Community had on virtual community research lines closely related to VR. Multimedia: from Wagner to Virtual Reality, edited by Randall Packer and Ken Jordan and first published in 2001, explores the term and its history from an avant-garde perspective. Philosophical implications of the concept of VR are systematically discussed in the book Get Real: A Philosophical Adventure in Virtual Reality (1998) by Philip Zhai, wherein the idea of VR is pushed to its logical extreme and ultimate possibility. According to Zhai, virtual reality could be made to have an ontological status equal to that of actual reality. Digital Sensations: Space, Identity and Embodiment in Virtual Reality (1999), written by Ken Hillis, offers a more critical and theoretical academic assessment of the complex set of cultural and political desires and practices culminating in the development of the technology.
Timeline
Virtual reality can trace its roots to the 1860s, when 360-degree art through panoramic murals began to appear. An example of this would be Baldassare Peruzzi’s piece titled, Sala delle Prospettive. In the 1920s, vehicle simulators were introduced. Morton Heilig wrote in the 1950s of an “Experience Theatre” that could encompass all the senses in an effective manner, thus drawing the viewer into the onscreen activity. He built a prototype of his vision dubbed the Sensorama in 1962, along with five short films to be displayed in it while engaging multiple senses (sight, sound, smell, and touch). Predating digital computing, the Sensorama was a mechanical device, which reportedly still functions today. Around this time, Douglas Englebart uses computer screens as both input and output devices. In 1966, Tom Furness introduces a visual flight stimulator for the Air Force. In 1968, Ivan Sutherland, with the help of his student Bob Sproull, created what is widely considered to be the first virtual reality and augmented reality (AR) head mounted display (HMD) system. It was primitive both in terms of user interface and realism, and the HMD to be worn by the user was so heavy it had to be suspended from the ceiling. The graphics comprising the virtual environment were simple wireframe model rooms. The formidable appearance of the device inspired its name, The Sword of Damocles. Also notable among the earlier hypermedia and virtual reality systems was the Aspen Movie Map, which was created at MIT in 1977. The program was a crude virtual simulation of Aspen, Colorado in which users could wander the streets in one of three modes: summer, winter, and polygons. The first two were based on photographs—the researchers actually photographed every possible movement through the city’s street grid in both seasons—and the third was a basic 3-D model of the city. In the late 1980s, the term “virtual reality” was popularized by Jaron Lanier, one of the modern pioneers of the field. Lanier had founded the company VPL Research in 1985, which developed and built some of the seminal “goggles and gloves” systems of that decade. In 1991, Antonio Medina, a MIT graduate and NASA scientist, designed a virtual reality system to “drive” Mars rovers from Earth in apparent real time despite the substantial delay of Mars-Earth-Mars signals. The system, termed “Computer-Simulated Teleoperation” as published by Rand, is an extension of virtual reality.
Impact
There has been an increase in interest in the potential social impact of new technologies, such as virtual reality. Mychilo S. Cline, in his book Power, Madness, and Immortality: The Future of Virtual Reality, argues that virtual reality will lead to a number of important changes in human life and activity. He argues that:
- Virtual reality will be integrated into daily life and activity, and will be used in various human ways.
- Techniques will be developed to influence human behavior, interpersonal communication, and cognition.
- As we spend more and more time in virtual space, there will be a gradual “migration to virtual space”, resulting in important changes in economics, worldview, and culture.
- The design of virtual environments may be used to extend basic human rights into virtual space, to promote human freedom and well-being, and to promote social stability as we move from one stage in socio-political development to the next.
- Virtual reality can also be used to induce body transfer illusions.
Heritage and archaeology
The use of VR in heritage and archaeology has potential in museum and visitor centre applications, but its use has been tempered by the difficulty in presenting a “quick to learn” real time experience to numerous people at any given time. Many historic reconstructions tend to be in a pre-rendered format to a shared video display, thus allowing more than one person to view a computer generated world, but limiting the interaction that full-scale VR can provide. The first use of a VR presentation in a heritage application was in 1994, when a museum visitor interpretation provided an interactive “walk-through” of a 3D reconstruction of Dudley Castle in England as it was in 1550. This consisted of a computer controlled laserdisc-based system designed by British based engineer Colin Johnson. One of the first users of virtual reality was Queen Elizabeth II, when she officially opened this visitor centre in June 1994. The system was featured in a conference held by the British Museum in November 1994, and in the subsequent technical paper, Imaging the Past – Electronic Imaging and Computer Graphics in Museums and Archaeology.
VR reconstruction
Virtual reality enables heritage sites to be recreated extremely accurately, so that the recreations can be published in various media. The original sites are often inaccessible to the public, or may even no longer exist. This technology can be used to develop virtual replicas of caves, natural environment, old towns, monuments, sculptures and archaeological elements.
Fiction
Many science fiction books and movies have imagined characters being “trapped in virtual reality”.
A comprehensive and specific fictional model for virtual reality was published in 1935 in the short story Pygmalion’s Spectacles by Stanley G. Weinbaum. In the story, the main character, Dan Burke, meets an elfin professor, Albert Ludwig, who has invented a pair of goggles which enable “a movie that gives one sight and sound […] taste, smell, and touch. […] You are in the story, you speak to the shadows (characters) and they reply, and instead of being on a screen, the story is all about you, and you are in it.” A more modern work to use this idea was Daniel F. Galouye’s novel Simulacron-3, which was made into a German teleplay titled Welt am Draht (“World on a Wire”) in 1973. Other science fiction books have promoted the idea of virtual reality as a partial, but not total, substitution for the misery of reality, or have touted it as a method for creating breathtaking virtual worlds in which one may escape from Earth.
Stanisław Lem wrote a short story in early 1960 called ” IJON TICHY’S MEMORIES”, in which he presented a scientist who devised a completely artificial virtual reality. Among the beings trapped inside his created virtual world, there is also a scientist, who also devised such machines creating another level of virtual world. The Piers Anthony novel Killobyte follows the story of a paralyzed cop trapped in a virtual reality game by a hacker, whom he must stop to save a fellow trapped player slowly succumbing to insulin shock. This novel toys with the idea of both the potential positive therapeutic uses, such as allowing the paralyzed to experience the illusion of movement while stimulating unused muscles, as well as virtual realities’ dangers. Vernor Vinge’s True Names, published in 1981, imagines a virtual world which is probably the first to represent a metaverse. In the story, characters interact with each other in a complete world, where they own homes and are represented using avatars. This type of virtual world was later to be realized as Second Life, which was launched in 2003.
Other popular fictional works that use the concept of virtual reality include William Gibson’s Neuromancer which defined the concept of cyberspace, Neal Stephenson’s Snow Crash, in which he made extensive reference to the term avatar to describe one’s representation in a virtual world, and Rudy Rucker’s The Hacker and the Ants, in which programmer Jerzy Rugby uses VR for robot design and testing.
The Doctor Who serial “The Deadly Assassin”, first broadcast in 1976, introduced a dream-like computer-generated reality, known as the Matrix.
The first major American television series to showcase virtual reality regularly was Star Trek: The Next Generation. Several episodes featured a holodeck, a virtual reality facility that enabled its users to recreate and experience anything they wanted. One difference from current virtual reality technology, however, was that replicators, force fields, holograms, and transporters were used to actually recreate and place objects in the holodeck, rather than illusions.
The New Zealand post-apocalyptic soap opera The Tribe (TV Series) shows Virtual Reality being used by an advanced enemy tribe named the Technos.
Cult British BBC2 sci-fi series Red Dwarf featured a virtual reality game titled “Better Than Life”, in which the main characters had spent many years connected. Virtual reality has also been featured in other Red Dwarf episodes, including “Back to Reality”, where venom from the despair squid caused the characters to believe that all of their experiences on Red Dwarf had been part of a VR simulation. Other episodes that feature virtual reality include “Gunmen of the Apocalypse”, “Stoke Me a Clipper”, “Blue”, “Beyond a Joke”, and “Back in the Red”.
The popular .hack multimedia franchise is based on a virtual reality MMORPG dubbed “The World” The French animated series Code Lyoko is based on the virtual world of Lyoko and the Internet. The virtual world is accessed by large scanners which use an atomic process, and breaks down the atoms of the person inside, digitizes them, and recreates an incarnation on Lyoko. The Saban show VR Troopers also made use of the concept.
Motion pictures
Steven Lisberger’s 1982 movie TRON was the first mainstream Hollywood picture to explore the idea of virtual reality. One year later, it would be fully expanded in the Natalie Wood film Brainstorm. A VR-like system used to record and play back dreams figures centrally in Wim Wenders’ 1991 film Until the End of the World. The 1992 film The Lawnmower Man (which bore almost no resemblance to the Stephen King story of the same name on which it was ostensibly based) tells the story of a research scientist who uses a VR system to jumpstart the mental and physical development of his mentally handicapped gardener. James Cameron’s Avatar depicts a time when people’s consciousness are virtually transported into biologically grown avatars. Outside the genre of science fiction, 1994’s Disclosure, starring Michael Douglas, based on the Michael Crichton book of the same name, depicts a VR headset being used as a navigation device for a prototype computer file system. In 1999, the film The Matrix and it’s sequels explored the possibility that the world we live in today was one giant Virtual Reality created by artificially intelligent machines.
Radio
In 2009, British digital radio station BBC Radio 7 broadcasted Planet B, a science-fiction drama set in a virtual world. Planet B is the largest ever commission for an original drama programme.
Fine art
David Em was the first fine artist to create navigable virtual worlds in the 1970s. His early work was done on mainframes at III, JPL, and Caltech. Jeffrey Shaw explored the potential of VR in fine arts with early works like Legible City (1989), Virtual Museum (1991), and Golden Calf (1994). Canadian artist Char Davies created immersive VR art pieces Osmose (1995) and Ephémère (1998). Maurice Benayoun’s work introduced metaphorical, philosophical or political content, combining VR, network, generation and intelligent agents, in works like Is God Flat (1994), The Tunnel under the Atlantic (1995), and World Skin (1997). Other pioneering artists working in VR have include Luc Courchesne, Rita Addison, Knowbotic Research, Rebecca Allen, Perry Hoberman, Jacki Morie, and Brenda Laurel. All mentioned artists are documented in the Database of Virtual Art.
Music
Immersive virtual musical instruments build on the trend in electronic musical instruments to develop new ways to control sound and perform music such as evidenced by conferences like NIME and aim to represent musical events and sound parameters in a virtual reality in such a way that they can be perceived not only through auditory feedback, but also visually in 3D and possibly through tactile as well as haptic feedback, allowing the development of novel interaction metaphors beyond manipulation such as prehension.
Therapeutic uses
The primary use of VR in a therapeutic role is its application to various forms of exposure therapy, ranging from phobia treatments to newer approaches to treating PTSD. A very basic VR simulation with simple sight and sound models has been shown to be invaluable in phobia treatment, like zoophobia, and acrophobia, as a step between basic exposure therapy such as the use of simulacra and true exposure. A much more recent application is being piloted by the U.S. Navy to use a much more complex simulation to immerse veterans suffering from PTSD in simulations of urban combat settings. Much as in phobia treatment, exposure to the subject of the trauma or fear leads to desensitization, and a significant reduction in symptoms.
Other research fields in which the use of virtual reality is being explored are physical medicine, rehabilitation, physical therapy, and occupational therapy. In adult rehabilitation, a variety of virtual reality applications are currently being evaluated within upper and lower limb motor rehabilitation for individuals recovering from stroke or spinal cord injury. In pediatrics, the use of virtual reality is being evaluated to promote movement abilities, navigational abilities, or social skills in children with cerebral palsy, acquired brain injury, or other disabilities. Research evidence is emerging rapidly in the field of virtual reality for therapeutic uses. A number of recent reviews published in peer-reviewed journals have summarized the current evidence for the use of Virtual Reality within pediatric and adult rehabilitation. One such review concluded that the field is potentially promising.
Implementation
To develop a real time virtual environment, a computer graphics library can be used as embedded resource coupled with a common programming language, such as C++, Perl, Java, or Python. Some of the most popular computer graphic libraries are OpenGL, Direct3D, Java3D, and VRML, and their use are directly influenced by the system demands in terms of performance, program purpose, and hardware platform. The use of multithreading can also accelerate 3D performance and enable cluster computing with multi-user interactivity.
Manufacturing
Virtual reality can serve to new product design, helping as an ancillary tool for engineering in manufacturing processes, new product prototypes, and simulation. Among other examples, Electronic Design Automation, CAD, Finite Element Analysis, and Computer Aided Manufacturing are widely utilized programs. The use of Stereolithography and 3D printing shows how computer graphic modeling can be applied to create physical parts of real objects used in naval, aerospace, and automotive industries, which can be seen, for example, in the VR laboratory of VW in Mladá Boleslav. Beyond modeling assembly parts, 3D computer graphics techniques are currently used in the research and development of medical devices for therapies, treatments, patient monitoring, and early diagnoses of complex diseases.
Urban design
3D virtual reality is becoming widely used for urban regeneration and planning and transport projects.