Intelligent Realities For Workers Using Augmented Reality, Virtual Reality and Beyond
driving virtual overlays of his view. As he
decides on next steps, he can communicate
with appropriate management systems
through that same HMD without having to
pull out a phone or laptop. As a wearable
computer, the HMD brings distant resources
in to the worker’s operational reality.
traditional user interface technologies. This
new paradigm is introduced here to help
decision makers and architects navigate the
expansive terrain of technologies that can
enable intelligent realities for workers. First,
the XR space is overviewed along with more
traditional mobile and desktop flat screens.
This leads to the consideration of intelligent
reality architecture and the development of
intelligent reality applications. From there,
specific use cases are proposed that exercise
combinations of reality presentation
technologies, IoT and AI.
An intelligent reality may be proximate to a
worker, like a machine on a factory floor. Or
that factory might be half way around the
world and understood by the user through
3D modeling of the factory. AR or VR
headsets may be involved, but do not have
to be – smart phone screens or flat screens
on a desktop may be a better option. The
worker may be mobile and use an AR head
mounted display or smart phone, or the
worker may be stationed in a command
center at the company headquarters. They
may be observing a reality in real time, or
they may be performing data-driven review
of an event that occurred in the past. In all
cases, though, the context dominates – both
visually and in the design of the
presentation.
T HE R EALITY -V IRTUALITY
C ONTINUUM AND M ODERN
E X TENDED R EALITY
In 1995, Paul Milgram et al published a paper
“A Taxonomy of Mixed Reality Visual
Displays”, which introduced the Reality-
Virtuality Continuum. 4 This paper remains
useful for discussing the current state of XR
as well as considering the role of mobile and
stationary flat screens. Figure 1 illustrates
the continuum between purely physical
reality and purely virtual.
Intelligent reality can be achieved today with
off-the-shelf technologies spanning IoT,
analytics, XR technologies, and more
4
P. Milgram et al., “Augmented Reality: A class of displays on the reality-virtuality continuum,” Proceedings Volume 2351,
Telemanipulator and Telepresence Technologies, Dec 1995. Available:
http://etclab.mie.utoronto.ca/publication/1994/Milgram_Takemura_SPIE1994.pdf
- 3 -
March 2019