All Reality : Values , taxonomy , and continuum , for Virtual , Augmented , eXtended / MiXed ( X ) , Mediated ( X , Y ) , and Multimediated Reality / Intelligence

Humans are creating aworld of eXtended/Artificial Reality/Intelligence (AR, AI, XR, XI or EI), that in many ways is hypocritical, e.g. where cars and buildings are always “allowed” to “wear” cameras, but humans sometimes aren’t, and where machines sense our every movement, yet we can’t even understand how they work. We’re constructing a system of values that gives more rights and less responsibilities to AI (Artificial Intelligence) than to HI (Humanistic Intelligence). Whereas it is becoming common to separate the notions of IRL (In Real Life) and “Augmented” or “Virtual” Reality (AR, VR) into completely disparate realms with clearly delineated boundaries, we propose here the notion of “All Reality” to more holistically represent the links between these soon-to-be-outdated culturally accepted norms of various levels of consciousness. Inclusive in the notion of “All Reality” is also the idea of “ethically aligned reality”, recognizing values-based biases, cultural norms, and applied ethics of the creators of technology. As a new field of study, All Reality is multidisciplinary. We must consider not just the user, but also how the technology affects others, e.g. how its physical appearance affects social situations, and how sensor-based reality (e.g. wearable and implantable cameras in the smart city) affects privacy, security, and trust. All Reality includes Virtual Reality (VR), Augmented Reality (AR), X-Reality (XR), X-Y Reality (XYR), and Mixed, Mediated, etc. realities (MR). It also includes realities that come from nature itself, allowing us to directly experience real (but otherwise invisible) phenomena, such as wave propagation and wave interference patterns, so that we can see radio waves and sound waves and how they interact with objects and each other. This expands our capacity to understand our world beyond synthetic realities to include also phenomenal/phenomenological realities and blends between synthetic and phenomenal realities. By showing the evolution and diversity of the various technologies in the Mediated Reality space, we demonstrate why “ethically aligned reality” is a critical element of All Reality, governing not just AI in its oftentimes reductionist and computationalist applications, but in the wider opportunities of its more holistic usage incorporating HI (Humanistic Intelligence) and the realities of our natural environment, i.e. phenomenal reality (Φ R). . . Note to reader: This paper includes a summary of some of the material in https://arxiv.org/pdf/1804.08386.pdf [39]. VR 1938 AR 1968 XR 1991 Virtual reality Aug. reality Phenomenal reality Xreality X-Y reality MiXed reality Mediated reality XYR 1994 MR 1994 ΦR 1974 All reality 2018 Quantimetric reality QR 1996 All R * ( R) Figure 1: Realities Timeline: from VR to All R D is k a n d E a rt h p ic tu re s a re f ro m W ik im e d ia C o m m o n s M ix e r a d a p te d f ro m R o la n d E d ir o l V -4 P io n e e r D G M -2 5 0 -K , a n d L is to n 1 2 M X 2 0 0 -U S B