In this talk, I will explore the four major technical problems to solve in VR/AR/MR, namely (i) Display resolution high enough not to see visible pixels, (ii) Latency (from motion to photons) to avoid dizziness, (iii) Tracking (with enough precision) so that manipulation and registration is satisfactory, (iv) Vergence-accommodation conflict inherent to all stereoscopic displays. I will also explain the current state of the art technologies, and use two case studies to show potential solutions in order to deal with above problems. The two case studies are:
1. CatAR: A Novel Stereoscopic Augmented Reality Cataract Surgery Training System
We propose CatAR, a novel stereoscopic augmented reality (AR) cataract surgery training system. It provides dexterous instrument tracking ability using a specially designed infrared optical system with 2 cameras and 1 reflective marker. The tracking accuracy on the instrument tip is 20 μm, much higher than previous simulators. Moreover, our system allows trainees to use and to see real surgical instruments while practicing. Five training modules with 31 parameters were designed and 28 participants were enrolled to conduct efficacy and validity tests. The results revealed significant differences between novice and experienced surgeons. Improvements in surgical skills after practicing with CatAR were also significant.
2. Stereoscopic 360。 Imaging
This report proposes a low-cost and portable polycamera system and accompanying methods for capturing and synthesizing stereoscopic 360。 panoramas. The polycamera consists of only four cameras with fisheye lenses. Synthesizing panoramas from only four views is challenging because the cameras view very differently and the captured images have significant distortions and color degradation including vignetting, contrast loss, and blurriness. For coping with these challenges, this paper proposes methods for rectifying the polyview images, estimating depth of the scene and synthesizing stereoscopic panoramas. The proposed camera is compact in size, light in weight, and inexpensive. The proposed methods allow the synthesis of visually pleasing stereoscopic 360。 panoramas using the images captured with the proposed polycamera.
Ming Ouhyoung received the BS and MS degree in electrical engineering from the National Taiwan University, Taipei, in 1981 and 1985, respectively. He received the Ph.D degree in computer science from the University of North Carolina at Chapel Hill in Jan., 1990. He was a member of the technical staff at AT&T Bell Laboratories, Middle-town, during 1990 and 1991. Since August 1991, he has been an associate professor in the department of Computer Science and Information Engineering, National Taiwan University. Then since August 1995, he became a professor. He was the Director of the Center of Excellence for Research in Computer Systems, College of Engineering, from August 1998 to July 2000, and was the Chairman of the Dept. of CSIE from August 2000 to July 2002. He was the associate dean of College of EECS (2012-2015). He has published over 100 technical papers on computer graphics, virtual reality, and multimedia systems. He is a senior member of ACM and member of IEEE.
The social revolutions have accompanied innovation of the view of the body. If we regard the information revolution as establishment of a virtual society against the real society, it is necessary to design a new view of body "JIZAI body (freedomated body)", which can adapt freely to the change of social structure, and establish a new view of the body. In this talk, we discuss how we understand of basic knowledge about the body editing for construction of JIZAI body (freedomated body) based on VR, AR and Robotics.
Masahiko (Masa) Inami is a Professor in the Research Center for Advanced Science and Technology at the University of Tokyo, Japan. He is also directing the Inami JIZAI Body Project, JST ERATO. His research interest is in Augmented Human, human I/O enhancement technologies including perception, HCI and robotics. He received BE and MS degrees in bioengineering from the Tokyo Institute of Technology and PhD in the Department of Advanced Interdisciplinary Studies (AIS) from the University of Tokyo in 1999. He joined the Faculty of Engineering of the University of Tokyo, and in 1999, he moved to the University of Electro-Communications. In April 2008, he joined Keio University, where he served as a Professor of the Graduate School of Media Design and the Vice-director of the International Virtual Reality Center till October 2015. In November 2015, he rejoined the University of Tokyo. His installations have appeared at Ars Electronica Center. He proposed and organized the Superhuman Sports Society.
Contemporary virtual imaging technology has demonstrated unprecedented detachment and alienation, and has completed the four steps of the simulacra world:
The first level is a projection of the magnificent real. The second level covers the magnificent real and varies its identity. The third layer makes this magnificent reality vanish. The fourth layer is completely out of touch with the so-called truth, and it is the most pure simulation.
The proliferation of "simulated" technologies has made human mind gradually keeaway from the essence of "experience". The hyperreal world is only constituted by the simulacra of self-referentiality. "Imitating" not only shows "not present" as "present" or makes the "imagining" as the "real", it further destroys the connection between anything and "reality". Within itself, it is no longer necessary to distinguish between "real" and "non-true." In this way, what is left is only the world constructed by the self-referentiality of "pure symbols" (without referential signifiers). In the future, the world represented by the symbolic content of computer images will be the true one. This reality not only replaces the original reality, but also surpasses it, completing the world of "hyperreality."
Ya-Lun Tao is a Professor in the College of Communication, National Chengchi University, Taiwan. He received the B.S. degree in the Department of Fine Arts, National Taiwan Normal University, Taiwan, R.O.C., in 1993, and the M.S. degree in the Institute of Plastic Art, Tainan National University of The Arts, Taiwan, R.O.C., in 1999. He was a lecturer in the Department of Fine Arts, National Chia-Yi University, and the Department of Communications Design, Shih Chien University, in 1999 and 2000, respectively. From 2003 to 2006, he was an Assistant Professor in the Graduate Program of Arts and Technology, Taipei National University of the Arts, and the Generation Education Center, Shih Chien University. He became an Assistant professor in Graduate Institute of Plastic Arts, Tainan National University of the Arts in 2006, and from 2007 to 2014 he was an Associate professor in the Department of New Media Art, Taipei National University of the Arts. He has ample experience of art exhibitions and has been awarded many honors, including the Taipei Prize of the Taipei Annual Arts Competition (1997), Contemporary Painting Creation Prize of the Li Chun Shen Foundation (1999), National Culture and Arts Foundation Grant (2000), and the Best New media Art installation of the MADATAC 09 AWARDS (2018).
Paper Submission Due: Jan 7, 2018
Final Decision to Authors: Jan 25, 2018
Demo Submission Due: Feb 12, 2018
Camera-Ready Due: Feb. 28, 2018
Early Registration Due: Mar. 7, 2018
Workshop Dates: Apr 13-17, 2018