Proposal

Narrative

Computer simulations expand architects’ ability to design in ways that go beyond representation, including environments which affect decision making or feasibility. Besides building performance simulation (structural-environmental simulation), advancement has been made in combining physical and virtual space through Augmented Reality technology. AR allows immersion into virtual environments where users experience and interact with pre-determined digital models. Building on this, architects are inventing tools to customize the interface between virtual and physical, allowing the uploading and editing of tailored environments inside the AR mode. Our department recently acquired AR equipment and has begun investigating ways to integrate this in design workflows, using the Microsoft Hololens platform. The faculty member who obtained the initial funds is leaving FAU, and additional funding is required to further pursue this work vis-à-vis the emergence of new advances in AR. As we obtained access to a just-released software (Fologram) which interfaces between the Digital 3D model in Rhinoceros® environment and the Hololens through Parametric modeling script (Grasshopper®), this proposal requests funds to secure licenses of Fologram as well as getting additional headsets. We will then have the ability to teach a research seminar where students work directly in Microsoft Hololens environment within a class. This opens substantial opportunities for cross-disciplinary collaboration (iSENSE), exploration of space evaluation, real-time design editing and improvement of construction constraints and assembly. Possible innovative applications include: 1. Urbanism: Immersion in full-scale spaces to assess factors like light, density, human-building relationships. a. Fabrication: Use of AR simulated model to guide the assembly of blocks to create a building vault or more complex configuration in 3-dimensional space b. Neuroscience: Assessment of user experience in AR environments

Facilities

The project does not require additional facilities. The School of Architecture has several open presentation spaces. The headsets will be used in various environments as necessary, including the design studio, if we manage to acquire enough headsets to teach a small elective course where students have direct access to the equipment.

Hardware Requirements

Total cost estimate: $16,500 - Microsoft Hololens: $3,000 (Development Edition: Quantity: 5 headsets = $15,000)** - AR technology develops very fast so at the time of purchase we will also consider latest developments in the field (i.e. Magic Leap Technologies, Miami VR Expo Community) **5 headsets will allow The Hololens headset allows a portable immersion in a virtual environment at various scales. It is designed for comfort and integrates all necessary features within a wearable wireless environment. Its ease of use and ongoing product development by Microsoft allows users to create their own apps, expanding the potential of its applications indefinitely. https://www.microsoft.com/en-us/hololens/hardware Specifications: CPU Intel 32 bit architecture HPU Holographic processing unit Memory 2 GB Storage 64 GB Flash Display 2 HD 16:9 light engines Resolution Holographic resolution: 2.3M total light points Pixel Density Holographic density: over 2.5k radiants (light points per radian) Refresh Rate 240Hz (60Hz content rate, each frame consists of four sequential colors: RGBG) Persistence 2.5ms Field of View 30°H and 17.5°V Optics See-through holographic lenses (waveguides) Tracking 6DOF Rotational Tracking Gyroscope, Magnetometer, Accelerometer Positional Tracking Depth Camera with 120°×120° FOV, 4 greyscale cameras Latency Motion to Photon: less than 2ms Audio Built-in speakers, Audio 3.5mm jack Camera 2MP photo / HD video camera, depth camera, 4 greyscale cameras Sensors ambient light sensor, array of 4 microphones Input Gaze, Gesture, Voice, HoloLens Clicker, Keyboard, Mouse Connectivity WiFi, Bluetooth Power Battery (2.5 to 5.5 hours per charge) Weight 579g Cable Length Wireless

Software Requirements

Total cost estimate: $7,500 - 5 licenses of Fologram for Augmented Reality in Rhino: $7,500 annually https://fologram.com - Other software that becomes available for testing Purchase Options: a. 1 year subscription, Floating license: $125 /month per headset ($ 1,500 USD billed annually) b. 3 year subscription, Floating license: $83 /month per headset ($ 3,000 USD billed every 3 years) The advantage of Fologram is its interface with Parametric Platform Grasshoper® which is a free plugin for Rhino 3D software, already available in the School of Architecture. Grasshopper incorporates several specializes simulation engines which have been developed by the department of Energy (Radiance, Butterfly), and have been tested in the past.

Personnel Costs

Total RA salary for 2 semesters: $4,800 We have so far used students' assistance in the project, and their work has been presented at the FAU research symposium. Hiring two research assistants (1/4: 10 hrs a week or 1/3: 13 hours/week) will be necessary to assist with implementing various design scenarios, establishing a pedagogical protocol for a specialist course and developing custom scripts/apps for pushing the limitation of this technology. We would request their assistance for at least 2-4 semesters, until the class is offered. RA salary: 10 hours /week x 12 weeks = $1,200/ semester per RA

Other Costs

The dissemination of our current work but also an understanding of current advances in the field of AR and specifically, its relationship with Design and Architecture will require exposure to research venues like specialist conferences and workshops, offering demonstration of technologies and training. The “Teaching with Technology” events organized by FAU are an ideal context for this type of discussion among faculty from various departments and allow the students to observe research across the university, promoting further collaboration and discussions for identifying funding prospects. Another suitable venue, where the project owner has participated in the past is the annual conference on “Tangible, Embedded and Embodied Interaction”, to be hosted in Tempe, AZ in spring 2019, with more upcoming venues in the near future. We would like to allow participation (1 faculty and 1 RA’s) and attendance of one or two workshops (estimated at $1,500/person/workshop including registration, transportation and accommodation). Total Travel/Training cost for 2 people: $3,000

Timeline

Based on our current limitations with regards to software availability, funds are necessary to continue the development of this research. While ongoing, faculty will organize current results in spring of 2019 and begin during the following academic year or as soon as funds allow the purchase of more headsets and Fologram licenses. The goal of the project will be designing a new elective course for academic year 2019-2020 using AR technology combined with parametric tools and digital fabrication.

Sustainability

This emergent technology has a wide range of applications which overlap with other academic disciplines. The complexity of programming to create custom apps to further enhance AR’s interface with design platforms requires some external consultation with faculty and graduate students from Computer Science and/or Multimedia Design. This is very much aligned with the University’s Pillars and Platforms initiatives which promote research and collaboration across departments and Colleges. Furthermore, the school of Architecture is currently looking to hire new faculty with expertise in environmental simulation, who could support and provide support wit this project. A letter of support by Associate Professor Mate Thitisawat is available upon request. He has already begun work with this technology and we are currently collaborating on identifying prospective applications in design workflows. As he is departing from the university, I would like to continue this work.

Resource Matching

The expansion of our resources on this kind of technology can substantially support several projects previously begun with alternate funding; for example, invesigations begun during a project on Performative Parametric Design, funded by an NCARB award (2013 National Council of Architectural Registration Boards Award). Within the overall School of Architecture context, there is a limited budget for lecture series. We propose to invite experts in the field of Architectural Computation whose works were developed using similar or comparable technology to give a lecture. This will increase opportunities to create a connection with other institutions and educate our students about this emergent technology that will shape part of our profession in the future.

Implementing Organization

FAU School of Architecture FAU College for Design and Social Inquiry