Proposal

Narrative

This tech-fee proposal is to purchase hardware and software that will support School of Communication & Multimedia Studies (SCMS) undergraduate/graduate courses and research projects related to Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and motion capture (mocap) animation production for games. This is part of an initiative to make sure our SCMS labs on the Davie campus are equipped with the latest technology for VR-AR-MS and games-animation production, so that students will be competitive for industry internships and jobs, especially with local companies like Magic Leap and Noitom. SCMS serves more than 1,200 students in two undergraduate degree programs, Communication Studies and Multimedia Studies (MMS), as well as a graduate MFA degree in Media, Technology, and Entertainment (MTEn). Media and entertainment, a $660Bil industry in 2017 that is predicted to grow to $792Bil by 2022 [1], with the most growth in VR/video games/e-sports with AR-MR surpassing VR by 2021 [2]. Animation, an important component of both games and VR, is expected to grow to $404Bil by 2023 [3]. Our graduates should be leaders in these high-tech creative industries, especially with companies like Magic Leap located only a few miles from the Davie campus. In October, SCMS faculty were invited by the Associate Provost for Broward Campuses to a keynote by Magic Leap’s VP of People, where we discussed internships and becoming a development site. Another local tech-company, Noitom, has offered mocap and VR internship projects [4]. This tech-fee will enable faculty to integrate advanced tech into our multimedia curriculum so that our students can compete for internships and jobs with students from other regional universities that have already begun adopting it [5]. Please see reference links under Sustainability section.

Facilities

I do not anticipate any facility accommodations beyond faculty/staff storing and maintaining the hardware and OIT installing the new software on some machines in ES 402 and 411. This proposal augments the Tech Fee “SCMS VR Upgrade for Multimedia Studies Labs” approved last year as submitted by Multimedia Studies (MMS) faculty Prof. Joey Bargsten and Prof. Francis McAfee. The hardware and software in this tech fee will complement the VR headsets and 360 AR cameras bought last year, and available for student use in SCMS computing labs housed on the fourth floor of the Education and Science building in rooms ES 402 and ES 411. The MTEn grad-lab in room ES 402 has a locked cabinet to secure VR-AR-MR headsets, mocap suits, and AR projectors. The hardware in this grant will be catalogued and maintained by SCMS with other technology stored in the ES 402 graduate lab and will be used with the laptops bought through last year’s tech fee that fulfill minimum system requirements for running VR technology. This tech-fee will provide two different sizes of Magic Leap One MR-headsets, one Noitom Perception Neuron-Pro mocap suit and one set of Hi5 VR gloves, one Lightform LF1 AR-spatial projection system with a dedicated high-lumens Epson projector, Leapmotion VR hand camera and Reallusion Motion Capture software, HTC Vive Trackers, and Quixel software for advanced 3D texture mapping (Totaling = $14,018.53). With taxes, shipping, and maintenance fees, we are requesting a total of $15,000 for this VR-AR-MR-Mocap upgrade to support MMS courses in interactive media, computer animation, and video game design which are taught in the Education and Science building on the Davie campus. The hardware and software in this tech-fee will be used in my 3D Production for Interactivity (DIG 6547), Video Game Design (DIG 4930), Advanced 3D Computer Animation (DIG 3306/MMC 6931), and Interactive Interface Design (DIG 6605) courses, among others.

Hardware Requirements

Noitom Neuron Perceptron Pro Motion Capture Suit ($4,108.98 - https://neuronmocap.com/content/product/perception-neuron-pro ): Mocap system will be used to create character animation in DIG 3306/MMC 6931, game assets in DIG 6547 and 4930, and VR research with the HTC Vive and Noitom Hi5 gloves in DIG 6605. Noitom Hi5 VR Gloves ($999 - https://www.hi5vrglove.com/store ): SCMS faculty were given an impressive VR demo using Neuron Perceptron, HTC Vive and Ni5 gloves. Gloves are for immersive full-body VR research projects in DIG 6605. HTC Vive Trackers ($222.56 for two - https://www.vive.com/us/accessory/ ): Two trackers will allow us to design more immersive VR experiences in DIG 6605. Leapmotion Universal VR Dev Bundle ($178 for two - https://store-us.leapmotion.com/ ): Can be mounted on our VR headsets to use computer vision tracking software to capture finger data for games and research in DIG 6547, 4930, and 6605. Magic Leap Mixed-Reality Headset and peripherals ($5,580 for two sizes - https://www.magicleap.com/magic-leap-one ): Headset uses retinal scanning to create a new MR experience, so headset fitting matters. We will buy two sizes for use in games-based research projects in DIG 6547, 4930, and 6605. Lightform AR Spatial Projection hardware ($699 - https://lightform.com/buy-now ): Camera connected to projector uses computer vision to scan and map 3D objects so projected animation interacts with the surface. Will be used in DIG 3306 and 6547. Epson HC 1450 projector for AR installations ($1,358 - https://www.cdwg.com/product/Epson-Home-Cinema-1450-3LCD-projector-LAN/4476609 ): Dedicated high-lumens projector to be used with Lightform for spatial projections in DIG 3306 and 6547. Projector stand and tripod for AR installations ($39.99 - https://www.amazon.com/gp/offer-listing/B079DNGNGQ/ref=dp_olp_new_mbc?ie=UTF8&condition=new ): Dedicated portable projector stand and tripod to be used in DIG 3306 and 6547 with the Lightform and Epson.

Software Requirements

The following software should work on the operating systems being used on machines in ES 402 and 411. Most of the critical software subscriptions used in the MMS labs are being addressed through other complimentary tech-fee proposals SCMS faculty are submitting this year, such as the Adobe CC licenses that include Photoshop, Premiere, and After Effects. Other software that is critical to VR-AR-MS and games production is either open-source (Unity 3D game engine), or secured through an academic grant with the company (Autodesk Maya, and MotionBuilder). While Unity is the main software used for developing interactive media, and Autodesk software is primarily used for creating 3D animated assets, the following programs will be used to augment our ability to produce animation and texture maps for MMS courses taught in ES 402 and 411. Reallusion Motion Live for IClone 7/3D Exchange Bundle ($599 - https://store-us.leapmotion.com/products/reallusion-motion-live-for-iclone-7-bundle ): Software to be installed on a VR-capable laptop in ES 402 and used with Noitom and Leapmotion mocap hardware for creating character animation in 3D Production for Interactivity (DIG 6547), Video Game Design (DIG 4930), Advanced 3D Computer Animation (DIG 3306/MMC 6931), and Interactive Interface Design (DIG 6605) courses. Quixel Suite 2 3D Texturing Photoshop plugin (six licenses for $234 - https://quixel.se/suite2/ ): Plugin software to be installed in ES 411 for texturing 3D models in Adobe Photoshop to support projects in 3D Production for Interactivity (DIG 6547), Video Game Design (DIG 4930), Advanced 3D Computer Animation (DIG 3306/MMC 6931), and Interactive Interface Design (DIG 6605) courses.

Personnel Costs

SCMS faculty and staff will store and maintain hardware in ES 402 and 411, and OIT will administer software updates and drivers, so no extra personnel costs are anticipated.

Other Costs

We are adding $981.47 for anticipated taxes and shipping of hardware that we don't have an exact quote for at this time, and maintenance fees.

Timeline

Nov 15, ‘18 — Tech Fee proposal submitted Jan 1, ‘19 — Approvals Completed Feb - Mar ‘19 — Awards Announced Mar - Jul ‘19 — Hardware purchasing and disbursement Jul – Aug ‘19 — Begin upgrading labs and installing equipment; begin testing and creating interactive media demos using the new hardware and software. Aug ‘19 — Upgrades/Installations complete in MMS labs ES 402 and 411 Sep ‘19 — Demos of new hardware and software complete for use in courses, and presentations scheduled in the College of Arts and Letters, the College of Engineering/Computer Science, and in the Office of Undergraduate Research and Inquiry; Call for Collaborations.

Sustainability

The hardware and software in this tech-fee will allow us to upgrade our MMS labs with new media technology that is at the center of the VR-AR-MS-Game design paradigm. It will allow our faculty and students to become content developers for local companies that offer internships and jobs in a high-tech high-wage field, which fulfills some of our State University System’s overall placement goals. This technology can also be used for presentations and research, such as using AR to enhance undergraduate research posters, and MTEn grad-students working with faculty in SCMS, Computer Science, Education, and others on developing NSF and NEH research projects. As an example, I am currently collaborating with Prof. Daniel Raviv (Computer Science) and Prof. Nancy Romance (Education) on an NSF research grant to design and develop a VR-AR game that will help teach 6th graders physics in the classroom. In addition, this tech-fee is in alignment with CAL and Broward campus-level initiatives and outreach to develop our Davie campus through community partnerships with tech companies like Magic Leap, as well as an OIT-Instructional Technologies interdepartmental initiative to develop FAUs capabilities in VR-AR-MS research. Narrative reference links: [1] https://www.cmo.com/features/articles/2018/6/12/5-industry-trends-shaping-the-future-of-media-and-entertainment.html#gs.TisJ0go [2] https://venturebeat.com/2018/10/19/superdata-oculus-quest-will-mainstream-vr-in-2019-but-ar-will-lead-by-2021/ [3] https://www.businesswire.com/news/home/20180426006065/en/Global-Animation-Market-Analysis-Forecasts-2018-2023-- [4] https://www.noitom.com/solutions/project-alice [5] https://news.miami.edu/stories/2018/11/enter-the-magicverse.html

Resource Matching

Personnel in SCMS will negotiate software and hardware costs, obtain quotes, and initiate purchases. Personnel in CAL will create purchase orders and oversee them to Purchasing. OIT will assist in software installation and networking.

Implementing Organization

SCMS in CAL; OIT