Whatever You Say, Happens: Live Creation of VR/AR Experiences
Moatboat is a way to create experiences in virtual reality and augmented reality using your voice. By saying sentences, you can create and control worlds and simulations. For example, you can create a small ecosystem by saying something like, “I want some wolves eating some sheep.” A scenario with wolves eating sheep will start happening in front of you. Unlike previous text-to-scene conversion research that focuses on placing geometry, we focus on adding layers of behaviors, relationships, and systems. Multiuser support plus a very tight user feedback loop allow multiple people to create together live. We outline our motivations, challenges, and how it works, with some specific examples and supporting videos.
Software engineer, game designer, and entrepreneur. Currently working on Moatboat, a simple way to create immersive experiences using natural language. My background is in video games, networked data synchronization, visual programming, developer tools, and productivity apps.
I created Simplenote, acquired by WordPress, where I became Head of Mobile. Before that I was an indie game developer and Senior Developer at Irrational Games, makers of BioShock.
Tue 24 OctDisplayed time zone: Tijuana, Baja California change
10:30 - 12:00 | |||
10:30 50mTalk | Keynote: Becoming Alive, Growing Up LIVE | ||
11:20 20mTalk | Toward a Live Stepper for Typed Expressions with Holes LIVE Cyrus Omar Carnegie Mellon University, Ian Voysey Carnegie Mellon University, Matthew Hammer University of Colorado, Boulder Pre-print | ||
11:40 20mTalk | Whatever You Say, Happens: Live Creation of VR/AR Experiences LIVE Mike Johnston Moatboat Pre-print Media Attached |