Category Archives: Augmented Reality / Apps

Augmented reality is computer vision with helps us create apps that understand the outside world. We like to use AR features to provide educational content and helpful information to people.

Action RPG Prototype Released

Streamfall.4 was just released to the Apple App store.

Find it here on your iOS device.

The app is a combat prototype which shows archery and the basics of melee combat as well as the camera system.



Many thanks to those who’ve contributed in some way!

  • Charles Gruenert
  • Chris Tran :
  • Michelle Routt
  • Gabriel Cordero
  • Meggie Rock
  • Darsyn Irwin
  • Hanah Harris

Road Map

  • Demo with tutorial, mini-story, and refined gameplay
  • Better lead for archery
  • Lewt
  • Multiplayer/local co-op support?
  • Team formations and strategic pc play
  • Deep magic system
  • Randomly generated environments
  • Episodic story with linear and non-linear elements
  • All-new character models
  • Shield and blocking system
  • Android, iOS, other touch-based systems
  • Enemies with fun combat ai
~ feedback please ~


Pokemon Go and Education

“Gee offered the observation that, though the USA had long suffered from a stubborn academic achievement gap between poor minority children and white middle-class kids, he knew of no “Pokémon gap.” – USAToday

Update! With new ‘native’ AR APIs for Android and iOS for single camera devices, we’ll be seeing these tools get better and better, and with more battery life. BTW, Unity3D has a plugin for the iOS ARKit and will surely have an Android version soon.

The devices are ubiquitous. And behind closed doors and walled off areas, educational opportunities abound. For developers such as myself who want to help educate and perhaps make the world a better place outside of the trouble riddled world of public education, producing an augmented reality approach to education seems to be an obvious route.

Pokemon Go smartly generates content around the globe algorithmically. I need to think about how such a thing could be done for content that is very particular to the location. Wouldn’t it be great if user generated content could come into play here?

Some ideas :

  • Historical markers and other points of interest could be augmented to show speeches and moments along the timeline where important things occurred. How could that be user generated?
  • Layers of rock in a cliffside could be augmented to show the layer where the KT event occurred and show the abundance of life before and the relatively quiet period after.
  • Outside of an electronics station or power plant, students can learn about the insides of the plant and satisfy their interests about how power is produced there.
  • Hooking up with a site like Coursera would allow course content to be developed around a single topic which would be augmented to show meaningful real-world things and how they work.

Problem points

  1. The devices which are ubiquitous have capability for image tracking, imprecise gps, and an IMU. Pokemon GO likely has an accuracy of around 9 meters. This isn’t good enough for pinpointing interesting things. Notice – in GO, you can’t walk around a Pokemon. This is because the tracking is poor – likely something like a Vuforia user generated image target, which gives loose tracking to whatever is in front of the camera. These image targets are shareable but are likely very hard to reproduce. Lets say a person takes a snapshot of a rock formation. That image target uses points of contrast (or perhaps a SLAM approach, which is a combo of GPS + CV Changes to the environment such as lighting or plant growth would dramatically make such a thing hard to place. Pokemon did it right though.. a gps coord + a loose tracking may just work.  (edit – this is no longer the case, as SLAM tracking has gotten really good!)
  2. Too much content. We are talking about a world worth of content. Server infrastructure alone could break this (this is likely workable..). However, developing content for this as a studio would be impossible.  So user generated content is likely the only way to go!

I want to think more on this. Please stay tuned.



Universal Gravitation for Science Education

This is the first iteration of what could be an interactive and fun piece demonstrating one of the most important concepts in Physics.

The force of gravity exists everywhere in the universe. This simulation shows what a bunch of particles might look like if there were nothing more massive nearby.

This was an interesting technological challenge for me because these particles are not Unity3d GameObjects. They are actually Particle Renderer particles, being cached every Update(), are then calculated (hundreds of calculations per frame), then at the end of the frame – offset based off of the calculation, then pushed back into the ParticleRenderer’s array of particles. The amount would not be possible otherwise.

I’d like to do this on either a massive scale, with the viewer watching it as they please from different scales. Or, using an astronomy database (with a limited sample), then sped up to watch the universe do its thing. I think this would a really great thing to see in a classroom or a museum.

Looking forward to working on this more.

*To view demo below, please use a browser other than Chrome.

New WebGL Version can be found here!


SmartPark Garage in Houston, TX

To view a demo of the project, please click here

Username: Admin | Password: adminpassword


screenshot2This is a preliminary offering of an interactive parking garage. Intended to be used as a larger system, this particular piece would be used for parking attendants and could be used to great affect in places like hotels.

This was somewhat challenging to build because of the amount of draw calls. Not to mention the sheer amount of parking spaces to distribute.

Bryan was primarily in charge of bringing all the elements together, and coding, while Michelle handled UI design and implementation in Unity 3D. The 3D models were provided from a sub-contractor on the project.



screenshot1_v2 smartpark_screenshots_parkingspots_v2