Byte Tank

Deep Reinforcement Learning: Playing a Racing Game

Agent playing Out Run, session 201609171218_175eps
No time limit, no traffic, 2X time lapse

Above is the built deep Q-network (DQN) agent playing Out Run, trained for a total of 1.8 million frames on a Amazon Web Services g2.2xlarge (GPU enabled) instance. The agent was built using python and tensorflow. The Out Run game emulator is a modified version of Cannonball. All source code for this project is available on GitHub.

Compressed Deque

This post aims to give some insights about a recently open-sourced python deque which compresses its items for a decreased volatile and persistent memory footprint.

Attenuate GoPro Chest Mount Heartbeat - Using GarageBand/iMovie

If you have a chest mount (chesty) for your GoPro, then you might have had the surprise of hearing your heartbeat on the recording, since it may lay fairly close to your heart, picking up its beat. This post will:

  • show you how to attenuate the heartbeat sound to a point where it is almost imperceptible, while maintaining the overall sound
  • attenuate the difference between quiet and loud sounds, so the listener gets less startled by a sudden noise created when entering with the bike on rought terrain or the common bike bell sound.

Survival Ball on OUYA

Survival Ball in now available on OUYA, and its publishing process was fairly straightforward. From the day of submission (2nd of September) to its approval (5th of September), it took a mere 3 days, counting that a re-submission had to be made in-between.

Survival Ball was already available on Google Play, Amazon and Kongregate, but OUYA just felt like the perfect platform for the game. With it, you could just grab the OUYA controller and/or a spare XBox/PS3 controller, and just have a quick match. I really loved the concept, and re-iterated on the previous version of the game to give it more controller friendly menus, better graphics, refined textures, and an overall revamp.

Nordic Game Jam’s Winners

This year’s Nordic Game Jam was crowned as the world’s largest game jam with about 470 participants. The winners have been announced, and can see the full list here: http://nordicgamejam.org/2013/01/21/winners-ngj13/

My personal highlight goes to Stalagflight (https://dl.dropbox.com/u/85666/Stalagflight-web/webBuild.html), which is as simple as stupidly fun! Stalagflight can be played with the keyboard, but it is tricky. If you have a gamepad the experience is much better.