I'm a graduate student at Brown University studying machine learning and decision making. This past year I spent doing a Pre-doc at Microsoft Research on RL and researching autonomous vehicles.


In school, I published research with the self-driving car lab, took many graduate-level seminars focusing on ML, and was a TA for deep learning. Some of my academic projects include: an RL agent that learns skills in Minecraft using emotion detection as feedback, a GAN that can reconstruct images of faces with up to 80% of the pixels missing, and a state-of-the-art actor-critic network to play Atari games using RL. As a TA for the first iteration of Brown's graduate-level deep learning course, I designed a lab and gave a guest lecture on implementing sequence-to-sequence machine translation. For research, I've worked on imitation learning, multi-agent game theory, and deep RL with Michael Littman's self-driving car lab. (Some of our work has gained publicity and other work will be published in the International Conference on Social Robotics.)


In industry, I've worked at Microsoft, Lyft and Adobe, in addition to several smaller companies. Most recently, I completed a Pre-doc at Microsoft Research with Katja Hofmann on long-term memory in RL. I wrote a paper on this work, as first author, accepted to ICLR 2020. At DeepScale, acquired by Tesla, I worked on perception for autonomous vehicles, developing novel methods for instance segmentation. At Lyft I designed a framework for solving sequential decision making problems with MDP's, including writing a special case solver for an MDP specific to autonomous vehicles at stop intersections. At Adobe I designed neural nets to forecast marketing data. I also worked at a robotics startup on both software and hardware, and co-created Food with Friends (an iOS app) several years ago.


Currently, my research interests include multi-agent RL, meta-learning, memory, human feedback, and learning without exploration. I am also interested in autonomous vehicles and healthcare applications, but I'm really open to any area where I can work on important, challenging problems. When a problem grabs me, I can't stop thinking about it until it's solved. Please see Portfolio or GitHub for a sample of my work!

Jacob Beck

Email: JakeABeck@gmail.com