Nicolas Heess

Ph.D

DeepMind

Show Academic Trajectory

Ego Network

D-Core

Research Interests

Author Statistics

Experience

Education

Bio

On his academic page, Heess states he is interested in understanding information processing in the brain.

Papers133 papers

Sort

By YearBy Citation

Divide-and-Conquer Monte Carlo Tree Search For Goal-Directed Planning

Parascandolo Giambattista,Buesing Lars,Merel Josh, Hasenclever Leonard, Aslanides John,Hamrick Jessica B.,Heess Nicolas, Neitz Alexander,Weber Theophane

Cited by1Bibtex

CoMic: Co-Training and Mimicry for Reusable Skills

Leonard Hasenclever, Fabio Pardo,Raia Hadsell,Nicolas Heess,Josh Merel

international conference on machine learning, (2020)

Bibtex

Catch & Carry: reusable neural controllers for vision-guided whole-body tasks

Josh Merel, Saran Tunyasuvunakool,Arun Ahuja,Yuval Tassa, Leonard Hasenclever, Vu Pham,Tom Erez,Greg Wayne,Nicolas Heess

ACM Trans. Graph., no. 4 (2020): 39

EIBibtex

Keep Doing What Worked: Behavior Modelling Priors for Offline Reinforcement Learning

Noah Siegel,Jost Tobias Springenberg,Felix Berkenkamp,Abbas Abdolmaleki,Michael Neunert, Thomas Lampe, Roland Hafner,Nicolas Heess,Martin Riedmiller

ICLR, (2020)

EIBibtex

Counterfactual Credit Assignment in Model-Free Reinforcement Learning

Thomas Mesnard,Théophane Weber, Fabio Viola, Shantanu Thakoor, Alaa Saade,Anna Harutyunyan,Will Dabney, Tom Stepleton,Nicolas Heess,Arthur Guez, Marcus Hutter,Lars Buesing

Bibtex

Behavior Priors for Efficient Reinforcement Learning

Dhruva Tirumala, Alexandre Galashov,Hyeonwoo Noh, Leonard Hasenclever,Razvan Pascanu, Jonathan Schwarz,Guillaume Desjardins,Wojciech Marian Czarnecki,Arun Ahuja,Yee Whye Teh,Nicolas Heess

Bibtex

V-MPO: On-Policy Maximum a Posteriori Policy Optimization for Discrete and Continuous Control

H. Francis Song,Abbas Abdolmaleki,Jost Tobias Springenberg, Aidan Clark,Hubert Soyer, Jack W. Rae, Seb Noury,Arun Ahuja,Siqi Liu, Dhruva Tirumala,Nicolas Heess, Dan Belov

ICLR, (2020)

Cited by16EIBibtex

Catch & Carry: reusable neural controllers for vision guided whole body tasks

Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne,Nicolas Heess

ACM Transactions on Graphics (TOG), no. 4 (2020): 39: 1-39: 12

Cited by4Bibtex

Robust Constrained Reinforcement Learning for Continuous Control with Model Misspecification

Daniel J. Mankowitz,Dan A. Calian, Rae Jeong, Cosmin Paduraru,Nicolas Heess, Sumanth Dathathri,Martin Riedmiller,Timothy Mann

Bibtex

Learning Dexterous Manipulation from Suboptimal Experts

Rae Jeong,Jost Tobias Springenberg, Jackie Kay, Daniel Zheng, Yuxiang Zhou, Alexandre Galashov,Nicolas Heess, Francesco Nori

Bibtex

A Generalized Training Approach for Multiagent Learning

Paul Muller,Shayegan Omidshafiei,Mark Rowland,Karl Tuyls,Julien Perolat,Siqi Liu,Daniel Hennes, Luke Marris,Marc Lanctot,Edward Hughes,Zhe Wang, Guy Lever

ICLR, (2020)

Cited by9EIBibtex

Local Search for Policy Iteration in Continuous Control

Jost Tobias Springenberg,Nicolas Heess,Daniel Mankowitz,Josh Merel, Arunkumar Byravan,Abbas Abdolmaleki, Jackie Kay,Jonas Degrave, Julian Schrittwieser,Yuval Tassa,Jonas Buchli, Dan Belov

Bibtex

Critic Regularized Regression

Ziyu Wang,Alexander Novikov,Konrad Zolna,Josh Merel,Jost Tobias Springenberg,Scott Reed,Bobak Shahriari, Noah Siegel,Caglar Gulcehre,Nicolas Heess,Nando de Freitas

NeurIPS, (2020)

EIBibtex

RL Unplugged: A Collection of Benchmarks for Offline Reinforcement Learning

Ziyu Wang,Caglar Gulcehre,Alexander Novikov, Thomas Paine, Sergio Gómez,Konrad Zolna, Rishabh Agarwal,Josh Merel,Daniel Mankowitz, Cosmin Paduraru,Gabriel Dulac-Arnold, Jerry Li

NeurIPS, (2020)

EIBibtex

Continuous-Discrete Reinforcement Learning for Hybrid Control in Robotics

Neunert Michael,Abdolmaleki Abbas,Wulfmeier Markus, Lampe Thomas,Springenberg Jost Tobias, Hafner Roland, Romano Francesco,Buchli Jonas,Heess Nicolas,Riedmiller Martin

CoRL, pp.735-751, (2020)

Cited by2EIBibtex

Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D Sokoban

Peter Karkus,Mehdi Mirza,Arthur Guez, Andrew Jaegle,Timothy Lillicrap,Lars Buesing,Nicolas Heess,Theophane Weber

Bibtex

Learning to swim in potential flow

Yusheng Jiao, Feng Ling, Sina Heydari,Nicolas Heess, Josh Merel,Eva Kanso

Bibtex

Value-driven Hindsight Modelling

Guez Arthur,Viola Fabio,Weber Théophane,Buesing Lars,Kapturowski Steven,Precup Doina,Silver David,Heess Nicolas

NeurIPS, (2020)

EIBibtex

Physically Embedded Planning Problems: New Challenges for Reinforcement Learning

Mehdi Mirza, Andrew Jaegle,Jonathan J. Hunt,Arthur Guez, Saran Tunyasuvunakool, Alistair Muldal,Théophane Weber, Peter Karkus,Sébastien Racanière,Lars Buesing, Timothy Lillicrap,Nicolas Heess

Cited by1Bibtex

Importance Weighted Policy Learning and Adaption

Alexandre Galashov, Jakub Sygnowski, Guillaume Desjardins, Jan Humplik, Leonard Hasenclever, Rae Jeong,Yee Whye Teh,Nicolas Heess

Bibtex

View All

Base Info Papers Patents Projects