Dehban, A; Jamone, L; Kampff, AR; Santos-Victor, J; (2017) A Deep Probabilistic Framework for Heterogeneous Self-Supervised Learning of Affordances. In: Proceedings of the 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). (pp. pp. 476-483). IEEE: Piscataway, NJ, USA.

Preview

Text adehban-humanoids2017.pdf - Accepted Version Download (2MB) | Preview

Abstract

The perception of affordances provides an action-centered parametric representation of the environment. By perceiving an object's visual features in terms of what actions they afford, novel behavior opportunities can be inferred about previously unseen objects. In this paper, a flexible deep probabilistic framework is proposed which allows an explorative agent to learn tool-object affordances in continuous space. To this end, we use a deep variational auto-encoder with heterogeneous probabilistic distributions to infer the most probable action that achieves a desired effect or to predict a parametric probability distribution over action consequences i.e. effects. Our experiments show the generalization of the method to unseen objects and tools and we have analyzed the influence of different design choices. Our framework goes beyond other proposals by incorporating various probability distributions tailored for each individual modality and by eliminating the need for any pre-processing of the data.

Download activity - last month

Export as CSVJSONXML

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item