Automatic discovery of concepts and actions.

•Our method ADC simultaneously discovers relational concepts and learns behaviors.•ADC automatically constructs its representation of the environment by exploration.•ADC introduces novel mechanisms to automatically drive its own learning process.•Knowledge incrementally learned by ADC in a task can be re-used in other tasks.•Knowledge representation used in ADC is easy to understand by humans.