Physics-informed models of domain wall dynamics as a route for autonomous domain wall design via reinforcement learning

Understanding the dynamics of domain walls in ferroelectrics is critical both for fundamental reasons of studying interfacial dynamics in disordered media, as well as practical engineering of metastable states with enhanced properties. Piezo response force microscopy (PFM) enables both imaging and writing of ferroelectric domain walls via a biased scanning probe. However, control over positioning of individual domain wall segments to engineer domain wall structures over large areas reproducibly, and particularly, quantification of associated mechanisms remains challenging. Here, we present a reinforcement learning based experimental workflow deployed on an autonomous PFM platform that enables automated data collection of domain walls interacting with pinning sites. The autonomous experiment is used to construct a physics-informed surrogate model of local domain wall response in response to applied electric fields by the PFM tip in prototypical (110) PbTiO3 thin films, and the results are further verified using phase-field simulations. The surrogate enables generation of ‘phase diagrams’ of the domain wall, conditional on initial structure. Subsequently, reinforcement learning is used to optimize tip-modification trajectories for obtaining desired domain wall structures in simulated environments utilizing the surrogate model for the environment dynamics. This workflow shows how automated data collection and autonomous agents can be orchestrated towards realizing domain wall manipulations with precision in scanning probe studies, and how such surrogates can aid in understanding domain wall interactions in ferroelectrics.