Pressure-tuned intralayer exchange in superlattice-like MnBi2Te4/(Bi2Te3)n topological insulators

The magnetic structures of the intrinsic magnetic topological insulator family MnBi2Te4(Bi2Te3)n (n = 0, 1, 2) adopt A-type antiferromagnetic (AFM) configurations with ferromagnetic (FM) MnBi2Te4 layers stacking through van der Waals interactions. While the interlayer coupling could be effectively tunned by the number of Bi2Te3 spacer layers n, the intralayer FM exchange coupling is considered too robust to control. Here, by applying hydrostatic pressure up to 3.5 GPa as an external knob, we discover the opposite responses of magnetic properties for MnBi2Te4(Bi2Te3)n with n = 1 and 2. In MnBi4Te7, the N\'eel temperature decreases with an increasing saturation field as pressure increases, indicating an enhanced interlayer AFM coupling. In sharp contrast, both the magnetic susceptibility and magneto-tranport measurements show that MnBi6Te10 experiences a phase transition from A-type AFM to quasi two-dimensional FM state with a suppressed saturation field under pressure. First-principles calculations reveal the essential role of the intralayer exchange coupling, which contains the competition between the AFM-preferred direct exchange and FM-preferred superexchange coupling, in determining these magnetic properties. Such a magnetic phase transition is also observed in Sb-doped MnBi6Te10 due to similar mechanism, where the in-plane lattice constant is effectively reduced.