Machine learning-enhanced search for a vectorlike singlet B quark decaying to a singlet scalar or pseudoscalar

The presence of a new decay mode relaxes the current mass exclusion limits on vectorlike quarks considerably. We consider the case of a weak-singlet vectorlike B quark that can decay to a singlet scalar or pseudoscalar 0. In an earlier paper [A. Bhardwaj et al., Roadmap to explore vectorlike quarks decaying to a new scalar or pseudoscalar, Phys. Rev. D, 106, 095014 (2022)], we mapped the possibilities to explore such setups at the LHC. We showed that it is possible for a B quark to decay into 0 and the 0 to dominantly decay to a pair of gluons or b quark(s) without fine-tuning the parameters. In this paper, we present a collider search strategy to look for the pair production of singlet B quarks. If both B's decay into b0 pairs, the final state is fully hadronic: BB -(b0)(b0) -(bgg)(bgg)/(bbb)(bbb), which is very challenging to probe. Therefore, we consider a simpler mixed decay specific to the singlet B case, BB -(b0)(tW) with a lepton in the final state, to achieve the best sensitivity at the high-luminosity LHC. We use a deep neural network with a weighted cross-entropy loss to separate the signal from the huge Standard Model background. Our analysis shows that large areas of the MB - M0 parameter space are discoverable through this signature. We show how the discovery and exclusion regions scale with the branching ratio in the new decay mode. We also estimate the reach in the inclusive monolepton channel with the same network model.