Effects of model size and composition on quality of head-and-neck knowledge-based plans

Purpose: Knowledge-based planning (KBP) aims to automate and standardize treatment planning. New KBP users are faced with many questions: How much does model size matter, and are multiple models needed to accommodate specific physician preferences? In this study, six head-and-neck KBP models were trained to address these questions.Methods: The six models differed in training size and plan composition: The KBPFull (n = 203 plans), KBP101 (n = 101), KBP50 (n = 50), and KBP25 (n = 25) were trained with plans from two head-and-neck physicians. KBPA and KBPB each contained n = 101 plans from only one physician, respectively. An independent set of 39 patients treated to 6000-7000 cGy by a third physician was re-planned with all KBP models for validation. Standard head-and-neck dosimetric parameters were used to compare resulting plans. KBPFull plans were compared to the clinical plans to evaluate overall model quality. Additionally, clinical and KBPFull plans were presented to another physician for blind review. Dosimetric comparison of KBPFull against KBP101, KBP50, and KBP25 investigated the effect of model size. Finally, KBPA versus KBPB tested whether training KBP models on plans from one physician only influences the resulting output. Dosimetric differences were tested for significance using a paired t-test (p < 0.05).Results: Compared to manual plans, KBPFull significantly increased PTV Low D95% and left parotid mean dose but decreased dose cochlea, constrictors, and larynx. The physician preferred the KBPFull plan over the manual plan in 20/39 cases. Dosimetric differences between KBPFull, KBP101, KBP50, and KBP25 plans did not exceed 187 cGy on aggregate, except for the cochlea. Further, average differences between KBPA and KBPB were below 110 cGy.Conclusions: Overall, all models were shown to produce high-quality plans. Differences between model outputs were small compared to the prescription. This indicates only small improvements when increasing model size and minimal influence of the physician when choosing treatment plans for training head-and-neck KBP models.