Oracle-based Protocol Testing with Eywa
CoRR(2023)
摘要
We present oracle-based testing a new technique for automatic black-box
testing of network protocol implementations. Oracle-based testing leverages
recent advances in LLMs to build rich models of intended protocol behavior from
knowledge embedded in RFCs, blogs, forums, and other natural language sources.
From these models it systematically derives exhaustive test cases using
symbolic program execution. We realize oracle-based testing through Eywa, a
novel protocol testing framework implemented in Python. To demonstrate Eywa's
effectiveness, we show its use through an extensive case study of the DNS
protocol. Despite requiring minimal effort, applying Eywa to the DNS resulting
in the discovery of 26 unique bugs across ten widely used DNS implementations,
including 11 new bugs that were previously undiscovered despite elaborate prior
testing with manually crafted models.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要