Position Paper: Generalized grammar rules and structure-based generalization beyond classical equivariance for lexical tasks and transduction
CoRR(2024)
摘要
Compositional generalization is one of the main properties which
differentiates lexical learning in humans from state-of-art neural networks. We
propose a general framework for building models that can generalize
compositionally using the concept of Generalized Grammar Rules (GGRs), a class
of symmetry-based compositional constraints for transduction tasks, which we
view as a transduction analogue of equivariance constraints in physics-inspired
tasks. Besides formalizing generalized notions of symmetry for language
transduction, our framework is general enough to contain many existing works as
special cases. We present ideas on how GGRs might be implemented, and in the
process draw connections to reinforcement learning and other areas of research.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要