Infinite-dimensional feature aggregation via a factorized bilinear model

•Infinite-dimensional features are directly aggregated without approximation error.•Our descriptors contain infinite order statistics of input features.•The sigmoid kernel is introduced to construct infinite-dimensional features.•Our method outperforms the state-of-the-art finite-dimensional and infinite-dimensional feature aggregation methods.