Not Logged In

Discriminative Neural Sentence Modeling by Tree-Based Convolution

Full Text: D15-1279.pdf PDF

This paper proposes a tree-based convolutional neural network (TBCNN) for discriminative sentence modeling. Our model leverages either constituency trees or dependency trees of sentences. The tree-based convolution process extracts sentences structural features, which are then aggregated by max pooling. Such architecture allows short propagation paths between the output layer and underlying feature detectors, enabling effective structural feature learning and extraction. We evaluate our models on two tasks: sentiment analysis and question classification. In both experiments, TBCNN outperforms previous state-of-the-art results, including existing neural networks and dedicated feature/rule engineering. We also make efforts to visualize the tree-based convolution process, shedding light on how our models work.

Citation

L. Mou, H. Peng, G. Li, Y. Xu, L. Zhang, Z. Jin. "Discriminative Neural Sentence Modeling by Tree-Based Convolution". EMNLP - Conference on Empirical Methods in Natural Language Processing, pp 2315–2325, September 2015.

Keywords:  
Category: In Conference
Web Links: doi
  ACL

BibTeX

@incollection{Mou+al:(EMNLP)15,
  author = {Lili Mou and Hao Peng and Ge Li and Yan Xu and Lu Zhang and Zhi
    Jin},
  title = {Discriminative Neural Sentence Modeling by Tree-Based Convolution},
  Pages = {2315–2325},
  booktitle = {EMNLP - Conference on Empirical Methods in Natural Language
    Processing},
  year = 2015,
}

Last Updated: February 04, 2021
Submitted by Sabina P

University of Alberta Logo AICML Logo