View Publication

Combining Statistical Language Models Via the Latent Maximum Entropy Principle

Shaojun Wang, Dept of Computing Science
Dale Schuurmans, AICML
Fuchun Peng, Department of Computer Science, University of Massachusetts at Amherst
Yunxin Zhao, Department of Computer Engineering and Computer Science, University of Missouri at Columbia

In this paper, we present a unified probabilistic framework for statistical language modeling which can simultaneously incorporate various aspects of natural language, such as local word interaction, syntactic structure and semantic document information. Our approach is based on a recent statistical inference principle we have proposed---the latent maximum entropy principle---which allows relationships over hidden features to be e

Citation

S. Wang, D. Schuurmans, F. Peng, Y. Zhao. "Combining Statistical Language Models Via the Latent Maximum Entropy Principle". Machine Learning Journal (MLJ), 60(1-3), pp 229-250, October 2005.

Keywords:	language modeling, Ngram models, latent semantic analysis, machine learning
Category:	In Journal

BibTeX

@article{Wang+al:MLJ05,
  author = {Shaojun Wang and Dale Schuurmans and Fuchun Peng and Yunxin Zhao},
  title = {Combining Statistical Language Models Via the Latent Maximum Entropy
    Principle},
  Volume = "60",
  Number = "1-3",
  Pages = {229-250},
  journal = {Machine Learning Journal (MLJ)},
  year = 2005,
}

Last Updated: July 06, 2007
Submitted by Nelson Loyola

Not Logged In

PapersDB

Combining Statistical Language Models Via the Latent Maximum Entropy Principle

Citation

BibTeX