Maximum Entropy (ME) modeling is a general statistical modeling paradigm that may be applied in language modeling and natural language processing to predict linguistic behavior by incorporating various informative features, each encoding some linguistically statistical event, from a corpus of data into a common framework of conditional models.
The present invention is intended to provide a fast method for selecting high quality features for Maximum Entropy (ME) modeling that may be applied in areas of statistical modeling and linear regression, ranging from language understanding and bio-informatics to stock market prediction. In this regard, the fast feature selection method of the present invention may build compact, high-quality, robust models and make feasible many previously impractical tasks.
