Free Downloads
Language Modeling For Information Retrieval (The Information Retrieval Series)

A statisticallanguage model, or more simply a language model, is a prob­ abilistic mechanism for generating text. Such adefinition is general enough to include an endless variety of schemes. However, a distinction should be made between generative models, which can in principle be used to synthesize artificial text, and discriminative techniques to classify text into predefined cat­ egories. The first statisticallanguage modeler was Claude Shannon. In exploring the application of his newly founded theory of information to human language, Shannon considered language as a statistical source, and measured how weH simple n-gram models predicted or, equivalently, compressed natural text. To do this, he estimated the entropy of English through experiments with human subjects, and also estimated the cross-entropy of the n-gram models on natural 1 text. The ability of language models to be quantitatively evaluated in tbis way is one of their important virtues. Of course, estimating the true entropy of language is an elusive goal, aiming at many moving targets, since language is so varied and evolves so quickly. Yet fifty years after Shannon's study, language models remain, by all measures, far from the Shannon entropy liInit in terms of their predictive power. However, tbis has not kept them from being useful for a variety of text processing tasks, and moreover can be viewed as encouragement that there is still great room for improvement in statisticallanguage modeling.

Series: The Information Retrieval Series (Book 13)

Paperback: 246 pages

Publisher: Springer; Softcover reprint of hardcover 1st ed. 2003 edition (October 4, 2013)

Language: English

ISBN-10: 9048162637

ISBN-13: 978-9048162635

Product Dimensions: 6.1 x 0.6 x 9.2 inches

Shipping Weight: 1 pounds (View shipping rates and policies)

Average Customer Review: Be the first to review this item

Best Sellers Rank: #2,113,601 in Books (See Top 100 in Books) #615 in Books > Computers & Technology > Computer Science > Information Theory #704 in Books > Textbooks > Computer Science > Artificial Intelligence #842 in Books > Computers & Technology > Networking & Cloud Computing > Network Administration > Storage & Retrieval

Language Modeling for Information Retrieval (The Information Retrieval Series) Body Language: Body Language Training - Attract Women & Command Respect, by Mastering Your High Status Body Language (Body Language Attraction, Body Language ... Language Secrets, Nonverbal Communication) Retrieval (The Retrieval Duet Book 1) BODY LANGUAGE : Decoding Alpha Male Body Language, Instantly Attract Any Woman Without Saying a Single word. (Body Language 101, Alpha male, Attract woman, ... Seduce Women, Eye Contact, Body Language) Introduction to Modern Information Retrieval, 3rd Edition Microsoft Excel 2013 Data Analysis and Business Modeling: Data Analysis and Business Modeling (Introducing) 3D Modeling For Beginners: Learn everything you need to know about 3D Modeling! Introduction to the Numerical Modeling of Groundwater and Geothermal Systems: Fundamentals of Mass, Energy and Solute Transport in Poroelastic Rocks (Multiphysics Modeling) Geochemical Modeling of Groundwater, Vadose and Geothermal Systems (Multiphysics Modeling) Mathematical Modeling of Collective Behavior in Socio-Economic and Life Sciences (Modeling and Simulation in Science, Engineering and Technology) Student Solutions Manual for Differential Equations: Computing and Modeling and Differential Equations and Boundary Value Problems: Computing and Modeling On Language: Chomsky's Classic Works Language and Responsibility and Reflections on Language in One Volume German: Learn German with These 500 Phrases (German Language, Speak German, Learning German, Germany Language, Austria Language, Learning German, Speaking German) Body Language: Master the Art of Reading Anyone Through Nonverbal Communication (Body Language 101, Body Language Mastery, Read Everyone) Image Description and Retrieval (Advances in Computer Vision and Machine Intelligence) The Gift of Life: The Reality Behind Donor Organ Retrieval The Portal of the Mystery of Hope (Ressourcement: Retrieval & Renewal in Catholic Thought) Abdominal Organ Retrieval and Transplantation Bench Surgery Tank Waste Retrieval, Processing, and On-site Disposal at Three Department of Energy Sites: Final Report Soul Retrieval: Mending the Fragmented Self