Misplaced Pages

#882117

34-664: Its composition was designed to match the original Brown corpus in terms of its size and genres as closely as possible using documents published in the UK in 1961 by British authors. Both corpora consist of 500 samples each comprising about 2000 words in the following genres: The chief compilers of the LOB corpous were Geoffrey Leech (Lancaster University) and Stig Johansson (University of Oslo); see Leech & Johansson (2009). The corpus has been also tagged , i.e. part-of-speech categories have been assigned to every word. This article about

68-465: A digital library is a stub . You can help Misplaced Pages by expanding it . This article about the English language is a stub . You can help Misplaced Pages by expanding it . Part-of-speech tagging In corpus linguistics , part-of-speech tagging ( POS tagging or PoS tagging or POST ), also called grammatical tagging is the process of marking up a word in a text (corpus) as corresponding to

102-432: A feature is any characteristic used to classify a phoneme or word. These are often binary or unary conditions which act as constraints in various forms of linguistic analysis. In phonology , segments are categorized into natural classes on the basis of their distinctive features . Each feature is a quality or characteristic of the natural class, such as voice or manner . A unique combination of features defines

136-648: A phoneme . Examples of phonemic or distinctive features are: [+/- voice ], [+/- ATR ] (binary features) and [ CORONAL ] (a unary feature; also a place feature). Surface representations can be expressed as the result of rules acting on the features of the underlying representation . These rules are formulated in terms of transformations on features. In morphology and syntax , words are often organized into lexical categories or word classes , such as "noun", "verb", "adjective", and so on. These word classes have grammatical features (also called categories or inflectional categories ), which can have one of

170-529: A category realises can also differ from language to language. There is often a correspondence between morphological and syntactic features, in that certain features, such as person , are relevant to both morphology and syntax; these are known as morphosyntactic features . Other types of grammatical features, by contrast, may be relevant to semantics ( morphosemantic features ), such as tense, aspect and mood , or may only be relevant to morphology ( morphological features ). Inflectional class (a word's membership of

204-414: A noun followed by a verb, the next item may be very likely a preposition, article, or noun, but much less likely another verb. When several ambiguous words occur together, the possibilities multiply. However, it is easy to enumerate every combination and to assign a relative probability to each one, by multiplying together the probabilities of each choice in turn. The combination with the highest probability

238-416: A particular part of speech , based on both its definition and its context . A simplified form of this is commonly taught to school-age children, in the identification of words as nouns , verbs , adjectives , adverbs , etc. Once performed by hand, POS tagging is now done in the context of computational linguistics , using algorithms which associate discrete terms, as well as hidden parts of speech, by

272-468: A particular verb class or noun class ) is a purely morphological feature, because it is only relevant to the morphological realisation of the word. In formal models of grammar, features can be represented as attribute-value pairs. For example, in Lexical functional grammar , syntactic features are represented alongside grammatical functions at the level of functional structure (f-structure), which takes

306-449: A set of descriptive tags. POS-tagging algorithms fall into two distinctive groups: rule-based and stochastic. E. Brill's tagger , one of the first and most widely used English POS-taggers, employs rule-based algorithms. Part-of-speech tagging is harder than just having a list of words and their parts of speech, because some words can represent more than one part of speech at different times, and because some parts of speech are complex. This

340-473: A set of potential values (also called the property , meaning , or feature of the category). For example, consider the pronoun in English. Pronouns are a lexical category . Pronouns have the person feature , which can have a value of "first", "second", or "third". English pronouns also have the number feature , which can have a value of either "singular" or "plural". As a result, we can describe

374-491: Is not rare—in natural languages (as opposed to many artificial languages ), a large percentage of word-forms are ambiguous . For example, even "dogs", which is usually thought of as just a plural noun, can also be a verb: Correct grammatical tagging will reflect that "dogs" is here used as a verb, not as the more common plural noun. Grammatical context is one way to determine this; semantic analysis can also be used to infer that "sailor" and "hatch" implicate "dogs" as 1) in

SECTION 10

#1732771837883

408-548: Is then chosen. The European group developed CLAWS, a tagging program that did exactly this and achieved accuracy in the 93–95% range. Eugene Charniak points out in Statistical techniques for natural language parsing (1997) that merely assigning the most common tag to each known word and the tag " proper noun " to all unknowns will approach 90% accuracy because many words are unambiguous, and many others only rarely represent their less-common parts of speech. CLAWS pioneered

442-676: The Eagles Guidelines see wide use and include versions for multiple languages. POS tagging work has been done in a variety of languages, and the set of POS tags used varies greatly with language. Tags usually are designed to include overt morphological distinctions, although this leads to inconsistencies such as case-marking for pronouns but not nouns in English, and much larger cross-language differences. The tag sets for heavily inflected languages such as Greek and Latin can be very large; tagging words in agglutinative languages such as Inuit languages may be virtually impossible. At

476-646: The POS tags used in the Brown Corpus). Other tagging systems use a smaller number of tags and ignore fine differences or model them as features somewhat independent from part-of-speech. In part-of-speech tagging by computer, it is typical to distinguish from 50 to 150 separate parts of speech for English. Work on stochastic methods for tagging Koine Greek (DeRose 1990) has used over 1,000 parts of speech and found that about as many words were ambiguous in that language as in English. A morphosyntactic descriptor in

510-637: The Viterbi algorithm , Brill tagger , Constraint Grammar , and the Baum-Welch algorithm (also known as the forward-backward algorithm). Hidden Markov model and visible Markov model taggers can both be implemented using the Viterbi algorithm. The rule-based Brill tagger is unusual in that it learns a set of rule patterns, and then applies those patterns rather than optimizing a statistical quantity. Many machine learning methods have also been applied to

544-437: The 100 million word British National Corpus , even though larger corpora are rarely so thoroughly curated. For some time, part-of-speech tagging was considered an inseparable part of natural language processing , because there are certain cases where the correct part of speech cannot be decided without understanding the semantics or even the pragmatics of the context. This is extremely expensive, especially because analyzing

578-448: The English pronoun "they" as a pronoun with [person:3] and [number:plural]. Third person singular pronouns in English also have a gender feature: "she" is [gender:feminine], "he" [gender:masculine] and "it [gender:neuter]. Different lexical categories realise or are specified for different grammatical features: for example, verbs in English are specified for tense, aspect and mood features, as well as person and number. The features that

612-586: The case of morphologically rich languages is commonly expressed using very short mnemonics, such as Ncmsan for Category=Noun, Type = common, Gender = masculine, Number = singular, Case = accusative, Animate = no. The most popular "tag set" for POS tagging for American English is probably the Penn tag set, developed in the Penn Treebank project. It is largely similar to the earlier Brown Corpus and LOB Corpus tag sets, though much smaller. In Europe, tag sets from

646-513: The field of HMM-based part of speech tagging but was quite expensive since it enumerated all possibilities. It sometimes had to resort to backup methods when there were simply too many options (the Brown Corpus contains a case with 17 ambiguous words in a row, and there are words such as "still" that can represent as many as 7 distinct parts of speech. HMMs underlie the functioning of stochastic taggers and are used in various algorithms one of

680-421: The field of natural language processing. The accuracy reported was higher than the typical accuracy of very sophisticated algorithms that integrated part of speech choice with many higher levels of linguistic analysis: syntax, morphology, semantics, and so on. CLAWS, DeRose's and Church's methods did fail for some of the known cases where semantics is required, but those proved negligibly rare. This convinced many in

714-606: The field that part-of-speech tagging could usefully be separated from the other levels of processing; this, in turn, simplified the theory and practice of computerized language analysis and encouraged researchers to find ways to separate other pieces as well. Markov Models became the standard method for the part-of-speech assignment. The methods already discussed involve working from a pre-existing corpus to learn tag probabilities. It is, however, also possible to bootstrap using "unsupervised" tagging. Unsupervised tagging techniques use an untagged corpus for their training data and produce

SECTION 20

#1732771837883

748-623: The higher levels is much harder when multiple part-of-speech possibilities must be considered for each word. In the mid-1980s, researchers in Europe began to use hidden Markov models (HMMs) to disambiguate parts of speech, when working to tag the Lancaster-Oslo-Bergen Corpus of British English. HMMs involve counting cases (such as from the Brown Corpus) and making a table of the probabilities of certain sequences. For example, once you've seen an article such as 'the', perhaps

782-459: The labor involved in reconfiguring them for this particular dataset). Thus, it should not be assumed that the results reported here are the best that can be achieved with a given approach; nor even the best that have been achieved with a given approach. In 2014, a paper reporting using the structure regularization method for part-of-speech tagging, achieving 97.36% on a standard benchmark dataset. Feature (linguistics) In linguistics ,

816-498: The late 70s the tagging was nearly perfect (allowing for some cases on which even human speakers might not agree). This corpus has been used for innumerable studies of word-frequency and of part-of-speech and inspired the development of similar "tagged" corpora in many other languages. Statistics derived by analyzing it formed the basis for most later part-of-speech tagging systems, such as CLAWS and VOLSUNGA . However, by this time (2005) it has been superseded by larger corpora such as

850-407: The most widely used being the bi-directional inference algorithm. In 1987, Steven DeRose and Kenneth W. Church independently developed dynamic programming algorithms to solve the same problem in vastly less time. Their methods were similar to the Viterbi algorithm known for some time in other fields. DeRose used a table of pairs, while Church used a table of triples and a method of estimating

884-479: The nautical context and 2) an action applied to the object "hatch" (in this context, "dogs" is a nautical term meaning "fastens (a watertight door) securely"). Schools commonly teach that there are 9 parts of speech in English: noun , verb , article , adjective , preposition , pronoun , adverb , conjunction , and interjection . However, there are clearly many more categories and sub-categories. For nouns,

918-439: The next word is a noun 40% of the time, an adjective 40%, and a number 20%. Knowing this, a program can decide that "can" in "the can" is far more likely to be a noun than a verb or a modal. The same method can, of course, be used to benefit from knowledge about the following words. More advanced ("higher-order") HMMs learn the probabilities not only of pairs but triples or even larger sequences. So, for example, if you've just seen

952-479: The other extreme, Petrov et al. have proposed a "universal" tag set, with 12 categories (for example, no subtypes of nouns, verbs, punctuation, and so on). Whether a very small set of very broad tags or a much larger set of more precise ones is preferable, depends on the purpose at hand. Automatic tagging is easier on smaller tag-sets. Research on part-of-speech tagging has been closely tied to corpus linguistics . The first major corpus of English for computer analysis

986-503: The plural, possessive, and singular forms can be distinguished. In many languages words are also marked for their " case " (role as subject, object, etc.), grammatical gender , and so on; while verbs are marked for tense , aspect , and other things. In some tagging systems, different inflections of the same root word will get different parts of speech, resulting in a large number of tags. For example, NN for singular common nouns, NNS for plural common nouns, NP for singular proper nouns (see

1020-509: The problem of POS tagging. Methods such as SVM , maximum entropy classifier , perceptron , and nearest-neighbor have all been tried, and most can achieve accuracy above 95%. A direct comparison of several methods is reported (with references) at the ACL Wiki. This comparison uses the Penn tag set on some of the Penn Treebank data, so the results are directly comparable. However, many significant taggers are not included (perhaps because of

1054-621: The tagset by induction. That is, they observe patterns in word use, and derive part-of-speech categories themselves. For example, statistics readily reveal that "the", "a", and "an" occur in similar contexts, while "eat" occurs in very different ones. With sufficient iteration, similarity classes of words emerge that are remarkably similar to those human linguists would expect; and the differences themselves sometimes suggest valuable new insights. These two categories can be further subdivided into rule-based, stochastic, and neural approaches. Some current major algorithms for part-of-speech tagging include

Lancaster-Oslo-Bergen Corpus - Misplaced Pages Continue

1088-459: The values for triples that were rare or nonexistent in the Brown Corpus (an actual measurement of triple probabilities would require a much larger corpus). Both methods achieved an accuracy of over 95%. DeRose's 1990 dissertation at Brown University included analyses of the specific error types, probabilities, and other related data, and replicated his work for Greek, where it proved similarly effective. These findings were surprisingly disruptive to

1122-440: Was painstakingly "tagged" with part-of-speech markers over many years. A first approximation was done with a program by Greene and Rubin, which consisted of a huge handmade list of what categories could co-occur at all. For example, article then noun can occur, but article then verb (arguably) cannot. The program got about 70% correct. Its results were repeatedly reviewed and corrected by hand, and later users sent in errata so that by

1156-463: Was the Brown Corpus developed at Brown University by Henry Kučera and W. Nelson Francis , in the mid-1960s. It consists of about 1,000,000 words of running English prose text, made up of 500 samples from randomly chosen publications. Each sample is 2,000 or more words (ending at the first sentence-end after 2,000 words, so that the corpus contains only complete sentences). The Brown Corpus

#882117