# Corpora

Written by and

This page describes four corpus collections useful for English studies (both modern and historical) and a large German corpus, which is often used for comparative reasons.

# 1 Basic Information

For a brief introduction to the field of digital humanities in general and the use of corpora, please see the following document:

Digital Humanities

We commonly distinguish generalized from specialized corpora and dynamic from static corpora.

A generalized corpus will try to balance the types of genres and domains it represents. It will contain texts from various genres (e.g. fiction, newspapers, academic texts, etc.) that at best have a word count as equal as possible. A specialized corpus, on the other hand, will focus on particular domains or genres and will represent these predominantly. An example for a generalized corpus is the British National Corpus (“The British National Corpus, version 3 (BNC XML Edition),” 2007) to be described below, which includes both spoken and written data from different genres. The TIMES corpus could be considered a specialized corpus as it only contains the genre ‘News’. However, it will be balanced concerning different subtypes of articles (e.g. sports, politics, or feuilleton). Thus a specialized corpus is always specialized relative to a generalized corpus (cf.  McEnery, Xiao, & Tono, 2006).

The second pair of corpus types determines whether new data will be included in the course of time or if it will stay stable. Whenever we speak of a dynamic corpus we refer to the first type, the latter is a characteristic of static corpora. An example for the former (i.e. dynamic corpus) is the Corpus of Contemporary American English (Davies, 2008), which has been fed with new data every two years.1 The British National Corpus (“The British National Corpus, version 3 (BNC XML Edition),” 2007) is an example of a static corpus: Its latest entries date from 1993.

The sections below describe the corpora that are most relevant to the research undertaken at the chair for diachronic English linguistics. However, many more corpora suited for the study of English exist. A list of such corpora can be found at the Corpus Resource Database (CoRD), curated by the University of Helsinki.

# 2 Penn Parsed Corpora of Historical English (Penn corpora)

(NB: accessible to students and staff of Anglistik Ⅳ at Mannheim University only)

Penn Corpora Website

The Penn Parsed Corpora of Historical English (Penn corpora in short) have been created at the University of Pennsylvania and span the linguistic history of British English, starting with Middle English (ME) documents. The corpora and their respective sizes are given below: - Penn-Helsinki Parsed Corpus of Middle English, 2nd edition (PPCME-2): 1.2 million words (Kroch & Taylor, 2000) - Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME): 1.7 million words (Kroch, Santorini, & Delfs, 2004) - Penn Parsed Corpus of Modern British English (PPCMBE): 1 million words (Kroch, Santorini, & Diertani, 2016)

The corpora represent the different linguistic stages and are each subdivided into several periods for easy reference. Each corpus is part-of-speech annotated (i.e. tagged) as well as syntactically annotated (i.e. parsed), making inquiries into historical texts available both at the word-level and at the syntactic level. As the language has changed, you will find slightly different annotation schemes for each of the corpora, but they all follow the same principle and are searchable via the search tool CorpusSearch (Randall, 2010), which is an open source program available at http://corpussearch.sourceforge.net/.2

In addition, the verbs of PPCME2 have also been lemmatized as part of the research project BASICS (short for Borrowing of Argument Structure in Contact Situations), which has been carried out by researchers of the Universities of Mannheim and Stuttgart (see Percillier, 2016, 2018 and the BASICS Toolkit website for details). To query verbs by lemma in the PPCME2, one can specify the lemma entry as listed in the Middle English Dictionary (MED, McSparran et al., 2001) with an l attribute, or with the MED entry number with an m attribute to avoid matching homonyms. Every such insertion is demarcated by @ characters. For example, searching for all forms of yeven, the Middle English ancestor to give, can be done with *@l=yeven@* or *@m=53944@*. Furthermore, a distinction is made regarding verb etymology: verbs of French origin can be queried with *@e=french@*, and other verbs with *@e=nonfrench@*. An additional version of the lemmatized PPCME2 contains lemma and animacy information for lexical noun forms within prepositional phrases headed by to that occur in the vicinity of verbs. This was done to help determine the status of prepositional phrases as prepositional objects or adverbials. Options for the animacy status are "animate", "inanimate", "ambiguous" for homonyms that could not be distinguished, and "panimate" for lexemes that are animate in their primary sense but have a high propensity to refer to animate entities via metonymy or metaphor. The animacy status can be queried as such: *@a=animate@* for animate nouns, *@a=animate@*|*@a=panimate@* to also include cases of potential metonymy or metaphor, or *@a=inanimate@* for inanimate nouns.

Due to a focus on prose texts, the PPCME2 has large data gap for the period from 1250–1350, often referred to as M2. Two additional corpora were compiled using the same annotation scheme as the PPCME2 to fill this gap: the Parsed Corpus of Middle Poetry (PCMEP, Zimmermann, 2018) and the Parsed Linguistic Atlas of Early Middle English (PLAEME, Truswell, Alcorn, Donaldson & Wallenberg, 2018). The lemmatization of lexical verbs and addition of animacy information described for the PPCME2 above has been extended to the PCMEP and PLAEME (see Percillier & Trips, 2020 for details). A combination of the three corpora PPCME2, PCMEP, and PLAEME provides the best coverage for the Middle English period.

A number of other corpora make use of the annotation scheme used for the Penn corpora as well. Among them is the York-Toronto-Helsinki Parsed Corpus of Old English Prose (YCOE in short, Taylor, Warner, Pintzuk, & Beths, 2003), which covers the Old English period and contains 1.5 million words. The sister corpus to the Penn corpora contains written texts of various genres, including law and medical texts, fiction, and many religious texts. Since Old English was an inflected language, expect POS-tags to be slightly differing from the later corpora (e.g. extended tags for case markings on words and phrases). It can also be accessed via the search engine CorpusSearch mentioned above.

Information and documentation about the corpora can be found at http://www-users.york.ac.uk/~lang22/YCOE/YcoeHome.htm for the Old English YCOE corpus and for the various Penn corpora of the later stages of English at https://www.ling.upenn.edu/hist-corpora/.

Notable studies carried out with the above-mentioned corpora include Pintzuk & Taylor (2008) and Taylor (2008) for Old English, Ecay & Tamminga (2013), Trips (2002) and Walkden & Morrison (2017) for Middle English, and Kytö & Romaine (1997) for Early Modern English.

# 3 English-Corpora.org

English-corpora.org Website

The corpora at English-Corpora.org, previously known as the Brigham Young University corpora (BYU in short), are a collection of several corpora developed by Mark Davies, a Professor of Linguistics at BYU. The collection includes a variety of annotated corpora which range from smaller static corpora (e.g. the Corpus of American Soap Operas) to huge dynamic corpora (e.g. the News on the Web corpus) suitable both for synchronic and diachronic research: - News on the Web (NOW): 6 billion+ words (Davies, 2013b) - Global Web-Based English (GloWbE): 1.9 billion words (Davies, 2013a) - Corpus of Contemporary American English (COCA): 560 million words (Davies, 2008) - Corpus of Historical American English (COHA): 400 million words (Davies, 2010) - TIME Magazine Corpus: 100 million words (Davies, 2007) - etc.

The corpora make use of the same user interface, which is available after registration. Each corpus has its own documentation about which texts have been included and from which time span the texts originate. Further, each corpus gives various query examples and a brief tutorial to ease into work with these corpora. Search options for collocations and corpus comparison make it easy to match results both within corpora and across them.

# 4 British National Corpus (BNC)

BNC Access

BNC2014 Access

The British National Corpus (“The British National Corpus, version 3 (BNC XML Edition),” 2007) is a 100 million word annotated text corpus developed by Oxford University press. It contains 90 per cent written and 10 per cent spoken material collected between 1980 and the early 1990s. The written texts span a wide range of genres, including fiction, newspapers, (non-)academic prose, among others. Spoken texts contain both conversations and monologues with the possibility to listen in to some of them. The time span of the texts in the BNC ranges from the 1960s to 1993.

The BNC may be explored via different interfaces, for instance via BNCWeb (Lehmann, Schneider, & Hoffmann, 2000, developed at Lancaster University) or through the BYU website. The BNCWeb is a very accessible and intuitive interface, giving information on a wide range of topics, including the tagset used, or how to build your own subcorpus. Access may be gained at http://bncweb.lancs.ac.uk/bncwebSignup/user/login.php.

The main page of the BNCWeb allows you to specify your search query in a number of ways, using either a simple syntax or a more elaborate query syntax (the so-called Corpus Query Processor-syntax, or CQP in short) to find more complex examples. On the result page, a number of possibilities emerge that involve the display of the output (e.g. the Key Word in Context display, or KWIC in short) or the presentation of the results (e.g. information on frequency or sociolinguistic data). The original BNC is both a balanced and representative corpus, but a static one, i.e. no new material will be created for this corpus. As of 2014 however, a new version of the corpus has been made available, the British National Corpus 2014 (Love, Dembry, Hardie, Brezina, & McEnery, 2017). Access to the BNC2014 is available via http://corpora.lancs.ac.uk/bnc2014/signup.php.

# 5 COSMAS II

COSMAS II Access

COSMAS II (“COSMAS II (Corpus Search, Management and Analysis System),” 1991) is an application developed at the Institute for the German Language (Institut für Deutsche Sprache, IDS) in Mannheim. With the application you are able to access several German text corpora within DeReKo (Deutsches Referenzkorpus, Kupietz, Belica, Lüngen, & Perkuhn, 2018) that contains about 42 billion words of written text as of February 2018. The corpus contains a variety of newspapers and magazines in the German language, among them Mannheimer Morgen, Die Zeit or the Swiss-based St. Galler Tagblatt. Recent additions to DeReKo include the magazines Stern and HÖRZU as well as a Soccer Liveticker corpus.

The individual subcorpora are annotated, either for POS tags only, or additionally for syntactic information.

An extensive documentation (including a brief tour and search query examples) can be found at the project’s website: https://www.ids-mannheim.de/cosmas2/projekt/. You can gain access to the web version via http://www.ids-mannheim.de/cosmas2-web/.

# References

COSMAS II (Corpus Search, Management and Analysis System). (1991). Mannheim: Institut für Deutsche Sprache. Retrieved from http://www.ids-mannheim.de/cosmas2/

Davies, M. (2007). TIME Magazine Corpus: 100 million words, 1920-2000s. Retrieved from https://corpus.byu.edu/time/

Davies, M. (2008). The Corpus of Contemporary American English (COCA): 560 million words, 1990-present. Retrieved from https://corpus.byu.edu/coca/

Davies, M. (2010). The Corpus of Historical American English (COHA): 400 million words, 1810-2009. Retrieved from https://corpus.byu.edu/coha/

Davies, M. (2013a). Corpus of Global Web-Based English: 1.9 billion words from speakers in 20 countries (GloWbE). Retrieved from https://corpus.byu.edu/glowbe/

Davies, M. (2013b). Corpus of News on the Web (NOW): 3+ billion words from 20 countries, updated every day. Retrieved from https://corpus.byu.edu/now/

Ecay, A., & Tamminga, M. (2013). Persistence as a diagnostic of grammatical status: The case of Middle English negation. 15th Diachronic Generative Syntax conference (DiGS15), Ottawa. Retrieved from http://artsites.uottawa.ca/digs15/programme/

Kroch, A., Santorini, B., & Delfs, L. (2004). The Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME), Release 3. Philadelphia: University of Pennsylvania. Retrieved from http://www.ling.upenn.edu/ppche/ppche-release-2016/PPCEME-RELEASE-3

Kroch, A., Santorini, B., & Diertani, A. (2016). The Penn Parsed Corpus of Modern British English (PPCMBE2), Release 1. Philadelphia: University of Pennsylvania. Retrieved from http://www.ling.upenn.edu/ppche/ppche-release-2016/PPCMBE2-RELEASE-1

Kroch, A., & Taylor, A. (2000). The Penn-Helsinki Parsed Corpus of Middle English, Second Edition (PPCME2), Release 3. Philadelphia: University of Pennsylvania. Retrieved from http://www.ling.upenn.edu/hist-corpora/

Kupietz, M., Belica, C., Lüngen, H., & Perkuhn, R. (2018). Das Deutsche Referenzkorpus DeReKo. Mannheim: Institut für Deutsche Sprache. Retrieved from http://www.ids-mannheim.de/kl/projekte/korpora/

Kytö, M., & Romaine, S. (1997). Competing forms of adjective comparison in modern English: What could be more quicker and easier and more effective? In T. Nevalainen & L. Kahlas-Tarkka (Eds.), To explain the present: Studies in the changing English language in honour of Matti Rissanen (pp. 329–352). Helsinki: Société Néophilologique.

Lehmann, H.-M., Schneider, P., & Hoffmann, S. (2000). BNCweb. In J. Kirk (Ed.), Corpora Galore: Analysis and Techniques in Describing English (pp. 259–266). Amsterdam: Rodopi.

Love, R., Dembry, C., Hardie, A., Brezina, V., & McEnery, T. (2017). The Spoken BNC2014: Designing and building a spoken corpus of everyday conversations. International Journal of Corpus Linguistics, 22(3), 319–344. doi:10.1075/ijcl.22.3.02lov

McEnery, T., Xiao, R., & Tono, Y. (2006). Corpus-Based Language Studies: An advanced resource book. London/New York: Routledge.

McSparran, F., Schaffner, P., Latta, J., Pagliere, A., Powell, C., & Stoeffler, M. (2001). Middle English Dictionary. University of Michigan. Retrieved from http://quod.lib.umich.edu/m/med/

Percillier, M. (2016). Verb lemmatization and semantic verb classes in a Middle English corpus. In Proceedings of the 13th Conference on Natural Language Processing (KONVENS 2016) (pp. 209–214). Retrieved from https://www.linguistics.rub.de/konvens16/pub/26_konvensproc.pdf

Percillier, M. (2018). A Toolkit for lemmatising, analysing, and visualising Middle English Data. In A. U. Frank, C. Ivanovic, F. Mambrini, M. Passarotti, & C. Sporleder (Eds.), Proceedings of the Second Workshop on Corpus-Based Research in the Humanities CRH-2 (Vol. 1, pp. 153–160). Vienna. Retrieved from https://www.oeaw.ac.at/fileadmin/subsites/academiaecorpora/PDF/CRH2.pdf

Percillier, M. & Trips, C. (2020). Lemmatising verbs in Middle English Corpora: The benefit of enriching the Penn-Helsinki Parsed Corpus of Middle English 2 (PPCME2), the Parsed Corpus of Middle English Poetry (PCMEP), and a Parsed Linguistic Atlas of Early Middle English (PLAEME). In Proceedings of the 12th Language Resources and Evaluation Conference (pp. 7170–7178). Retrieved from https://www.aclweb.org/anthology/2020.lrec-1.886

Pintzuk, S., & Taylor, A. (2008). The Loss of OV Order in the History of English. In A. van Kemenade & B. Los (Eds.), The Handbook of the History of English (pp. 249–278). Oxford: Blackwell.

Taylor, A. (2008). A Note on the Position of the Verb in Old English Rhythmic Prose. York Papers in Linguistics, 9, 124–141. Retrieved from https://www.york.ac.uk/language/ypl/ypl2/09/YPL2-09-06-Taylor.pdf

Taylor, A., Warner, A., Pintzuk, S., & Beths, F. (2003). The York-Toronto-Helsinki Parsed Corpus of Old English Prose (YCOE). York: University of York. Retrieved from http://www-users.york.ac.uk/~lang22/YCOE/YcoeHome.htm

The British National Corpus, version 3 (BNC XML Edition). (2007). Distributed by Bodleian Libraries, on behalf of the BNC Consortium: University of Oxford. Retrieved from http://www.natcorp.ox.ac.uk/

Trips, C. (2002). From OV to VO in Early Middle English. Amsterdam/Philadelphia: John Benjamins. doi:10.1075/la.60

Truswell, R., Alcorn, R., Donaldson, J., & Wallenberg, J. (2018). A Parsed Linguistic Atlas of Early Middle English. University of Edinburgh. doi: 10.7488/ds/2310

Walkden, G., & Morrison, D. A. (2017). Regional Variation in Jespersen’s Cycle in Early Middle English. Studia Anglica Posnaniensia, 52(2), 173–201. doi:10.1515/stap-2017-0007

Zimmermann, R. (2018). The Parsed Corpus of Middle English Poetry (PCMEP). http://pcmep.net

1. As of the end of 2019, the corpus will no longer be updated (see https://www.english-corpora.org/coca/).

2. For an introduction to the query language used by CorpusSearch, see the corresponding tutorial on this site.