Genre Annotation of Web Corpora: Scheme and Issues
| Authors | |
|---|---|
| Year of publication | 2021 |
| Type | Article in Proceedings |
| Conference | Proceedings of the Future Technologies Conference (FTC) 2020, Volume 1 |
| MU Faculty or unit | |
| Citation | |
| Web | Elektronická verze sborníku |
| Doi | http://dx.doi.org/10.1007/978-3-030-63128-4_55 |
| Keywords | Corpus annotation; Inter-annotator agreement; Text genre; Web corpora |
| Description | Unlike traditional corpora made from printed media in the past decades, sources of web corpora are not categorised and described well, thus making it difficult to control the content of the corpus. This paper presents an attempt to classify genres in a large English web corpus through supervised learning. A set of genres suitable for web corpora users is defined based on a research of related work. A genre annotation scheme with active learning rounds is introduced. A collection of web pages representing various genres that was created for this task and a scheme of consequent human annotation of the data set is described. Measuring the inter-annotator agreement revealed that either the problem may not be well defined, or that our expectations concerning the precision and recall of the classifier cannot be met. Eventually, the project was postponed at that point. Possible solutions of the issue are discussed at the end of the paper. |
| Related projects: |