The Swedish Culturomics Gigaword Corpus: A One Billion Word Swedish Reference Dataset for NLP
Paper in proceeding, 2016

In this paper we present a dataset of contemporary Swedish containing one billion words. The dataset consists of a wide range of sources, all annotated using a state-of-the-art corpus annotation pipeline, and is intended to be a static and clearly versioned dataset. This will facilitate reproducibility of experiments across institutions and make it easier to compare NLP algorithms on contemporary Swedish. The dataset contains sentences from 1950 to 2015 and has been carefully designed to feature a good mix of genres balanced over each included decade. The sources include literary, journalistic, academic and legal texts, as well as blogs and web forum entries.

A One Billion Word Swedish Reference Dataset for NLP

Author

Stian Rødven Eide

University of Gothenburg

Nina Tahmasebi

University of Gothenburg

Lars Borin

University of Gothenburg

Linköping Electronic Conference Proceedings. Digital Humanities 2016. From Digitization to Knowledge 2016: Resources and Methods for Semantic Processing of Digital Works/Texts, July 11, 2016, Krakow, Poland

1650-3740 (eISSN)

Vol. 126 002 8-12
978-91-7685-733-5 (ISBN)

Subject Categories

Language Technology (Computational Linguistics)

ISBN

978-91-7685-733-5

More information

Created

10/10/2017