Quality of Word Vectors and its Impact on Named Entity Recognition in Czech

František Dařena, Martin Süss

Quality of Word Vectors and its Impact on Named Entity Recognition in Czech

Číslo: 2/2020
Periodikum: European Journal of Business Science and Technology
DOI: 10.11118/ejobsat.2020.010

Klíčová slova: Named Entity Recognition, word embeddings, word vectors training, natural language processing, Czech language

Pro získání musíte mít účet v Citace PRO.

Přečíst po přihlášení

Anotace: Named Entity Recognition (NER) focuses on finding named entities in text and classifying them into one of the entity types. Modern state-of-the-art NER approaches avoid using hand-crafted features and rely on feature-inferring neural network systems based on word embeddings. The paper analyzes the impact of different aspects related to word embeddings on the process and results of the named entity recognition task in Czech, which has not been investigated so far. Various aspects of word vectors preparation were experimentally examined to draw useful conclusions. The suitable settings in different steps were determined, including the used corpus, number of word vectors dimensions, used text preprocessing techniques, context window size, number of training epochs, and word vectors inferring algorithms and their specific parameters. The paper demonstrates that focusing on the process of word vectors preparation can bring a significant improvement for NER in Czech even without using additional language independent and dependent resources.