Skip to main content

LUP Student Papers

LUND UNIVERSITY LIBRARIES

Sentiment Analysis for Talent Attraction

Zec, Jelena LU (2023) DABN01 20231
Department of Economics
Department of Statistics
Abstract (Swedish)
The reputation of a company on employer review platforms can have a significant impact on its ability to attract talented workers. Companies use sentiment analysis to learn how their employer brand is perceived online. Furthermore, sentiment analysis can detect strengths and weaknesses in their employer brand, indicating which areas need improvement.
The proposed methods for improving word embeddings for sentiment analysis commonly involve combining several pre-trained word embeddings, or concatenating vector representations of non-textual elements (e.g., emojis and images) to word embeddings. These methods involve training complex neural networks, which is usually computationally expensive.
This thesis investigates if adding features... (More)
The reputation of a company on employer review platforms can have a significant impact on its ability to attract talented workers. Companies use sentiment analysis to learn how their employer brand is perceived online. Furthermore, sentiment analysis can detect strengths and weaknesses in their employer brand, indicating which areas need improvement.
The proposed methods for improving word embeddings for sentiment analysis commonly involve combining several pre-trained word embeddings, or concatenating vector representations of non-textual elements (e.g., emojis and images) to word embeddings. These methods involve training complex neural networks, which is usually computationally expensive.
This thesis investigates if adding features prior to tokenization, instead of concatenating embeddings, increases the accuracy of word embeddings, thereby improving the results of the fine-tuned BERT model for classifying sentiment of employer reviews on the online platform Glassdoor. It also investigates the impact of the BERT Next Sentence Prediction objective on the models’ ability to learn more accurate word embeddings.
Testing three different models and comparing their performance indicates that the suggested approach can improve the model’s accuracy. However, additional research is needed to investigate the impact of the chosen features on the observed results. The study hasn’t found enough evidence that addition of the Next Sentence Prediction objective results in higher accuracy of the model, but it shows that it significantly improves model ability to understand the sentiment of the reviews. (Less)
Please use this url to cite or link to this publication:
author
Zec, Jelena LU
supervisor
organization
course
DABN01 20231
year
type
H1 - Master's Degree (One Year)
subject
keywords
NLP, sentiment analysis, BERT, transformers
language
English
id
9117989
date added to LUP
2023-11-21 12:54:48
date last changed
2023-11-21 12:54:48
@misc{9117989,
  abstract     = {{The reputation of a company on employer review platforms can have a significant impact on its ability to attract talented workers. Companies use sentiment analysis to learn how their employer brand is perceived online. Furthermore, sentiment analysis can detect strengths and weaknesses in their employer brand, indicating which areas need improvement.
The proposed methods for improving word embeddings for sentiment analysis commonly involve combining several pre-trained word embeddings, or concatenating vector representations of non-textual elements (e.g., emojis and images) to word embeddings. These methods involve training complex neural networks, which is usually computationally expensive.
This thesis investigates if adding features prior to tokenization, instead of concatenating embeddings, increases the accuracy of word embeddings, thereby improving the results of the fine-tuned BERT model for classifying sentiment of employer reviews on the online platform Glassdoor. It also investigates the impact of the BERT Next Sentence Prediction objective on the models’ ability to learn more accurate word embeddings. 
Testing three different models and comparing their performance indicates that the suggested approach can improve the model’s accuracy. However, additional research is needed to investigate the impact of the chosen features on the observed results. The study hasn’t found enough evidence that addition of the Next Sentence Prediction objective results in higher accuracy of the model, but it shows that it significantly improves model ability to understand the sentiment of the reviews.}},
  author       = {{Zec, Jelena}},
  language     = {{eng}},
  note         = {{Student Paper}},
  title        = {{Sentiment Analysis for Talent Attraction}},
  year         = {{2023}},
}