Roman Urdu Sentiment Analysis Using Pre-trained DistilBERT and XLNet

Roman Urdu is a resource-poor language, therefore training a deep learning-based model from scratch is not that fruitful due to the lack of a large dataset. This is where the magic of transfer learning comes to the rescue. Using Huggingface's transformer models DistilBERT and XLNet we see a huge improvement in the results compared to the popular machine learning models Logistic Regression and Naïv...