Unsupervised

BERT
https://github.com/google-research/bert

AlephBERT
https://arxiv.org/pdf/2104.04052.pdf

Multi-language Aspects
How Language-Neutral is Multilingual BERT?​
https://arxiv.org/pdf/1911.03310.pdf

AraBERT: Transformer-based Model for Arabic Language Understanding
https://arxiv.org/pdf/2003.00104.pdf


GPT-3
https://arxiv.org/abs/2005.14165
 
ELMo
https://allennlp.org/elmo