A Lite BERT and Statistical Language Models
- Mentors
- Ayushk4, Avik Sengupta
- Organization
- The Julia Language
JuliaText is a JuliaLang organization that provides packages to work with text. The aim of this project is to enrich TextAnalysis.jl with Framework for Statistical Language models and Practical implementation of Pretrained ALBERT.
ALBERT is a deep-learning natural language processing model that uses far fewer parameters than BERT (Devlin et al., 2019) without sacrificing accuracy.