Tokenlearn
Tokenlearn
Pre-train Static Word Embeddings
Tokenlearn is a method for pre-training Model2Vec models. It uses a pre-distilled Model2Vec model and pre-trains it on a large corpus of mean embeddings from a teacher model.
Quick Start
Installation
Install Tokenlearn with the following command:
Creating Features
Create features with the following command:
Training a Model
Train a model with the following command: