MultiFiT vocabulary

[muellerzr (Zachary Mueller)]

@pierreguillou

learner (language_model_learner in fastai v1).

For exactly where/how, see the convert weights function:

Lesson 4 Advanced Discussion

Correct The reasoning is there’s a convert_weights function that takes those WT103 weights (or any LM weights) to our new corpus, see it below: def convert_weights(wgts:Weights, stoi_wgts:Dict[str,int], itos_new:Collection[str]) -> Weights: "Convert the model `wgts` to go with a new vocabulary." dec_bias, enc_wgts = wgts.get('1.decoder.bias', None), wgts['0.encoder.weight'] wgts_m = enc_wgts.mean(0) if dec_bias is not None: bias_m = dec_bias.mean(0) new_w = enc_wgts.new_z…