Entity embeddings

[muellerzr (Zachary Mueller)]

@wpan

please let me know

Is there a particular reason why you extracted the layers vs using hooks to grab the output at the embedding layer? For more context:

Unable to compute intermediate layer's output to get embeddings

We have our answer! Here’s what I did, presume this is your fastai tabular model for the Adult Sample dataset. I want to grab the intermediate layer output of 100, when our FC layers are [200,100]. I do the following: with hook_outputs(learn.model.layers[:-1]) as hooks: _ = learn.model(cat,cont) I can then access these intermediate layer activations by doing: hooks.stored[-1]. This will be of shape [64,100] in this particular example For another example, if we wa…

(I guess one is more raw PyTorch while the other is more fastai like.)