Using embedding from the Neural Network in Random Forests

[muellerzr (Zachary Mueller)]

Got the answer to this finally, we can use hooks:

Unable to compute intermediate layer's output to get embeddings

We have our answer! Here’s what I did, presume this is your fastai tabular model for the Adult Sample dataset. I want to grab the intermediate layer output of 100, when our FC layers are [200,100]. I do the following: with hook_outputs(learn.model.layers[:-1]) as hooks: _ = learn.model(cat,cont) I can then access these intermediate layer activations by doing: hooks.stored[-1]. This will be of shape [64,100] in this particular example For another example, if we wa…