Classifying visualized embeddings?

I have about 500 cnn models trained for classification task.(in theory)

Half scored well on a test set. half scored poorly on the same test set.

If I visualized the final embeddings layer for each model.

Would it be reasonable to train a resnet classifier to predict “good model/bad model” just by looking at the final embeddings layer of each model?

I’m considering starting this project.
Does anyone have any experience, thoughts, or resources that might help?

Any help would make my day. Cheers!

ps. here is where i’ve looked so far for how to visualize the embeddings: