Inverting the softmax without knowing input activations

Hi Zach. If you know the constant then it is invertible. That would serve as a constraint on the activations.

I did not try Leon’s solution, imagining that if you applied the right constant to his result you would get back the original activations.

1 Like