Ingeneral, what is the distribution of the weights?

I just have a question that, is there a general distribution of weights in NN?
Let’s say we trained a NN, and can we diagnose the NN based on the distritbuion of the weights of each layer?
Does typical networks (eg Resnet, MobileNet) have a standard distribution of weights?