What you are looking for is called Adaptive Pooling. Below is thread that you can read to understand more about it. And as jeremy said, he will also cover this in class. So, you can have a second go at this concept later when this covered. 
1 Like