I asked Ian Goodfellow (the author of the paper) recently about maxout, and he said he still thinks it has potential, even though it hasn’t been used much.
I haven’t seen it used in successful kaggle solutions, however, which I don’t think is a good sign. I tend to stick with stuff that wins competitions, since that’s where we see state of the art results pretty much every time.