Per other thread, @sgugger has added a resize_method parameter that helps with this.
Thanks @jeremy and @sgugger!