Run fast.ai model in the browser with fast.ai 2

Part 1 (2020)
1

I’m trying to run a fast.ai model with onnx in the web browser

I found a working solution for fast.ai 1: How to run a fastai model in the browser

  • Replaced cnn_learner with custom cnn_learner
    • Solves the problem with "TypeError: unrecognized operator ‘Shape’

I’m trying to migrate the code to fast.ai 2.
-> https://github.com/gfeller/react-ml-app/blob/master/00_michael-bundesrat.ipynb

  • Replaced cnn_learner with custom cnn_learner
    • Flatten() -> nn.Flatten()
    • dls.add_tfms -> dls.after_batch

I can export the model and load the model with onnxjs:
-> https://github.com/gfeller/react-ml-app/blob/master/src/components/utils.js#L37

But running the model await session.run([warmupTensor]); results in “invalid inputs detected; op: BatchNormalization_50”

Any ideas how I can fix it?
Or is there any other way to use a fast.ai model directly in a browser?

Thanks a lot!

1 Like
2

It works if the check is disabled…

# disable check
# if (!(t = e.op).checkInputs(h)) throw new Error("invalid inputs detected; op: " + e.node.name);
t = e.op  # works