If you’re open to hosting your model in the cloud it’s easier to get larger models to work on mobile.
In my other blog, I hosted my model on Hugging Face Spaces and call the model endpoint in my app. The app was made using Flutter so it works on iOS and Android. It can even be made to work as a web app. But I’ve not tried this.
The plus point of doing this is that you don’t have to deal with model conversion, optimizing model on your device, etc.