Thank you! this exactly the issue conda and venv are separate environments and conda command was not installing the package in my venv.
I used the below command to install fastai:
C:\Users\Samtha\Documents\automation_tool\venv\Scripts\pip install fastai==1.0.61 --no-cache-dir
Here I had to specifically pick the pip path of my venv environment. The simple pip command was also not installing in the correct path for some reason, it kept installing the fastai in C:\Users\Samtha\Anaconda3