Would IPython Notebook do it for you, too (instead of an IDE)? If you do it in a virtualenv, it shouldn’t mess up anything. Just a few commands (but quite some megabytes) and you’re in your notebook. (Worked for me in Ubuntu and Lubuntu).
conda create -n myenv
source activate myenv
conda install jupyter
conda install -c pytorch -c fastai fastai
jupyter-notebook
You can still install a proper editor (Visual Studio Code or Sublime Text) just normally with apt-get or GUI tools, to be able to navigate in fastai or pytorch code.