I struggled a bit to find instructions to install it. These are the commands that worked for me in the end:
conda install -c conda-forge jupyter_contrib_nbextensions
cd ~/anaconda3/envs/fastai/lib/python3.6/site-packages/jupyter_contrib_nbextensions/nbextensions
jupyter nbextension install collapsible_headings --user