I had trouble setting this up so posting this because I found an article that helped me: 5 easy steps to start editing python notebooks over SSH - Willem's Fizzy Logic
In short, set up jupyter notebook with the following flags:
jupyter notebook --no-browser --port=8080
Then, on your laptop, connect to the remote server running the jupyter notebook with:
ssh -N -L 8080:localhost:8080 <remote_user>@<remote_host>
Then go to localhost:8080 in your laptop browser to get to work!