I would like to make my Kaggle submission from my PC, but I'm having problems copying the CSV file from the server to my machine.
My unix exposure is about 30-plus years old, and I'm still getting used to AWS and learning bash. But I've been through the Andrew Ng ML course on Coursera, as well as the Learning From Data course on edX by Caltech, so lots of the concepts make sense. I have a Kaggle account and made it to the top 26% on a competition last year about voter intentions as part of the Data Analytics MOOC.
(Frustrating, because I stepped through the whole modeling process in a jupyter notebook over the course of several hours, and I think I may have a reasonably good submission, even though it is only my first time through the process.)
But syntax is everything, eh?
Enough background and whining...
I tried FileLink, which quickly gave me a URL in the jupyter cell, but clicking on it gave me a 404 not found error. I tried to make sense of Stack Overflow discussion about FileLink and the trees it recognizes, but I never understood how to overcome my problem.
So then I turned to scp, tried basic syntax,
scp username@remote:/file/to/send /where/to/put
in my case, something like this in a cygwin bash session on my PC:
scp @:/home/courses/README.md C:/BigData
where "C:/BigData" is a folder on my machine. After failing to get the actual submission file, I thought I would simplify the problem and just copy a text file higher up the directory tree, namely /home/courses/README.md
I also tried using this for the destination: /cygwin/c/BigData
Same error in all cases for using scp: Permission Denied (public key)
Based on Stack Overflow suggestions, I've tried these things with the same result:
scp firstname.lastname@example.org:~/scraper/summary.csv /home/barns/Desktop (add a tilde)
scp -vvv email@example.com:~/scraper/summary.csv /home/barns/Desktop (add a -vvv)
I got a bunch of lines from -vvv. One told me scp was trying the right ip address, but using port 22. Can that be right? Is that a problem? Instead of port 8888 where the notebooks are?
I can see the right ip address in .ssh/known_hosts on my local machine
The only file with a "pem" in it is aws-key-fast-ai.pem
Do I need a pem file for AWS?
I've spent over an hour searching the Forum on Lesson 2 and reading Stack Overflow without reaching a solution. If you've followed me this far, you can tell I'm very confused. If anyone could give me a few guidelines, preferably with explicit syntax for an imaginary system, I would appreciate it. Thank you.