How to set up AWS for Part 1 v2

wbrucek · November 24, 2017, 12:36am

I’ve found lots of posts, some videos, but I’m not sure exactly what to use/follow. I imagine there’s an AMI that’s mostly set up already.

Here’s what I’ve found:

Comprehensive setup instructions and video, apparently for the previous course: http://wiki.fast.ai/index.php/AWS_install
This refers to an AMI that works with a p2 or p3, and also how to set up a p3: Using AWS P3 instances
An AMI for testing - is this the one? AWS AMI available for testing
Introductory workshop - says an AMI will be available. In-class discussion: Introductory workshop
Some alternate scripts for setting up AWS: AWS GPU install script and public AMI

lgvaz · November 24, 2017, 12:57am

I would suggest this awesome write up from @reshama

Partha · November 26, 2017, 4:12pm

Yes follow reshmas…She did a fantastic job…I was newbee as well…now i am comfortable in AWS…
Let me know if you have any question…even simple ones…i will do my best…
Partha

github.com

reshamas/fastai_deeplearn_part1/blob/master/tools/aws_ami_gpu_setup.md

# AWS fastami GPU Image Setup
fastai.ai Part 1 v2  
Notes from Lesson 2 live on 06-Nov-2017  

---
## Part I - Setting up AMI

AMI (Amazon Machine Image):  a template for how your computer is created

### Step 0:  Getting Started
Log into AWS Console:  http://console.aws.amazon.com/  
Select Service:  `EC2`  
`Launch Instance`

### Step 1:  Choose an Amazon Machine Image (AMI)
* Search Community AMIs [left menu]
* Search:  `fastai`
* Select this image (for region N. Virginia):  `fastai-part1v2-p2 - ami-c6ac1cbc`  

**NOTE:**  this AMI is available in a number of regions.  Check your local region first.  If it's not available, check next closest region.

This file has been truncated. show original

naveenmanwani · November 27, 2017, 10:04am

guys as soon as i did .ssh ubuntu@xx.xx.xx.xxx -L8888:localhost:8888
i got this in return
ssh: connect to host xx.xx.xx.xxx port 22: Resource temporarily unavailable
could anyone help me in figuring out where actually the problem is

ecdrid · November 27, 2017, 10:32am

Wait for few minutes after the launch of the instances…

naveenmanwani · November 27, 2017, 10:39am

thanks for replying it’s been 30 minutes ,but still it’s showing me the same error as above

ecdrid · November 27, 2017, 11:11am

Can you share the screen shot of your terminal…

naveenmanwani · November 27, 2017, 11:36am

ser

here you go

ecdrid · November 27, 2017, 1:23pm

Are you sure you are in the correct directory??

Moreover the command is also incorrect…

it’s ssh -i … Acceskeyfile…

try
ls -a
And if there’s a .SSH folder,
Do a
cd .ssh/

Have a search beforehand…

Vishucyrus · November 27, 2017, 1:59pm

Hey Naveen … Are you using some shared LAN like in a University … ? It does happen that when LAN is used the ssh request bounces many times and then timeout occurs. However if you use wifi instead it gets connected instantly. So you can do one thing … Just use your mobile wifi for connecting to AWS and then continue using it with ur LAN . It then works smoothly.

naveenmanwani · November 27, 2017, 2:11pm

@ecdrid as you guided me ,here are the results,could you please tell me know what mistake i must have did

ecdrid · November 27, 2017, 2:12pm

Where’s your .pem file??

ecdrid · November 27, 2017, 2:13pm

Have a look at wiki lesson 1…

There’s a doc file there…

Or have a look at reshma’s post

ecdrid · November 27, 2017, 2:14pm

github.com

reshamas/fastai_deeplearn_part1/blob/master/tools/aws_ami_gpu_setup.md

# AWS fastami GPU Image Setup
fastai.ai Part 1 v2  
Notes from Lesson 2 live on 06-Nov-2017  

---
## Part I - Setting up AMI

AMI (Amazon Machine Image):  a template for how your computer is created

### Step 0:  Getting Started
Log into AWS Console:  http://console.aws.amazon.com/  
Select Service:  `EC2`  
`Launch Instance`

### Step 1:  Choose an Amazon Machine Image (AMI)
* Search Community AMIs [left menu]
* Search:  `fastai`
* Select this image (for region N. Virginia):  `fastai-part1v2-p2 - ami-c6ac1cbc`  

**NOTE:**  this AMI is available in a number of regions.  Check your local region first.  If it's not available, check next closest region.

This file has been truncated. show original

…

Just follow it blindfolded…

ecdrid · November 27, 2017, 2:15pm

Do create a access key pair file using AWS webpage and then move that file to .SSH directory…
And then run the command…

ecdrid · November 27, 2017, 2:20pm

Jeremy did give a session doesn’t AWS at the end of his lecture…

Either the 1st or 2nd…(not sure which one)

Vishucyrus · November 27, 2017, 2:20pm

It was 2nd lecture.

naveenmanwani · November 27, 2017, 2:31pm

please @ecdrid and @Vishucyrus correct me if i’m wrong
first step
ssh-keygen -t rsa
after getting those keys i should moved it to my hard drive
using this command
cp .ssh/id_rsa.pub /mnt/c/Users/ADMIN/Documents/
then share this key to AWS through import key option .

if this method of mine is correct .could you please tell me how to create a .pem file

Vishucyrus · November 27, 2017, 2:56pm

In the lecture Jeremy only used ssh-keygen … (without -t rsa)
I don’t know about creating a .pem file… But I guess you want this to use with putty… If so then you don’t need to create .pem file. You can follow these steps…

cp .ssh/id_rsa /mnt/c/Users/ADMIN/Documents/
Open PuTTYgen app and load id_rsa
Click “Save private key” with the name id_rsa.ppk
Use this to connect to your AWS instance with puTTY .

Note - I tried to do this with puTTY but got the same result until I changed my Internet Source.

ecdrid · November 27, 2017, 2:58pm

we can create .pem file using aws website itself…