Lambda GPU Cloud for Deep Learning (A100s at $1.10/GPU/hr) - $150 sign up credit

Hi everyone -

Very excited to be here and evangelize Lambda’s GPU cloud service for deep learning.
Lambda GPU Cloud provides instant access to cloud NVIDIA GPUs.

@Justinpinkney , @Jordan_Lambda and myself (@mitesh) - we will be happy to answer any questions/comments/queries that anyone here has as best and as fast as we can (you can reply under this topic for any questions). We look forward to learning from your feedback as we work on making Lambda a robust cloud offering.

With Lambda GPU Cloud, you have:

  • TensorFlow, JupyterLab, PyTorch, and other popular ML software pre-installed
  • persistent storage to save your datasets and other files (in beta - for certain instance types only)
  • root access to your instances via SSH

Some of our current limitations are:

1 - No API offering
2 - No instance suspension
3 - Persistent storage in Beta
4 - No fast.ai image yet

Here are some resources that can help with FAQs:

  1. Sign up and FAQ website - GPU Cloud - VMs for Deep Learning | Lambda

  2. Our (just started) documentation portal - Lambda GPU Cloud | Lambda Docs

  3. Some useful articles:
    a) How to Transfer Data to Lambda Cloud GPU Instances
    b) Setting Up A Kubernetes Run:AI Cluster on Lambda Cloud
    c) Multi node Distributed Training with PyTorch APIs and mpirun

  4. Other interesting GPU benchmarks and blogs from Lambda - The Lambda Deep Learning Blog

  5. @Justinpinkney is the creator of the viral text-to-Pokemon model (based on Stable Diffusion) and his how to is here:
    How to fine tune stable diffusion: how we made the text-to-pokemon model at Lambda

Finally - what can you look forward to on Lambda Cloud in the next few months(part of what we are working on to improve our cloud offering):

  1. APIs (for programmatic spin up and down of instances)
  2. Region based persistent storage also rolling out (alpha)
  3. Instance suspension
  4. Security group rules (user based control)
  5. Team based accounts

Currently - Lambda Cloud has NVIDIA A100 40GB, A6000s and V100 GPUs.
Lambda will be launching:

  1. A100 80GB in November
  2. H100 80GB in Q1 2023 (sorry for the vagueness - at mercy of GPU supply chain)

We are very very excited to provide the GPUs at competitive rates for on demand cloud services - anywhere from 10-70% cheaper (depending on whether you are using spot or on demand instances on any other public cloud providers). Here is a third party summary of all the cloud providers and their pricing that we have found to be accurate:

SIGN UP CREDIT - For availing $150 sign up credit for Lambda - please email mitesh@lambdal.com from the email that you use to sign up for Lambda cloud with the email Subject:
“fast.ai credit”

Please note -

  1. You will have to sign up on Lambda cloud here first for us to be able to apply the credits: GPU Cloud Sign Up | Lambda
  2. for internationals - our firewall and authentication checks might prevent you from creating an account - due to credit card authentication not going through. Please still email as per above (email from your account email to mitesh@lambdal.com with the Subject: “fast.ai credit” and we will make sure to authenticate your account and apply the credits).
  3. If you already use Lambda cloud - please still email as above and we will apply the credit to your account.

Looking forward to a great part 2 from Jeremy and learning from everyone’s feedback.

Cheers,
Lambda Cloud Team

48 Likes

Wow that’s really generous @mitesh – thanks for this fantastic support of the fast.ai community.

11 Likes

Hi, this is a very generous offer, thanks!

Is it possible to make an account and get the credit with a private email (gmail)? I see you ask for a “Work email” on signup.

Yes, it is. Sorry for confusion - to clarify - it does not have to be work email; the request for credit has to be sent from the same email that you use to sign up on Lambda cloud platform.

6 Likes

Thank you! :slight_smile: Really appreciate it

1 Like

Apologies for the deleted post, i was going to ask for troubleshooting help, but turned out that it just started working, so disregard!

After suffering quite a bit with Paperspace, I’m giving Lambda Could a try. Thanks for the generous $150 credit!

2 Likes

Lambda is awesome. The main thing they are missing at the moment is the option to pause/start an instance.

2 Likes

Thank you so much. We are coming out with persistent storage in first week of February across all instances which will be soon be followed by instance suspension - thank you for your patience while we work on making Lambda cloud robust for all use cases (within deep learning).

6 Likes

Hi, sorry, I wrote a few emails about lambda support but did not get any feedback. Are you still providng a 150$ credit?

2 Likes

Hi everyone - thank you for using Lambda cloud. The above credit program has now been retired. We are working on adding more GPUs to our cloud platform.

2 Likes

Hi mitesh, it there any other credits like this? I am new to

1 Like