Wiki: Best Practices

Would it be helpful to have a wiki post to compile best-practices/rules-of-thumb/common-methodologies (with links)?

Knowing FastAI approach, prerequisite, and find your pathway is essential:

Fastbook – for whom?
FastAI Forum – which channel for whom, would it be helpful to have some kind of label for beginners, intermediate or have 10-grade level. What this strategy and other strategies can help the FastAI Forum user. Use them more effectively.

FastAI and NLP – specific topics.

Jeremy’s FastAI Coding Style:
https://docs.fast.ai/dev/style.html

Great place about to start with Best Practices:
http://dev.fast.ai/
(Incomplete)

Understand the structure of FastAI in nutshell snapshots:

From: http://dev.fast.ai/tutorial.imagenette

30 Best practices suggested:

  1. Ask questions:

Probably, you can google or some good practice in stackoverflow or somewhere else for general ai practice, programming, etc. If you can think about something very specific for Fastai. Please add more here.

Figure out what is the uniqueness of Fastai and yourself. Good practice by asking questions:

a. How fastai is a good match for you?
b. What is your purpose of learning FastAI?
c. What is your learning rate -Lr?
d. What is your learning model, cf. ResNetX, architecture for what purpose and improvement/fine tuning?
e. What is your pattern and rhyme of your learning style?
f. What can be the loss rate of your learning?
g. How do you evaluate the accuracy and ways of validate what you learned?
h. How would you apply universal approximation theorem in your learning journey?
i. How would you deal with the data and info you get from Fastai?
j. What more questions can be helpful for you and others?

  1. Be inspired by FastAi that we can learn from about learning models and the process of developing AI fast or slow as our own learning journey, which can be extended much further beyond fastai. Thus, Thank you FastAI and the community.

Paraphrase of Jeremy’s Comment about the paper:

  1. Familiar stuff looks complex
  2. Important beyond basic, but hard to read
  3. Look for a blog about the paper
  4. Learn Greek alphabet(which is used in the paper) in Wikipedia or detexify.

Data Set

  • Split your training set into training/validation sets (roughly 80/20) (source)
  • Do as much of your work as you can on a small sample of the data (source)
3 Likes

Nice idea! I’ve made it into a wiki post so others can edit.

I thought about titling it “Jeremy says…”, but thought better of it. :slight_smile:

It is good to start from here:

https://docs.fast.ai/index.html

This is a good one, but 2 years ago.

Probably, you can google or some good practice in stackoverflow or somewhere else for general ai practice, programming, etc. If you can think about something very specific for Fastai. Please add more here.

Thus, I add one more.

  1. Figure out what is the uniqueness of Fastai and yourself. Good practice by asking questins:
    a. How fastai is a good match for you?
    b. What is your learning rate -Lr?
    c. What is your model, cf. ResNet?
    d. What is your pattern and rhyme of your learning style?
    e. What can be the loss rate of your learning?
    f. How do you evaluate the accuracy and ways of validate what you learned?
    g. How would you apply universal approximation theorem in your learning journey?
    h. How would you deal with the data and info you get from Fastai?

I am inspired by FastAi that I can learn from about learning model and the process of develop AI fast or slow as my own learning journey, which can be extended much further beyond fastai. Thus, Thank you FastAI and the community.