Fast matrix multiplications from scratch

Computational Linear Algebra
1

Hi there :wave:,

For the math / linear algebra lovers under us: I wrote a blog on explaining matrix multiplications from scratch and doing a couple of refactorings to speed things up. It’s based on lecture 1 of part2 of the 2019 course which also goes over this, but it has one last speed-up which is not covered in the lecture.

Spoiler alert: by doing so we get faster then torch.einsum :bike:

I hope you enjoy reading it, feedback welcome :slight_smile:

https://lucasvw.github.io/posts/04_matmul/

7 Likes
2

Great post. A small typo in the definition. Size shall be ‘ar x bc’.

1 Like
3

Thanks so much for noticing and letting me know @bilalUWE, I just pushed a fix :pray:

1 Like
4

Hey Lucas,

Excellent post!

Quick question, what did you use to create the images in your blog post?
(They’re very pretty!)

5

Hi @Grey-Shirt,

Thanks :pray:. I made them with draw.io, that works pretty well in my opinion!

1 Like