Time series/ sequential data study group

vrodriguezf · February 2, 2021, 12:55pm

Soon there will be a ROCKETology the same way that NLP folks have the BERTology

oguiza · February 2, 2021, 2:21pm

Wow. Thanks for sharing @vrodriguezf!
And congratulations @angusde on your Time Series Classification SOTA. Very impressive!! The work you and your team is doing is superb, and so different from everything else in these area.
In the end we’ll need to become rocket scientists to be able to apply your research!

saiyan6174 · February 2, 2021, 11:30pm

Thanks for sharing the Zotero library, victor.

Also any cool dataset suggestions to just try out different classification models and learn parallelly? I was a forecasting guy mainly focused on statistical methods and now I’m looking to get my hands dirty with deep learning for ts classification tasks.

angusde · February 2, 2021, 11:55pm

All credit to Chang Wei here, this is essentially all his work.

harikrishnanrajeev · February 3, 2021, 9:43am

development of methods to isolate the relevant signals in these convolutions will be highly productive

… Eagerly looking forward to it.

Authors , Thanks so much for your work.

oguiza · February 4, 2021, 10:55am

PredictionDynamics for time series

Hi,
I just wanted to share a new, brief tutorial notebook I’ve uploaded to the tsai repo to show how you can now use the new PredictionDynamics callback to visualize the model’s prediction during training.
You can use it with any DL model (not just time series), in classification or regression tasks.
I think it’s useful to get a better understanding of how training is progressing.

This is the type of output you’ll get during training (it’s updated at the end of every epoch):

vrodriguezf · February 4, 2021, 6:36pm

wow that’s really cool, thanks!!! I love this kind of interpretability tools! Btw can you share the blog post of Mr. Karpathy? The link of the notebook is broken

Would it be possible to see the evolution of that plot after the training has ended? Is it stored somewhere?

oguiza · February 4, 2021, 6:53pm

Thanks for your feedback @vrodriguezf!

Here’s the link (I’ll fix it on the notebook).

I don’t store the evolution anywhere as it’d probably slow down the process considerably. It takes 250 ms to update the chart, but to save is probably much slower. I’ll check it anyway. Something we could have though is an option to save it, knowing it’ll make training slower. What’s your use case for storing the evolution? How would you use it?

vrodriguezf · February 4, 2021, 6:59pm

Probably it only makes sense if behind of your training you are using an experiment tracking tool like weights & biases. That tool does exactly that, log things (e.g. the activations of your layers) for each training step, to allow a easy navigation through them afterwards.

I can think about and make a PR if I manage to spare some coding time

oguiza · February 6, 2021, 5:29pm

Meeting with Angus Dempster - Rocket, MiniRocket, and MultiRocket

Hi all,

I’d like to invite you to participate in a web meeting we’ll have with Angus Dempster next week (@angusde ).

For those of you who don’t know him, Angus is a Ph.D. student at Monash University in Australia (a world-class group in time series research) and is one of the authors of several outstanding papers:

Dempster, A., Petitjean, F., & Webb, G. I. (2020). ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels. Data Mining and Knowledge Discovery , 34 (5), 1454-1495.
Dempster, A., Schmidt, D. F., & Webb, G. I. (2020). MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification. arXiv preprint arXiv:2012.08791 .
Tan, C. W., Dempster, A., Bergmeir, C., & Webb, G. I. (2021). MultiRocket: Effective summary statistics for convolutional outputs in time series classification. arXiv preprint arXiv:2102.00457 .

As you probably know, the ROCKETs have made a very significant impact in Time Series Classification and Regression. They are not only incredibly fast but have established a new SOTA!

Interestingly, the ROCKET’s use a very different approach compared to all other algorithms.
If you want to learn more about how they work and want to take the opportunity to ask one of the top researchers in the area of time series come and join us!

Date/ Time:

February 10th (Wednesday) from 5:00 to 6:00 am Australian Eastern Daylight Time
February 9th (Tuesday) from 7:00 to 8:00 pm Central European Time
February 9th (Tuesday) from 1:00 to 2:00 pm Eastern Standard Time

If you are willing to participate, please reply to this blog post indicating so and I will forward you the link to the meeting through the forum’s email. We’ll use Google Meet.

meanpenguin · February 6, 2021, 7:50pm

i’m interested please send invite

geoHeil · February 8, 2021, 6:50am

I am also interested - please send the invite.

harikrishnanrajeev · February 8, 2021, 6:53am

I am interested. Kindly send the invite.

mrfabulous1 · February 8, 2021, 6:54am

Hi oguiza hope all is well!

Could you send me an invite also?

kBodolai · February 8, 2021, 8:52am

I’d love to join this!

GPialla · February 8, 2021, 9:53am

Hi @oguiza
I am also very interested.
Can i get an invite?

morgan · February 8, 2021, 12:58pm

would love to join

Helicopter9005 · February 8, 2021, 1:13pm

Hello @oguiza.

I am excited to join as well!
Would you please kindly send me a link?

Thanks for organising it (and this amazing forum and tsai)

Ezno · February 8, 2021, 1:51pm

I am interesting in participating. Please send the invite!

florianl · February 8, 2021, 2:02pm

thanks for arranging this meeting. I’d like to participate :).