Great explanation @Pomo. I think with large enough conv1d , ROCKET can create a sufficient and dense feature space that we can think of it like a dictionary to look up. Imagine it a kind of spectrogram with small dilation conv1d cover high frequency and large dilation for small frequency.
P/s: I’ve just found that the repo you refered to ROCKET for fastai is compatible for version 2 now. It is updated yesterday. But I cannot find the information about ROCKET. Can you please take a look at it to see if the author just removed something ? Thanks