Using process_one instead of process in pre-processing

Hi, my company firewall won’t let any multi-core preprocessing happen for me, so I’m trying to use just one core. I have looked through the code that I should use the process_one method instead of the process method in my tokenizer, as this will call the _process_all_1 in turn, but I cannot figure out how to tell fastaiv1 about it.
Any help is appreciated!

You should just change defaults.cpu to 1, that will normally solve your problem.

1 Like