Just made the first edit a few minutes ago, but surely there is more to include
For folks involved in anything huggingface, this is the place to address the issues you are having w/r/t to working with that library in fastai as well as recommendations for general improvement. Please include any relevant forum posts or projects at the bottom as well as help flesh out the issues and needs in the “Issues/Recommendations” section.
Any questions, I think we can talk about them here.
Nice work, great descriptions and suggestions. Do you think its worth adding something related to the named tensors that HF just implemented (to complement the dict integration)?
Also, do you think its worth adding a wrapper to utilise the tokenizers from transformers and/or tokenizers library?
Where is the info on the named tensors functionality? Haven’t seen that, but it makes sense to add it to the wiki as we’re likely to see more frameworks likely incorporate named tensors as well.
Sure. Maybe a recommendation that the option exist in fastai to use either???