Are there methods or code for using fastai to summarize documents/ articles? Not sure if ULMFit can be used for this purpose.
1 Like
What is the detail of “summarize”, what does that mean?
Text Summarization - generating a summary that captures the gist of what an article/document is about.
The RNN version of ULMFiT would work to encode. You would need a decoder that worked.
Where is a corpus of text with paired summaries? I’m know how to get that for matched languages, but where is the text & summary in the same language to train on?
Unfortunately could not find anything for this task in fastai. There are other methods out there like graph based techniques: https://www.analyticsvidhya.com/blog/2018/11/introduction-text-summarization-textrank-python/
Still not as good though 