Summarizing Documents using Fastai

Are there methods or code for using fastai to summarize documents/ articles? Not sure if ULMFit can be used for this purpose.

1 Like

What is the detail of “summarize”, what does that mean?

Text Summarization - generating a summary that captures the gist of what an article/document is about.

@alvisanovari did you make any progress using ULMFit for text summarization?

The RNN version of ULMFiT would work to encode. You would need a decoder that worked.

Where is a corpus of text with paired summaries? I’m know how to get that for matched languages, but where is the text & summary in the same language to train on?

Unfortunately could not find anything for this task in fastai. There are other methods out there like graph based techniques:

Still not as good though :confused: