Summarizing Documents using Fastai

(Bilal) #1

Are there methods or code for using fastai to summarize documents/ articles? Not sure if ULMFit can be used for this purpose.

1 Like

#2

What is the detail of “summarize”, what does that mean?

0 Likes

(Bilal) #3

Text Summarization - generating a summary that captures the gist of what an article/document is about.

0 Likes

(David Bressler) #4

@alvisanovari did you make any progress using ULMFit for text summarization?

0 Likes

(Bobak Farzin) #5

The RNN version of ULMFiT would work to encode. You would need a decoder that worked.

Where is a corpus of text with paired summaries? I’m know how to get that for matched languages, but where is the text & summary in the same language to train on?

0 Likes

(Bilal) #6

Unfortunately could not find anything for this task in fastai. There are other methods out there like graph based techniques: https://www.analyticsvidhya.com/blog/2018/11/introduction-text-summarization-textrank-python/

Still not as good though :confused:

0 Likes