Intelligent sentence/phrase embeddings

Part 2 (2017)
1

Hi Everyone,

I am sure many of your ideas will help in coming up with an intelligent sentence/phrase embeddings.
In the class @jeremy taught us one of the ways like summing up the word embeddings to come up with sentence embeddings of required dimensions.
Other may be to concatenate word embeddings to form sentence embeddings.
Any other suggestions ?

2

Bidirectional LSTM with attention would be the main way nowadays…

3

@jeremy thank you. Is this paper a good starting point to implement and keep it in our toolbox ?

4

I haven’t seen that paper before - looks interesting though… I was just referring to using the same approaches we learnt in lessons 12 & 13.

1 Like