I feel I should understand it, but it’s just outside of my reach. It’s now 10 years after university.
My guess ist that even if it would be better when it comes to generic text, most of the texts which really mean something have a lot of context around them which a model will know nothing about and thus will not know what is important to the people working with this topic and what is not.
Capitalism is awesome!
So are nightmares and religion, but they still can fuck you up ;)