

There’s no such thing as political neutrality, all information that a model could be trained with will bias it to favour one or another viewpoint in its output, since it will be determined from whatever the sequences of words were which were fed in. Where do you imagine you’d get politically neutral training data from?






Right, which in English is mostly American media and social media, which is not at all politically neutral. Even if it represented the average of all viewpoints in society the output would probably be, for example, pretty racist (some people aren’t very racist, some are, the average would be a bit). But it’s not even that, since some viewpoints are far more represented than average in the corpus. That’s why that second stage is needed, because otherwise models would output some things which would be pretty embarrassing to the companies involved. Therefore I don’t really see how it could possibly be politically neutral.