• 0 Posts
  • 19 Comments
Joined 3 years ago
cake
Cake day: December 9th, 2023

help-circle
  • Whatever biases remain would be some kind of average of all the views of the people whose text is in the training corpus, which I hear is a pretty indiscriminate collection of literally anything people can download.

    Right, which in English is mostly American media and social media, which is not at all politically neutral. Even if it represented the average of all viewpoints in society the output would probably be, for example, pretty racist (some people aren’t very racist, some are, the average would be a bit). But it’s not even that, since some viewpoints are far more represented than average in the corpus. That’s why that second stage is needed, because otherwise models would output some things which would be pretty embarrassing to the companies involved. Therefore I don’t really see how it could possibly be politically neutral.