relic_

You’re going to see the media organic content labels, just like groceries have “regular” and “organic”. There’s demand for such a certification so it wouldn’t surprise me to see that in the near future.

Yes but that’s related to LLMs specifically, not backpropagation. There’s plenty of ML paradigms that use backprop and have continual learning setups.

Backprop is the process of how the weights are updated.

You need to be more specific. If your point is that you literally cannot backprop while doing a forward pass, then sure. But you can certainly do inference then backprop on the outcome…

I fail to see how that is substantially different from a human doing something then reflecting and learning.

You can critique LLMs and transformers generally, but to say it’s somehow a problem with backprop is a bit of a stretch.