

Nice. I just wondered how they were coming along.
Right now, I have to manage which model does what. So I don’t. It’s the companies dime after all, and they clearly value speed over efficiency. But the model I directly talk to doesn’t need to be super high end. It could be well versed in which model is best for what task and farm put all of the work to the right model for the job. Seems like that alone could reduce cost a ton. But then start adding in cheaper local models and the price could fall a ton.
It would also be more accurate. Like if I had a small local model for interacting with a set of apis. It wouldn’t make the mistake of not considering that the api paginates results. The general model makes this mistake over and over.
So I agree this is the direction of the future. Just trying to figure out when we will get there.




Ok, I get it. Your mind is made up, don’t confuse you with facts. You aren’t even reading what I am typing.