I’d wager it’s simply not possible to be profitable using AI for most use-cases. You either burn way too many tokens on your queries or risk your business falling victim to an under-tokenized AI hallucination.
I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
I know I am getting down voted for this because people haven’t tried it.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption, I have plenty of lived experience. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
This logically leads to a similar question to OP’s again: if it’s so easy to cut down on hallucinations, then why haven’t the designers of this software already integrated that in?
That’s the economists angle, yes, but that’s not what I’m getting at.
You can’t make a business with AI because anyone can use an LLM to do anything an LLM can do.
There are exceptions in the short term, but they may not last. For example, we’re paying a hefty subscription fee for an AI service that scrapes financial data from scanned pages. It’s much more accurate than traditional OCR.
Presently its better than its competitors so commands a premium price. However, I don’t think it will enjoy that position for long.
This doesn’t make a lot of sense. Just because everyone can use Word doesn’t mean you can’t make a business using it. Oh no, everyone has calculators, guess you can’t have a business that uses calculators. Businesses and people in general use the best tools available for the job, which might be pencil and paper, or eventually an LLM.
If you noticed that calculators were really good at adding up numbers, and started a business using a calculator to add up numbers for people, you won’t attract any customers because people can just use their own calculators.
That does not mean businesses do not use calculators.
I’d wager it’s simply not possible to be profitable using AI for most use-cases. You either burn way too many tokens on your queries or risk your business falling victim to an under-tokenized AI hallucination.
Or any AI hallucination
I love the assumption that if you spend enough tokens, it won’t hallucinate, like it isn’t a mathematical certainty or anything.
You can cut hallucinations by 90% just by prompting the LLM to.not guess API and function names and to provide it with full docs or MCP to find docs.
Yeah but it’s not guessing in the first place. It has zero reasoning skills. It just outputs the most likely next word. Even when you ‘tell it not to’
I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption, I have plenty of lived experience. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
This logically leads to a similar question to OP’s again: if it’s so easy to cut down on hallucinations, then why haven’t the designers of this software already integrated that in?
This is kinda fundamental to economics: the moment AI learns to perform some task, that task becomes less valuable.
But then aren’t there just different tasks to do? VisiCalc and Excel didn’t make accountants irrelevant.
That’s the economists angle, yes, but that’s not what I’m getting at.
You can’t make a business with AI because anyone can use an LLM to do anything an LLM can do.
There are exceptions in the short term, but they may not last. For example, we’re paying a hefty subscription fee for an AI service that scrapes financial data from scanned pages. It’s much more accurate than traditional OCR.
Presently its better than its competitors so commands a premium price. However, I don’t think it will enjoy that position for long.
This doesn’t make a lot of sense. Just because everyone can use Word doesn’t mean you can’t make a business using it. Oh no, everyone has calculators, guess you can’t have a business that uses calculators. Businesses and people in general use the best tools available for the job, which might be pencil and paper, or eventually an LLM.
You’re conflating a tool with a service.
If you noticed that calculators were really good at adding up numbers, and started a business using a calculator to add up numbers for people, you won’t attract any customers because people can just use their own calculators.
That does not mean businesses do not use calculators.