"Correction" tool

The issues is pretty self-explanatory really, the LLM tends to call the “correction” tool in response to in-character dialogue. The real issue is I can’t exactly figure out WHY it’s up to the LLM to decide this? I mean LLMs are good at generating a sentence based on what they have trained on and probabilities, they are rather terrible at reasoning and deciding things so why is the LLM even deciding this stuff for us?

Plus realistically it either costs us money via credits or it costs you money if we use the default model so it sort of makes no sense to me WHY it’s up to the LLM to decide when it “thinks” we want to make out of character corrections? An easier and more logical way to implement this would be a button we could press or an option we could choose from a drop-down menu to “talk to the DM out of character”.

I sort of get the urge to mimic a real D&D game where everything is fluid and we just use the same text box for everything and it’s sort of a neat and novel idea but it really doesn’t provide anything so since LLMs are always going to be LLMs and be awful at “choosing” things why not just have it be something the actual people playing decide? I mean how much money would it save? Probably not a ton but over the entire life of the product it’d make a difference and it’d work better.

Though it’s not a constant thing it IS very annoying when my character is like “Actually I have a spell that can handle that!” and the LLM decides to derail the campaign, make 4 context blocks, and refuses to respond in character to the comment for multiple generation attempts when just an option on my end to decide if I’m in character or trying to correct the DM instead of a character would work better, cost less, and prevent the service from coming off as broken or annoying.

Not trying to be a jerk here so I hope it doesn’t come off that way, I am just not sure I understand the upside of the current system given the way LLMs work, they should not be trying to “decide” what we want when that’s just not what LLMs are good at if the alternative has so many upsides.