Perhaps you could introduce a higher paid tier than “Legend” that would give more token space and memory. Tokens make a huge difference in LLMs and even at “Legend” especially with Franz being composed of multiple different AIs, there’s clearly just not enough tokens to maintain extended conversations or interactions without Franz forgetting things far too quickly.
I understand that operating an LLM is not free, you have to pay for compute and more tokens mean more compute, but perhaps if there are enough people interested in paying more for a better overall experience, it might be worth it to create a new tier with more tokens and larger context windows for the various subcomponents of Franz.
Please authenticate to join the conversation.
In Review
💡 Feature Request
4 months ago

Nanako
Get notified by email when there are changes.
In Review
💡 Feature Request
4 months ago

Nanako
Get notified by email when there are changes.