Usage meter & Cost Estimates

[vadimkatsman]

If to inspect the JSON file with exported conversations, you could see the token cost for both inbound (prompts) and outbound (generated text) messages. But that information is not available on the human interface.

Concise description
To have an aggregated usage meter as well as chat / message cost counter.
Since pricing for inbound and outbound tokens differ, to have 2 separate counts in the format like 300/240 (and maybe using different colors - green vs red etc.)

[enricoros]

Need more details to understand if this applies only to the last message, or former messages:
Since once generated (output) message then becomes an input message for all the rest of the conversation, what's a json structure that would be able to capture this?

[vadimkatsman]

Your internal JSON includes the cost of each message. My suggestion is simply to display it on UX - I am not suggesting to compute it any different. With added aggregation across the chat and across all chats.

[arbiterFF]

I love this feature. It would be great to have this somewhere. Though not a top priority IMO (at least relative to moving architecture to cloud and being able to save and personas and chats x-device, or the ability to integrate with G-suite to RAG personal data)