[ichpen]

Maybe belongs in the framework addon but some sort of budget management or throttle management i.e. max number of ChatGPT transactions per day/month etc. per user.

Global maximum ceiling too. In case you get spammed or some job goes out of control. I know you can manage some things on openai but this allows for granular controls.