OpenAI Typical API Costs

ProofChat
1

what are the typical OpenAi API costs for proofChat queries?

2

Hello,

Welcome to the community. :slight_smile:

Prices vary based on the model you choose. ProofChat’s default is GPT 4.1 mini. It costs 80cents /million input tokens and $5/million output tokens. In the 4 months that I have been working on ProofChat, we have not spent more than 25 dollars.

A typical conversation where you might have 5 or ten messages, costs a few pennies, maybe 10 cents.

Your mileage will vary. You can set limits on your OpenAi account to ensure you don’t go crazy.

Hope that helps

Todd

3

Thanks Todd, it is useful to know what ballpark we are in and that this is worth considering even for very small customers.

4

Running your own Private AI servers is pretty costly. If you get them in the cloud its a few thousand a month. If you buy them they cost 5 to 10K. Open AI is just way cheaper. The trade off is privacy. But Open AI will even give you a BAA for HIPPA Compliance so… maybe it doesn’t matter???

Todd

5

I would say for a lot of businesses I work with here in the UK it does matter for a variety of reasons, including:

  • Commercial sensitive information
  • Personal information in general which we have an obligation to keep private
  • any data regarding children.
6

HIPPA covers most of that if not all of it. At least it would in the US.

A lot of companies are nervous about it. It is a valid concern.

And you can do it privately, it is just going to to cost you 10 to 20X more. ProofChat Pro can use any provider including FileMaker’s AI Server. You just need to spend 5 or 10K on a mac studio, or something similar.

Todd