pull down to refresh

30 sats \ 3 replies \ @optimism 4h \ on: ChatGPT tried to gaslight me about OpenAI reasoning token billing AI
You did 1.5 million requests in a day?!?!! Whoa!!
write
preview
100 sats \ 2 replies \ @SimpleStacker OP 4h
Yes I'm pretty much a power user at this point. It's for a research project
reply
30 sats \ 1 reply \ @optimism 4h
Just know that if you're using mini, you can probably run something better on a g4dn or g5 on AWS spot, for lots cheaper than the $300 in one day implied above. My current g4dn costs me approx $1.20 an hour or so and if it gets out of hand I just use a smaller one.
reply
100 sats \ 0 replies \ @SimpleStacker OP 4h
Hmm, good point. If I had to redo this I might've started on AWS, but I think I'm too committed to my current setup/workflow now. Good thing is I should only have to do this many requests once or twice to establish my dataset, and more times only if I screwed up or need to change the prompt or something. It's not a live service that I'm running or anything.
reply