Counting OpenAI Tokens per Request in FastAPI — Without Touching My Use Cases

I'm rebuilding evorag, a Python retrieval service: it chunks documents, embeds them with OpenAI's text-embedding-3-small, stores vectors in PostgreSQL + pgvector, and returns the most relevant chunks