Found my answer here Assistants API pricing details per message - #66 by _j.
By reading that, my conclusion is:
Assistants API can actually more costly and it’s hard to control the history we sent to the model.
Assistant API is just a wrapper. The cost is on the model. Assistant API still sends the token to the mode which we need to pay.