# How do we submit evals for function calls?

**URL:** <https://community.openai.com/t/how-do-we-submit-evals-for-function-calls/270038>\
**Category:** API\
**Created:** [June 18, 2023, 11:07pm UTC](https://community.openai.com/t/how-do-we-submit-evals-for-function-calls/270038 "2023-06-18T23:07:42Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![sam.saffron](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/sam.saffron/32/31387_2.png) [@sam.saffron](https://community.openai.com/u/sam.saffron)\
**Post date:** [June 18, 2023, 11:07pm UTC](https://community.openai.com/t/how-do-we-submit-evals-for-function-calls/270038/1 "2023-06-18T23:07:42Z")

</div>

I am noticing quite a few cases where evals for function calls can help

1. While testing I made a searchbot and asked it to search for “404 in user profiles.” no matter what I did I only got “profiles404 user” in my function args.

2. While testing I noticed that no matter what I do I can not get the model to run multiple functions, “search for car and then bar, what is common?”

Reading through eval source code I can see that the completions only look at the returned message:

> <https://github.com/openai/evals/blob/c2587c69a2f330282d3ba76eceaf580ee03fa67a/evals/completion_fns/openai.py#L28-L35>

I tried searching through the repo for `function_call` and can not find anything.

Can OpenAI add a sample eval for function calls, then we can all together help hone the functionality! 🤗

---

<div class="post-metadata">

**Author:** ![dani-mp](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/dani-mp/32/194303_2.png) [@dani-mp](https://community.openai.com/u/dani-mp)\
**Post date:** [September 7, 2023, 10:45am UTC](https://community.openai.com/t/how-do-we-submit-evals-for-function-calls/270038/2 "2023-09-07T10:45:18Z")

</div>

I faced this problem myself today. Is it even possible to include the functions in the first place?

---

<div class="post-metadata">

**Author:** ![vladin](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/vladin/32/414837_2.png) [@vladin](https://community.openai.com/u/vladin)\
**Post date:** [August 10, 2025, 10:39pm UTC](https://community.openai.com/t/how-do-we-submit-evals-for-function-calls/270038/3 "2025-08-10T22:39:22Z")

</div>

Hey, any progress on that? In fact would be nice extending the eval example to include “functions calling eval” as well as LLM eval. Basically end-to-end eval of the graph.  
It would also be nice to allow a quick adding of test case to eval set right from the dashboard, providing its ground truth.