REST ChatBot Architecture and Bugs

API
1

Hello everyone,
I am currently building a chat bot which should fulfill the following functions:

  1. query data at REST endpoints (function calling)
  2. give recommendations for action on the data (Vector search)

Currently I have only implemented the function calling part, which works moderately.

  1. first my questions about function calling:
    1.1 For function call which have e.g. a date with from and to and I ask for the last two weeks, then the current day is used but in the year 2023. If I ask for one week, the period is used correctly. In the system message, I have a line that specifies the time zone and the current time in ISO format.

1.2 If I ask for data points that should fulfill a certain property, then the correct function call is executed, which returns all data. However, not all results are taken into account when generating the answer.

2 My question about Vector Search:
2.1 How do I have to design my application to be able to combine both function calling and vector search and how do I tell the application when to call which function with the correct values?

I hope you understand what I mean, otherwise please ask.

I am currently using gpt4o but I had the same problems with gpt4turbo.

1 Like