Okay, one weird finding.
Switching from model: 'gpt-4-1106-preview'
to model: 'gpt-3.5-turbo-1106'
actually helps.
With the switch to GPT-3.5 my function does get called. Super weird, I would have expected the opposite and didn’t even try 3 before. Assuming that it couldn’t work, if “not even 4” worked