Is gpt4 turbo preview now slower than gpt 4?

Hi!

After the release of the gpt4 turbo preview model, it performed 2-3 times faster than the gpt4 model, which is a gamechanger.

However, today I notice that it actually generates ~same amount of text ~2-3 times slower than the gpt4 model… 16s vs 8s, 8s vs 3s.

I have not checked this in the past days, but maybe anyone else noticed it too and has any thoughts on this, if it’s temporary, when we might get the previous performance back, or maybe there’ve been any news about the more stable model soon?

Thanks!

3 Likes

Report for 2 trials of gpt-4:

  • total response time.Min:012.489 Max:020.243 Avg:016.366
  • latency (s)…Min:000.869 Max:001.646 Avg:001.257
  • response tokens…Min:256.000 Max:256.000 Avg:256.000
  • total rate…Min:012.646 Max:020.499 Avg:016.572
  • stream rate…Min:013.712 Max:021.945 Avg:017.828

Report for 2 trials of gpt-4-1106-preview:

  • total response time.Min:018.822 Max:026.294 Avg:022.558
  • latency (s)…Min:001.001 Max:001.241 Avg:001.121
  • response tokens…Min:256.000 Max:256.000 Avg:256.000
  • total rate…Min:009.736 Max:013.601 Avg:011.669
  • stream rate…Min:010.082 Max:014.504 Avg:012.293

All signs point to yes.

I got one GPT-4 that was continuously faster than the other, both calls faster than fastest ‘preview’. ‘preview’ has an odd bursty staccato to its token output.

Article writing quality

[gpt-4]

Title: The Wonderful World of Kittens: A Comprehensive Guide

Introduction

Kittens, the young offspring of cats, are some of the most adorable creatures
on the planet. Their playful antics, curious eyes, and soft fur make them
irresistible to many. But there’s more to these tiny felines than just their cuteness.
This article will delve into the fascinating world of kittens, exploring their
development, behavior, health, and how to care for them.

Development of Kittens

Kittens are born after a gestation period of approximately 63-65 days. At
birth, they are completely helpless, with their eyes and ears sealed shut. They
rely entirely on their mother for warmth, food, and protection.

Around two weeks of age, kittens start to open their eyes, revealing blue irises
regardless of their eventual adult color. Their ears also begin to unfold, and
they start to explore their surroundings, albeit clumsily.

By the fourth week, kittens become more active and playful. Their teeth start
to come in, and they begin to wean off their mother’s milk and start eating
solid food.

By eight weeks, kittens are usually fully weaned. They are also more
coordinated and engage in social play with their siblings. This is a

[gpt-4-1106-preview]
Kittens: The
Adorable Introduction to Feline Friendship

The world of pets is vast and varied, but few creatures can tug at the heartstrings
quite like kittens. These tiny, playful, and often mischievous little felines
are the embodiment of cuteness and have a unique way of bringing joy and
laughter into our lives. In this article, we’ll explore the world of kittens,
from their development and care to their behavior and the benefits of having
them as companions.

The Early Life of Kittens

Kittens are born after a gestation period of around 64 to 67 days. They enter
the world blind, deaf, and completely dependent on their mother for survival.
For the first few weeks, they spend most of their time sleeping and nursing.
Their eyes begin to open at around 7 to 10 days old, but their vision is not
fully developed until they are about two months old.

As they grow, kittens develop at a rapid pace. By the third week, they start
to wobble around on unsteady legs, exploring their immediate surroundings. This
is also when they begin to develop their sense of hearing. By the fourth week,
they are more coordinated and start to play with their littermates, learning
vital social skills and boundaries

2 Likes

‘preview’ has an odd bursty staccato to its token output.

I have noticed this too, same with GPT-4 in the ChatGPT web interface.

I thought it was just caused by my internet connection.

2 Likes

I have experienced the same too. Response time of gpt-4 and ‘preview’ makes no difference.