Now that's its back I was curious what the /models endpoint returned, and I confirmed my suspicion that GPT-4 is still limited to 4K tokens (that's what the API says the token limit is). I wonder if it's a separate model, or they artificially limited the 8K model. I thought the limit was a bug at first.

As per the payload, it is for free plan only?

{ "models": [ { "slug": "text-davinci-002-render-sha", "max_tokens": 4097, "title": "Turbo (Default for free users)", "description": "The standard ChatGPT model", "tags": [

      ],
      "qualitative_properties": {
        
      }
    }
  ],
  "user_id": "user-vg3ArQIeJIehMctFjquoG6BO"
}

You get more models with ChatGPT Plus.