Add GPT-4.1 support

[tarekgh]

https://openai.com/index/gpt-4-1/

[tahitimoon]

Also GPT-4.1-mini

[MwSpaceLLC]

We wait this, at our SaaS for dev updates.

[phuturesh]

According to the how-to-run example in MRCR benchmark, they use o200k_base to count tokens for gpt-4.1. May be a temporary solution.

[kaimatzu]

I may be wrong, but I think the tokenization is the same as 4o.

[tarekgh]

@kaimatzu 4, 4o, o1, and o3 all are using the encoding o200k_base. So according to @phuturesh reply, looks 4.1 using the same encoding.

tiktoken/tiktoken/model.py

Lines 26 to 30 in 4560a88

	"o1": "o200k_base",
	"o3": "o200k_base",
	# chat
	"gpt-4o": "o200k_base",
	"gpt-4": "cl100k_base",

[deepdive101]

@tarekgh Your link does not list gpt-4.1.

[tarekgh]

Your link does not list gpt-4.1.

That is right. This is why we have this tracking issue open till the 4.1 mapping gets added.