a ^g+@sUddlmZddlmZddlmZddddddddddddd Zded <ddddddddddddd d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d*Zded<dddddZ dddddZ dS)) annotations)Encoding) get_encodingZ o200k_baseZ cl100k_base) zo1-zo3-z chatgpt-4o-zgpt-4o-zgpt-4-zgpt-3.5-turbo-z gpt-35-turbo-z ft:gpt-4ozft:gpt-4zft:gpt-3.5-turbozft:davinci-002zft:babbage-002zdict[str, str]MODEL_PREFIX_TO_ENCODINGZ p50k_baseZ r50k_baseZ p50k_editgpt2)*Zo1Zo3zgpt-4ozgpt-4z gpt-3.5-turbozgpt-3.5z gpt-35-turboz davinci-002z babbage-002ztext-embedding-ada-002ztext-embedding-3-smallztext-embedding-3-largeztext-davinci-003ztext-davinci-002ztext-davinci-001ztext-curie-001ztext-babbage-001z text-ada-001ZdavinciZcurieZbabbageadazcode-davinci-002zcode-davinci-001zcode-cushman-002zcode-cushman-001z davinci-codexz cushman-codexztext-davinci-edit-001zcode-davinci-edit-001ztext-similarity-davinci-001ztext-similarity-curie-001ztext-similarity-babbage-001ztext-similarity-ada-001ztext-search-davinci-doc-001ztext-search-curie-doc-001ztext-search-babbage-doc-001ztext-search-ada-doc-001zcode-search-babbage-code-001zcode-search-ada-code-001rzgpt-2MODEL_TO_ENCODINGstr) model_namereturncCsXd}|tvrt|}n$tD]\}}||r|Sq|durTtd|dd|S)zrReturns the name of the encoding used by a model. Raises a KeyError if the model name is not recognised. NzCould not automatically map z_ to a tokeniser. Please use `tiktoken.get_encoding` to explicitly get the tokeniser you expect.)r ritems startswithKeyError)r Z encoding_nameZ model_prefixZmodel_encoding_namer\/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/tiktoken/model.pyencoding_name_for_modelPs    rrcCs tt|S)zfReturns the encoding used by a model. Raises a KeyError if the model name is not recognised. )rr)r rrrencoding_for_modelisrN) __future__rcorerregistryrr__annotations__r rrrrrrsx  8