a bg::@sdZddlZddlmZmZddlmZmZmZddl m Z ddl m Z ddl mZddlmZmZd d d d d d d d d d ddd d d d d d ddddddddddddddddddddd dddddd d d ddddddd d d dddddddddddddddddddddddddddddddddddddddddddddd d d d!ddddd"dd!dd#d#d#d$ddddddd!d%ddd&ZGd'd(d(eZd3ejd*eeeed+d,d-Zd4ejd*eeeeed.d/d0ZGd1d2d2e ZdS)5z(Callback Handler that prints to std out.N)Enumauto)AnyDictList)warn_deprecated)BaseCallbackHandler) AIMessage)ChatGeneration LLMResultgQ?gQ~?gQ?g/nR?g/nB?g/nr?g~jth?g~jtX?g~jt?ga2U0*#?ga2U0*?ga2U0*C?g{Gzd?g{GzT?g{Gzt?g{Gz?gQ?gQ?gMb@?gMbP?gMb`?gMbp?g-C6:?g{Gz?g-C6Z?ga2U0*3?g~jtx?ga2U0*S?ga2U0*c?)o1z o1-2024-12-17z o1-cachedzo1-2024-12-17-cachedz o1-completionzo1-2024-12-17-completionzo3-minizo3-mini-2025-01-31zo3-mini-cachedzo3-mini-2025-01-31-cachedzo3-mini-completionzo3-mini-2025-01-31-completionz o1-previewzo1-preview-cachedzo1-preview-2024-09-12zo1-preview-2024-09-12-cachedzo1-preview-completionz o1-preview-2024-09-12-completionzo1-minizo1-mini-cachedzo1-mini-2024-09-12zo1-mini-2024-09-12-cachedzo1-mini-completionzo1-mini-2024-09-12-completionz gpt-4o-minizgpt-4o-mini-cachedzgpt-4o-mini-2024-07-18zgpt-4o-mini-2024-07-18-cachedzgpt-4o-mini-completionz!gpt-4o-mini-2024-07-18-completiongpt-4oz gpt-4o-cachedgpt-4o-2024-05-13zgpt-4o-2024-08-06zgpt-4o-2024-08-06-cachedzgpt-4o-2024-11-20zgpt-4o-2024-11-20-cachedzgpt-4o-completionzgpt-4o-2024-05-13-completionzgpt-4o-2024-08-06-completionzgpt-4o-2024-11-20-completiongpt-4z gpt-4-0314z gpt-4-0613z gpt-4-32kzgpt-4-32k-0314zgpt-4-32k-0613zgpt-4-vision-previewzgpt-4-1106-previewzgpt-4-0125-previewzgpt-4-turbo-previewz gpt-4-turbozgpt-4-turbo-2024-04-09zgpt-4-completionzgpt-4-0314-completionzgpt-4-0613-completionzgpt-4-32k-completionzgpt-4-32k-0314-completionzgpt-4-32k-0613-completionzgpt-4-vision-preview-completionzgpt-4-1106-preview-completionzgpt-4-0125-preview-completionzgpt-4-turbo-preview-completionzgpt-4-turbo-completionz!gpt-4-turbo-2024-04-09-completionz gpt-3.5-turbozgpt-3.5-turbo-0125zgpt-3.5-turbo-0301zgpt-3.5-turbo-0613zgpt-3.5-turbo-1106zgpt-3.5-turbo-instructzgpt-3.5-turbo-16kzgpt-3.5-turbo-16k-0613zgpt-3.5-turbo-completionzgpt-3.5-turbo-0125-completionzgpt-3.5-turbo-0301-completionzgpt-3.5-turbo-0613-completionzgpt-3.5-turbo-1106-completionz!gpt-3.5-turbo-instruct-completionzgpt-3.5-turbo-16k-completionz!gpt-3.5-turbo-16k-0613-completionz gpt-35-turbozgpt-35-turbo-0125zgpt-35-turbo-0301zgpt-35-turbo-0613zgpt-35-turbo-instructzgpt-35-turbo-16kzgpt-35-turbo-16k-0613zgpt-35-turbo-completionzgpt-35-turbo-0125-completionzgpt-35-turbo-0301-completionzgpt-35-turbo-0613-completionz gpt-35-turbo-instruct-completionzgpt-35-turbo-16k-completionz gpt-35-turbo-16k-0613-completionz text-ada-001adaztext-babbage-001Zbabbageztext-curie-001Zcurieztext-davinci-003ztext-davinci-002zcode-davinci-002zbabbage-002-finetunedzdavinci-002-finetunedzgpt-3.5-turbo-0613-finetunedzgpt-3.5-turbo-1106-finetunedzgpt-3.5-turbo-0125-finetunedz gpt-4o-mini-2024-07-18-finetunedz'gpt-4o-mini-2024-07-18-finetuned-cachedz babbage-002-finetuned-completionz davinci-002-finetuned-completionz'gpt-3.5-turbo-0613-finetuned-completionz'gpt-3.5-turbo-1106-finetuned-completionz'gpt-3.5-turbo-0125-finetuned-completionz+gpt-4o-mini-2024-07-18-finetuned-completionzbabbage-002-azure-finetunedzdavinci-002-azure-finetunedz!gpt-35-turbo-0613-azure-finetunedz&babbage-002-azure-finetuned-completionz&davinci-002-azure-finetuned-completionz,gpt-35-turbo-0613-azure-finetuned-completionzada-finetuned-legacyzbabbage-finetuned-legacyzcurie-finetuned-legacyzdavinci-finetuned-legacyc@s"eZdZdZeZeZeZdS) TokenTypezToken type enum.N)__name__ __module__ __qualname____doc__rPROMPT PROMPT_CACHED COMPLETIONrrw/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/callbacks/openai_info.pyrsrF token_type) model_name is_completionrreturncCs|rtddddtj}|}d|vr:|ddd}d|vrT|d dd }d |vrn|d d d }|tjkr|ds|ds|ds|dsd|vrd|vr|dS|tjkr|ds|dr|ds|dS|SdS)a Standardize the model name to a format that can be used in the OpenAI API. Args: model_name: Model name to standardize. is_completion: Whether the model is used for completion or not. Defaults to False. Deprecated in favor of ``token_type``. token_type: Token type. Defaults to ``TokenType.PROMPT``. Returns: Standardized model name. 0.3.13zis_completion is deprecated. Use token_type instead. Example: from langchain_community.callbacks.openai_info import TokenType standardize_model_name('gpt-4o', token_type=TokenType.COMPLETION) 1.0ZsincemessageZremovalz.ft-rz-azure-finetunedz:ft-:z-finetuned-legacyzft:z -finetunedrzgpt-3.5zgpt-35zo1-Z finetunedlegacyz -completionr r rz-cachedN)rrrlowersplit startswithr)rrrrrrstandardize_model_namesL  r*)r num_tokensrrrcCsZ|rtddddtj}t||d}|tvrJtd|ddtt||d S) a Get the cost in USD for a given model and number of tokens. Args: model_name: Name of the model num_tokens: Number of tokens. is_completion: Whether the model is used for completion or not. Defaults to False. Deprecated in favor of ``token_type``. token_type: Token type. Defaults to ``TokenType.PROMPT``. Returns: Cost in USD. r zis_completion is deprecated. Use token_type instead. Example: from langchain_community.callbacks.openai_info import TokenType get_openai_token_cost_for_model('gpt-4o', 10, token_type=TokenType.COMPLETION) r!r"rzUnknown model: z=. Please provide a valid OpenAI model name.Known models are: z, i)rrrr*MODEL_COST_PER_1K_TOKENS ValueErrorjoinkeys)rr+rrrrrget_openai_token_cost_for_models    r0cseZdZUdZdZeed<dZeed<dZeed<dZ eed<dZ eed<dZ eed<d Z e ed <d d fd d Zed ddZeed ddZeeefeeed dddZeed dddZeed dddZdd ddZedddd ZZS)!OpenAICallbackHandlerz)Callback Handler that tracks OpenAI info.r total_tokens prompt_tokensprompt_tokens_cachedcompletion_tokensreasoning_tokenssuccessful_requestsg total_costN)rcstt|_dS)N)super__init__ threadingLock_lockself __class__rrr:s zOpenAICallbackHandler.__init__cCs<d|jd|jd|jd|jd|jd|jd|jS)Nz Tokens Used: z Prompt Tokens: z Prompt Tokens Cached: z Completion Tokens: z Reasoning Tokens: z Successful Requests: z Total Cost (USD): $)r2r3r4r5r6r7r8r>rrr__repr__!s zOpenAICallbackHandler.__repr__cCsdS)z;Whether to call verbose callbacks even if verbose is False.Trr>rrralways_verbose,sz$OpenAICallbackHandler.always_verbose) serializedpromptskwargsrcKsdS)zPrint out the prompts.Nr)r?rDrErFrrr on_llm_start1sz"OpenAICallbackHandler.on_llm_start)tokenrFrcKsdS)zPrint out the token.Nr)r?rHrFrrron_llm_new_token7sz&OpenAICallbackHandler.on_llm_new_token)responserFrcKsz|jdd}Wnty(d}Yn0t|tr|z*|j}t|trT|j}|j}nd}d}Wqtyxd}d}Yq0nd}d}d}d}|r*d|di} |d} |d} |pi d} rt | } n"|j durd} nt |j dd} d| d ivr |d d}d | d ivr|d d }n|j dur:dSd |j vr|j |j d 7_ Wdn1sr0YdS|j d } | dd} | dd} t |j dd} | tvr| |}t| |tjd}t| |tjd}||}t| | tjd}nd}d}|j ~|j||7_|j| dd7_|j| 7_|j|7_|j| 7_|j|7_|j d 7_ Wdn1s0YdS)zCollect token usage.rNr2Z output_tokensZ input_tokensrZ cache_readZinput_token_detailsZ reasoningZoutput_token_details token_usager%r5r3r)Z generations IndexError isinstancer r#r usage_metadataresponse_metadataAttributeErrorgetr*Z llm_outputr=r7r,r0rrrrr8r2r3r4r5r6)r?rJrFZ generationr#rOrPr4r6rLr5r3Zresponse_model_namerZuncached_prompt_tokensZuncached_prompt_costZcached_prompt_costZ prompt_costZcompletion_costrrr on_llm_end;s            .     z OpenAICallbackHandler.on_llm_endcCs|S)z&Return a copy of the callback handler.rr>rrr__copy__szOpenAICallbackHandler.__copy__)memorcCs|S)z+Return a deep copy of the callback handler.r)r?rUrrr __deepcopy__sz"OpenAICallbackHandler.__deepcopy__)rrrrr2int__annotations__r3r4r5r6r7r8floatr:strrBpropertyboolrCrrrrGrIr rSrTrV __classcell__rrr@rr1s&          Wr1)F)F)rr;enumrrtypingrrrZlangchain_core._apirZlangchain_core.callbacksrZlangchain_core.messagesr Zlangchain_core.outputsr r r,rrrZr\r*rWrYr0r1rrrrs<      : (