a bg@sddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZddlmZddlmZeeZdd iZd Ze ed d d ZGddde ZdS)N)AnyListOptionalUnion)CallbackManagerForLLMRun)LLM) AIMessage BaseMessageFunctionMessage HumanMessage SystemMessage)Field)enforce_stop_tokensz Content-Typezapplication/json)messagereturncCsrt|trd|jd}nVt|tr0d|jd}n>t|trHd|jd}n&t|tr`d|jd}ntd||S)Nuser)ZrolecontentZ assistantsystemfunctionzGot unknown type ) isinstancer rrr r ValueError)rZ message_dictro/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/chatglm3.py_convert_message_to_dicts    rc@seZdZUdZedddZeed<dZeed<dZ e e ed <d Z e ed <d Zeed <dZeed<eedZeeed<dZeed<dZeedfed<eZe ed<eedddZee dddZeedddZee dddZ d#ee eee e!eed d!d"Z"dS)$ChatGLM3zChatGLM3 LLM service.z chatglm3-6bmodel)defaultalias model_namez)http://127.0.0.1:8000/v1/chat/completions endpoint_urlN model_kwargsi N max_tokensg? temperaturegffffff?top_p)default_factoryprefix_messagesF streaming http_clienttimeout)rcCsdS)NZ chat_glm_3r)selfrrr _llm_type:szChatGLM3._llm_typecCs,|j|j|j|j|jd}i||jp(iS)z,Get the parameters used to invoke the model.)rr#r"r$stream)rr#r"r$r'r!)r*paramsrrr_invocation_params>szChatGLM3._invocation_paramscCsddl}|jp|j|jdS)Nr)r))httpxr(ZClientr))r*r/rrrclientJszChatGLM3.client)promptrcCs4|j}|jt|dg}|ddd|Di|S)N)rmessagescSsg|] }t|qSr)r).0mrrr Uz)ChatGLM3._get_payload..)r.r&r update)r*r1r-r2rrr _get_payloadPszChatGLM3._get_payload)r1stop run_managerkwargsrc KsRddl}||}td|z|jj|jt|d}Wn4|jyn}zt d|WYd}~n d}~00td||j dkrt d|zb| } t | t rd } | | vr| | } t| r| dd d } qt d | nt d | Wn>t jy8}z"t d|d|jWYd}~n d}~00|durNt| |} | S)axCall out to a ChatGLM3 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = chatglm_llm.invoke("Who are you?") rNzChatGLM3 payload: )headersjsonz$Error raised by inference endpoint: zChatGLM3 response: zFailed with response: choicesrrzNo content in response : zUnexpected response type: z?Error raised during decoding response from inference endpoint: z . Response: )r/r8loggerdebugr0postr HEADERSZ NetworkErrorr status_coder=rdictlenJSONDecodeErrortextr) r*r1r9r:r;r/payloadresponseeZparsed_responseZ content_keysr?rHrrr_callZs>  $    zChatGLM3._call)NN)#__name__ __module__ __qualname____doc__r rstr__annotations__r r!rrEr"intr#floatr$listr&rr r'boolr(rrDEFAULT_TIMEOUTr)propertyr+r.r0r8rrLrrrrr%s6          r)r=loggingtypingrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZlangchain_core.messagesrr r r r Zpydanticr Zlangchain_community.llms.utilsr getLoggerrMr@rCrWrErrrrrrs