a bg>@sddlZddlZddlmZmZmZmZmZmZddl Z ddl m Z ddl m Z ddlmZddlmZeeZGddde ZdS) N)AnyDictListMappingOptionalSet)CallbackManagerForLLMRun)LLM)Field)enforce_stop_tokenscsneZdZUdZdZeed<edddZe ed<dZ e e ed <d Z e e ed <d Ze e ed <dZeed<dZe eed<gZe eeed<dZe e ed<dZe e ed<dZeed<gZeeed<dZeed<eddfdd ZeedddZeeedd d!Ze eefdd"d#Z!ee"eefdd$d%Z#d)ee eee e$eed&d'd(Z%Z&S)*Yuan2unYuan2.0 language models. Example: .. code-block:: python yuan_llm = Yuan2( infer_api="http://127.0.0.1:8000/yuan", max_tokens=1024, temp=1.0, top_p=0.9, top_k=40, ) print(yuan_llm) print(yuan_llm.invoke("你是谁？")) zhttp://127.0.0.1:8000/yuan infer_apiiZ max_token)alias max_tokensgffffff?tempg?top_prtop_kF do_sampleechostop@ repeat_last_ngzG?repeat_penalty streaminghistory use_historyN)kwargsreturnc sBtjfi||jpddkr>|jp(ddkr>tdd|_dS)zInitialize the Yuan2 class.rzGtop_p and top_k cannot be set simultaneously. set top_k to 0 instead...N)super__init__rrloggerwarning)selfr __class__l/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/yuan2.pyrIs zYuan2.__init__)rcCsdS)NzYuan2.0r%r"r%r%r& _llm_typeTszYuan2._llm_typecCshdS)N>rrrrrr%r%r%r%r&_model_param_namesXszYuan2._model_param_namesc Cs&|j|j|j|j|j|j|j|jdS)Nrr rrrrrrr*r'r%r%r&_default_paramsbszYuan2._default_paramscs*djifddjDS)zGet the identifying parameters.modelcs"i|]\}}|vr||qSr%)r)).0kvr'r%r& tsz-Yuan2._identifying_params..)r(r+__dict__itemsr'r%r'r&_identifying_paramsns zYuan2._identifying_params)promptr run_managerrrc Ks|jr |j|d|j}n|}ddi}td|dg|j|j|j|j |j d}t d|zt j|j||d}Wn6t jjy} ztd | WYd } ~ n d } ~ 00t d ||jd krtd |z|} | ddkrtd| dd| ddd| vrNt| dddkrD| dddd} ntdntdWn@t jjy} z"td| d|jWYd } ~ n d } ~ 00|d urt| |} |jr|j| t d|j| S)uxCall out to a Yuan2.0 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = yuan_llm.invoke("你能做什么?") zz Content-Typezapplication/jsonZ000)idZques)Z ques_listZtokens_to_generateZ temperaturerrrzYuan2.0 prompt:)headersdatazError raised by inference api: NzYuan2.0 response: zFailed with response: ZerrCode0zFailed with error code [z], error message: [Z exceptionMsg]ZresDataoutputrZanszNo output found in response.zNo resData found in response.z:Error raised during decoding response from inference api: z . Response: z history: )rrappendjoinjsondumpsrrrrrr debugrequestsputr exceptionsRequestException ValueError status_codelenJSONDecodeErrortextr ) r"r4rr5rinputr7r8responseerespZ generate_textr%r%r&_callys^   $        z Yuan2._call)NN)'__name__ __module__ __qualname____doc__r str__annotations__r rintrrfloatrrrboolrrrrrrrrrrpropertyr( staticmethodrr)rr+rr3rrO __classcell__r%r%r#r&r s>          r )r?loggingtypingrrrrrrrBZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zpydanticr Zlangchain_community.llms.utilsr getLoggerrPr r r%r%r%r&s