a bg@slddlmZmZmZmZmZddlmZddlm Z ddl m Z m Z m Z ddlmZmZGddde ZdS) )AnyDictListMappingOptional)CallbackManagerForLLMRun)LLM)convert_to_secret_strget_from_dict_or_envpre_init) ConfigDict SecretStrc@sbeZdZUdZdZeed<dZeed<dZ e ed<dZ eed <d Z e ed <d Zeed <dZe ed<dZe ed<dZe ed<gZeeed<dZe ed<dZeed<dZe ed<dZeed<dZeed<dZeeed<eddZee e dddZ!e"e#eefd d!d"Z$e"e#eefd d#d$Z%e"ed d%d&Z&d*eeeeee'eed'd(d)Z(dS)+NLPCloudaaNLPCloud large language models. To use, you should have the ``nlpcloud`` python package installed, and the environment variable ``NLPCLOUD_API_KEY`` set with your API key. Example: .. code-block:: python from langchain_community.llms import NLPCloud nlpcloud = NLPCloud(model="finetuned-gpt-neox-20b") Nclientzfinetuned-gpt-neox-20b model_nameTgpuenlanggffffff? temperature max_lengthlength_no_input remove_inputremove_end_sequence bad_wordsg?top_p2top_krepetition_penalty num_beamsnum_return_sequencesnlpcloud_api_keyZforbid)extra)valuesreturncCsjtt|dd|d<z6ddl}|j|d|d|d|dd|d <Wntydtd Yn0|S) z?Validate that api key and python package exists in environment.r"ZNLPCLOUD_API_KEYrNrrr)rrrzXCould not import nlpcloud python package. Please install it with `pip install nlpcloud`.)r r nlpcloudZClientZget_secret_value ImportError)clsr$r&r)o/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/nlpcloud.pyvalidate_environment:s     zNLPCloud.validate_environment)r%c Cs2|j|j|j|j|j|j|j|j|j|j |j d S)z4Get the default parameters for calling NLPCloud API. rrrrrrrrrr r!r,selfr)r)r*_default_paramsPszNLPCloud._default_paramscCs(id|jid|jid|ji|jS)zGet the identifying parameters.rrr)rrrr/r-r)r)r*_identifying_paramsaszNLPCloud._identifying_paramscCsdS)zReturn type of llm.r&r)r-r)r)r* _llm_typekszNLPCloud._llm_type)promptstop run_managerkwargsr%cKsf|rt|dkrtdn|r4t|dkr4|d}nd}i|j|}|jj|fd|i|}|dS)alCall out to NLPCloud's create endpoint. Args: prompt: The prompt to pass into the model. stop: Not supported by this interface (pass in init method) Returns: The string generated by the model. Example: .. code-block:: python response = nlpcloud("Tell me a joke.") rzXNLPCloud only supports a single stop sequence per generation.Pass in a list of length 1.rN end_sequenceZgenerated_text)len ValueErrorr/rZ generation)r.r2r3r4r5r6paramsresponser)r)r*_callps zNLPCloud._call)NN))__name__ __module__ __qualname____doc__rr__annotations__rstrrboolrrfloatrintrrrrrrrrr r!r"rr r Z model_configr rr+propertyrr/r0r1rr;r)r)r)r*r sJ                 rN)typingrrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZlangchain_core.utilsr r r Zpydanticr r rr)r)r)r*s