a bg)@sddlZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZmZmZddlmZeeZed d d d Gd dde ZdS)N)AnyDictListOptionalUnion) deprecated)CallbackManagerForLLMRun)LLM)get_from_dict_or_env) BaseModel ConfigDictmodel_validator)enforce_stop_tokensz0.3.28z1.0z)langchain_predictionguard.PredictionGuard)ZsinceZremovalZalternative_importc@sVeZdZUdZdZeed<dZee ed<dZ ee ed<dZ ee ed <d Zee ed <dZee ed <dZeee ed <dZeee ee effed<dZeee efed<dZee ed<eddZeddeedddZeee efdddZee dddZeee efdddZd#e eee ee ee d d!d"Z!dS)$PredictionGuardaPrediction Guard large language models. To use, you should have the ``predictionguard`` python package installed, and the environment variable ``PREDICTIONGUARD_API_KEY`` set with your API key, or pass it as a named parameter to the constructor. Example: .. code-block:: python llm = PredictionGuard( model="Hermes-3-Llama-3.1-8B", predictionguard_api_key="your Prediction Guard API key", ) NclientzHermes-3-Llama-3.1-8Bmodel max_tokensg? temperatureg?top_ptop_kstoppredictionguard_inputpredictionguard_outputpredictionguard_api_keyZforbid)extrabefore)mode)valuesreturncCsJt|dd}zddlm}||d|d<WntyDtdYn0|S)zCValidate that the api_key and python package exists in environment.rZPREDICTIONGUARD_API_KEYr)r)Zapi_keyrzfCould not import predictionguard python package. Please install it with `pip install predictionguard`.)r predictionguardr ImportError)clsrZ pg_api_keyrr#v/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/predictionguard.pyvalidate_environmentBs   z$PredictionGuard.validate_environment)rcCs d|jiS)zGet the identifying parameters.r)rselfr#r#r$_identifying_paramsXsz#PredictionGuard._identifying_paramscCsdS)zReturn type of llm.r r#r&r#r#r$ _llm_type]szPredictionGuard._llm_type)kwargsrc Ksf|d|j}|d|j}i|j|j|j|jt|tr@| n|t|trT| n|d|}|S)Nrr)rrrrinputoutput) poprrrrrr isinstancer Z model_dump)r'r*r+r,paramsr#r#r$_get_parametersbs zPredictionGuard._get_parameters)promptr run_managerr*rc Ks|jfi|}d}|jdur0|dur0tdn|jdurB|j}n|}|jjjf|j|d|}|dD]2}|dddrj|d d} td| qj|dd d } |rt | |} | S) a$Call out to Prediction Guard's model API. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. Example: .. code-block:: python response = llm.invoke("Tell me a joke.") Nz2`stop` found in both the input and default params.)rr1choicesstatuszerror: z Error from PredictionGuard API: rtext) r0r ValueErrorrZ completionscreaterget startswith removeprefixr) r'r1rr2r*r/stopsresponsereserr_msgr6r#r#r$_callys*     zPredictionGuard._call)NN)"__name__ __module__ __qualname____doc__rr__annotations__rrstrrintrfloatrrrrrrrboolrrr Z model_configr r%propertyr(r)r0rr@r#r#r#r$rs8     r)loggingtypingrrrrrZlangchain_core._api.deprecationrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zlangchain_core.utilsr Zpydanticr r r Zlangchain_community.llms.utilsr getLoggerrAloggerrr#r#r#r$s