a bgr!@sdddlZddlmZmZmZmZmZmZddlm Z ddl m Z ddl m Z mZGddde ZdS)N)AnyDictListMappingOptionalUnion)CallbackManagerForLLMRun)LLM)Field SecretStrc@seZdZUdZeed<eed<dZeeed<dZ eeed<dZ ee ed<e e dZeeefed <e d d d Ze ed <eedddZdeeeeeeeedddZeeeefdddZedddZdS) PredibaseaUse your Predibase models with Langchain. To use, you should have the ``predibase`` python package installed, and have your Predibase API key. The `model` parameter is the Predibase "serverless" base_model ID (see https://docs.predibase.com/user-guide/inference/models for the catalog). An optional `adapter_id` parameter is the Predibase ID or HuggingFace ID of a fine-tuned LLM adapter, whose base model is the `model` parameter; the fine-tuned adapter must be compatible with its base model; otherwise, an error is raised. If the fine-tuned adapter is hosted at Predibase, then `adapter_version` in the adapter repository must be specified. An optional `predibase_sdk_version` parameter defaults to latest SDK version. modelpredibase_api_keyNpredibase_sdk_version adapter_idadapter_version)default_factory model_kwargsg?)Zmax_new_tokensZ temperaturedefault_options_for_generation)returncCsdS)N predibaseselfrrp/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/predibase.py _llm_type(szPredibase._llm_type)promptstop run_managerkwargsrc Ks i|j|jpi|pi}|r~zrddlm}ddlm}ddlm}m } ddl m } m } ddl m} ddlm} ||jdd d }||d }WnZty}ztd |WYd}~n6d}~0ty}ztd |WYd}~n d}~00|jd|jd}|jrjz|j|j|jdd}Wn(|yP|jd|jd}Yn0|j|dj||d}n|j||d}|jSddlm}dtjd<||jd}ddl }ddl!m"}ddl#m$}ddl%m&}|j'j(|jd}|jr|jrd|jd|j}|)ddz|jf||d|}Wn8|y`}ztd|d |WYd}~n d}~00nZz|jf||jd!d"|}Wn:|y}z td#|jd$|WYd}~n d}~00nVz|jfd%|i|}Wn<|j*y}z td&|jd'|WYd}~n d}~00|j+}|S)(Nr)PredibaseClient) get_session)ServerResponseErrorSession)HuggingFaceLLM LLMDeployment)GeneratedResponse)Modelz https://api.app.predibase.com/v1zserving.app.predibase.com)tokenZgatewayZserving_endpoint)sessionzZCould not import Predibase Python package. Please install it with `pip install predibase`.z-Your API key is not correct. Please try againzpb://deployments/)uri)nameversionZmodel_idzhf://)r )roptions)r zhttps://api.app.predibase.comZPREDIBASE_GATEWAY) api_token)Client)GenerationError)Response)Zdeployment_ref/r/)rrzAn adapter with the ID "zE" cannot be found in the Predibase repository of fine-tuned adapters.Zhub)rrZadapter_sourcezEither an adapter with the ID "z" cannot be found in a HuggingFace repository, or it is incompatible with the base model (please make sure that the adapter configuration is consistent). rzAn LLM with the deployment ID "z" cannot be found at Predibase (please refer to "https://docs.predibase.com/user-guide/inference/models" for the list of supported models). ),rr_is_deprecated_sdk_versionrr!Z predibase.pqlr"Zpredibase.pql.apir#r$Z predibase.resource.llm.interfacer%r&Zpredibase.resource.llm.responser'Zpredibase.resource.modelr(rZget_secret_value ImportError ValueErrorr r rZ get_modelrZ with_adaptergenerateresponser osenvironrequestsZ lorax.clientr0Z lorax.errorsr1Z lorax.typesr2Z deploymentsclientpopJSONDecodeErrorZgenerated_text) rrrrr r.r!r"r#r$r%r&r'r(r*ZpceZbase_llm_deploymentZ adapter_modelresultr rr;Z LoraxClientr1r2Z lorax_clientZ pb_adapter_idr8geZjdeZ response_textrrr_call,s                    zPredibase._callcCsid|jiS)zGet the identifying parameters.r)rrrrr_identifying_paramsszPredibase._identifying_paramsc CszVddl}ddlm}ddlm}|jdd}|jp6|}|j|d}||kpRd|v WSty}ztd|WYd}~n d}~00dS)Nr) __version__)Versionz2024.4.8)version_stringz+devzkCould not import Predibase Python package. Please install it with `pip install semantic_version predibase`.)semantic_versionZpredibase.versionrDZsemantic_version.baserErr5)rrGcurrent_versionrEZsdk_semver_deprecatedZactual_current_versionZsdk_semver_currentr?rrrr4s(   z$Predibase._is_deprecated_sdk_version)NN)__name__ __module__ __qualname____doc__str__annotations__r rrrrintr dictrrrrpropertyrrrrBrrCboolr4rrrrr s6    r )r9typingrrrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zpydanticr r r rrrrs