a bg1@s ddlmZddlZddlmZmZddlmZddlm Z m Z m Z m Z m Z mZddlmZddlmZddlmZdd lmZdd lmZmZmZdd lmZd ZGd ddeZGdddeZGdddeZ GdddeZ!GdddeeZ"Gdddee"Z#dS)) annotationsN)ABCabstractmethod)Enum)AnyDictIteratorListMappingOptional)CallbackManagerForLLMRun)LLM)GenerationChunk)pre_init) BaseModel ConfigDictField)enforce_stop_tokenszocid1.generativeaiendpointc@s6eZdZeeddddZedddddZd S) ProviderstrreturncCsdSNselfrrx/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/oci_generative_ai.pystop_sequence_keyszProvider.stop_sequence_keyrresponsercCsdSrrrrrrrcompletion_response_to_textsz$Provider.completion_response_to_textN)__name__ __module__ __qualname__propertyrrr!rrrrrs rc@s8eZdZUdZded<ddddZddd d d Zd S) CohereProviderZstop_sequencesrrNonercCsddlm}|j|_dSNrmodels)oci.generative_ai_inferencer*ZCohereLlmInferenceRequestllm_inference_requestrr*rrr__init__s zCohereProvider.__init__rrcCs|jjjdjSNr)datainference_responseZgenerated_textstextr rrrr!$sz*CohereProvider.completion_response_to_textNr"r#r$r__annotations__r.r!rrrrr&s  r&c@s8eZdZUdZded<ddddZddd d d Zd S) MetaProviderstoprrr'rcCsddlm}|j|_dSr()r+r*ZLlamaLlmInferenceRequestr,r-rrrr.+s zMetaProvider.__init__rrcCs|jjjdjSr/)r0r1choicesr2r rrrr!0sz(MetaProvider.completion_response_to_textNr3rrrrr5(s  r5c@s eZdZdZdZdZdZdZdS) OCIAuthTypez'OCI authentication types as enumerator.N)r"r#r$__doc__API_KEYZSECURITY_TOKENZINSTANCE_PRINCIPALZRESOURCE_PRINCIPALrrrrr84s r8c@seZdZUdZedddZded<dZded <d Zded <d Z ded <dZ ded<dZ ded<dZ ded<dZ ded<dZded<dZded<eddddZedddddZeddd d!Zddd"d#d$ZdS)% OCIGenAIBasezBase class for OCI GenAI modelsNT)defaultexcluderclientr>z Optional[str] auth_typeDEFAULT auth_profilez ~/.oci/configauth_file_locationmodel_idproviderzOptional[Dict] model_kwargsservice_endpointcompartment_idFbool is_streamforbidr)extraarbitrary_types_allowedZprotected_namespacesr)valuesrc s|ddur|Sz"ddlid|djjdd}|dtdjkrpjj|d |d d |d <|d dn|dtdjkrfdd}jj|d |d d |d <||d d|d <n^|dtdjkrjj |d <n:|dtdjkrjj |d <nt d|ddj jfi||d<Wn`tyd}ztd|WYd}~n:d}~0ty}zt d||WYd}~n d}~00|S)zBValidate that OCI config and python package exists in environment.rBNrrJ) )configsignerrJZretry_strategytimeoutrCr9rFrE)Z file_locationZ profile_namerTrUr:cs^j|dd}t|ddd}|}Wdn1sD0Yjj||S)Nkey_fileZsecurity_token_filezutf-8)encoding)rUZload_private_key_from_filegetopenreadauthsignersZSecurityTokenSigner) oci_configpkfZ st_stringocirrmake_security_token_signers  &zEOCIGenAIBase.validate_environment..make_security_token_signer)r^r;r<z)Please provide valid value to auth_type, z is not valid.zYCould not import oci python package. Please make sure you have the oci package installed.zCould not authenticate with OCI client. If INSTANCE_PRINCIPAL or RESOURCE_PRINCIPAL is used, please check the specified auth_profile, auth_file_location and auth_type are valid.)rbretryZDEFAULT_RETRY_STRATEGYr8namerT from_filepopr\r]Z%InstancePrincipalsSecurityTokenSignerZget_resource_principals_signer ValueErrorZgenerative_ai_inferenceZGenerativeAiInferenceClient ImportErrorModuleNotFoundError Exception)clsrQZ client_kwargsrcexerrarvalidate_environmentpsj        z!OCIGenAIBase.validate_environmentMapping[str, Any]rcCs|jpi}id|iS)zGet the identifying parameters.rI)rI)r _model_kwargsrrr_identifying_paramss z OCIGenAIBase._identifying_params) provider_maprcCsZ|jdur|j}n&|jdur$td|jdd}||vrRtd|jd||S)Nzmodel_id is required to derive the provider, please provide the provider explicitly or specify the model_id to derive the provider..rz(Invalid provider derived from model_id: zL Please explicitly pass in the supported provider when using custom endpoint)rHrGrhsplitlower)rrsrHrrr _get_providers   zOCIGenAIBase._get_provider)r"r#r$r=rrBr4rCrErFrGrHrIrJrKrMr model_configrror%rrrwrrrrr?=s&         Mr?c@seZdZdZedddZeddddZed dd d Zed dd dZ dddddddZ d dddddZ ddddd ddddZ d dddd ddddZ dS)!OCIGenAIaOCI large language models. To authenticate, the OCI client uses the methods described in https://docs.oracle.com/en-us/iaas/Content/API/Concepts/sdk_authentication_methods.htm The authentifcation method is passed through auth_type and should be one of: API_KEY (default), SECURITY_TOKEN, INSTANCE_PRINCIPAL, RESOURCE_PRINCIPAL Make sure you have the required policies (profile/roles) to access the OCI Generative AI service. If a specific config profile is used, you must pass the name of the profile (from ~/.oci/config) through auth_profile. If a specific config file location is used, you must pass the file location where profile name configs present through auth_file_location To use, you must provide the compartment id along with the endpoint url, and model id as named parameters to the constructor. Example: .. code-block:: python from langchain_community.llms import OCIGenAI llm = OCIGenAI( model_id="MY_MODEL_ID", service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com", compartment_id="MY_OCID" ) rNT)rOrPrrcCsdS)zReturn type of llm.Zoci_generative_ai_completionrrrrr _llm_typeszOCIGenAI._llm_typerpcCsttdS)zGet the provider map)Zcoheremeta)r&r5rrrr _provider_mapszOCIGenAI._provider_maprcCs|j|jdS)z Get the internal provider object)rs)rwr|rrrr _providerszOCIGenAI._providerzOptional[List[str]]zDict[str, Any])promptr6kwargsrc Csddlm}|jpi}|dur*|||jj<|jdurs$