a bg@sddlmZmZmZmZddlmZddlmZddl m Z m Z ddl m Z Gddde eeeeefZGdd d e eZd S) )AnyDictListOptional) Embeddings)pre_init) BaseModel ConfigDict)ContentHandlerBasec@seZdZdZdS)EmbeddingsContentHandlerzContent handler for LLM class.N)__name__ __module__ __qualname____doc__rr/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/embeddings/sagemaker_endpoint.pyr sr c@seZdZUdZdZeed<dZeed<dZ eed<dZ e eed<e ed<dZ e eed <dZe eed <ed d d dZeeedddZeeeeedddZdeeeeeedddZeeedddZdS)SagemakerEndpointEmbeddingsaCustom Sagemaker Inference Endpoints. To use, you must supply the endpoint name from your deployed Sagemaker model & the region where it is deployed. To authenticate, the AWS client uses the following methods to automatically load credentials: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html If a specific credential profile should be used, you must pass the name of the profile from the ~/.aws/credentials file that is to be used. Make sure the credentials / roles used have the required policies to access the Sagemaker endpoint. See: https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies.html Nclient endpoint_name region_namecredentials_profile_namecontent_handler model_kwargsendpoint_kwargsTZforbidr)Zarbitrary_types_allowedextraZprotected_namespaces)valuesreturnc Cs|ddur|Szddl}z@|ddur<|j|dd}n|}|jd|dd|d<Wn4ty}ztd ||WYd}~n d}~00Wntytd Yn0|S) z.Dont do anything if client provided externallyrNrr)Z profile_namezsagemaker-runtimer)rzCould not load credentials to authenticate with AWS client. Please check that credentials in the specified profile name are valid. zRCould not import boto3 python package. Please install it with `pip install boto3`.)getboto3Sessionr Exception ValueError ImportError)clsrrsessionerrrvalidate_environmentus4   z0SagemakerEndpointEmbeddings.validate_environment)textsrc Csttdd|}|jpi}|jp$i}|j||}|jj}|jj}z"|jj f|j |||d|}Wn2t y}zt d|WYd}~n d}~00|j |dS)z3Call out to SageMaker Inference embedding endpoint.cSs |ddS)N  )replace)xrrrz=SagemakerEndpointEmbeddings._embedding_func..)Z EndpointNameBodyZ ContentTypeAcceptz$Error raised by inference endpoint: Nr/)listmaprrrZtransform_input content_typeacceptsrZinvoke_endpointrr!r"Ztransform_output) selfr(Z _model_kwargsZ_endpoint_kwargsbodyr3r4responser&rrr_embedding_funcs$   $z+SagemakerEndpointEmbeddings._embedding_func@)r( chunk_sizercCsVg}|t|krt|n|}tdt||D]$}|||||}||q,|S)aCompute doc embeddings using a SageMaker Inference Endpoint. Args: texts: The list of texts to embed. chunk_size: The chunk size defines how many input texts will be grouped together as request. If None, will use the chunk size specified by the class. Returns: List of embeddings, one for each text. r)lenranger8extend)r5r(r:results _chunk_sizeir7rrrembed_documentss  z+SagemakerEndpointEmbeddings.embed_documents)textrcCs||gdS)zCompute query embeddings using a SageMaker inference endpoint. Args: text: The text to embed. Returns: Embeddings for the text. r)r8)r5rBrrr embed_querys z'SagemakerEndpointEmbeddings.embed_query)r9)r r rrrr__annotations__rstrrrrr rrrr Z model_configrr'rfloatr8intrArCrrrrrs( /   $ rN)typingrrrrZlangchain_core.embeddingsrZlangchain_core.utilsrZpydanticrr Z+langchain_community.llms.sagemaker_endpointr rErFr rrrrrs    $