a bgO@sDddlZddlZddlZddlZddlmZddlmZddlm Z m Z m Z m Z m Z ddlZddlmZddlmZddlmZddlmZdd lmZdd lmZdd lmZmZdd lmZdd lm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&e'e(Z)dZ*dZ+dZ,Gddde-eZ.e e#e&fdddZ/e-dddZ0GdddeZ1dS)N)Enum) HTTPStatus)AnyDictListOptionalTuple) ClientTimeout)Document)get_runtime_environment)get_from_dict_or_env)VectorStoreRetriever) BaseModel)Responserequest)RequestException)App AuthContextContext FrameworkPromptQaRuntimez0.1.1zhttp://localhost:8000zhttps://api.daxa.aic@seZdZdZdZdZdZdS)Routesz2Routes available for the Pebblo API as enumerator.z/v1/app/discoverz /v1/promptz/v1/prompt/governanceN)__name__ __module__ __qualname____doc__retrieval_app_discoverpromptprompt_governancer!r!/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/chains/pebblo_retrieval/utilities.pyr%sr)returnc Cst}td|ddd}t}t|jtjd|dd|j |j t |dd|d dd }d |jvrvd |_ d |_ td|td|||fS)zFetch the current Framework and Runtime details. Returns: Tuple[Framework, Runtime]: Framework and Runtime for the current app instance. Z langchainZlibrary_versionN)nameversionZPWDplatformunknownruntimeZruntime_version)hostpathr&os os_versioniplanguageZlanguage_versionDarwinZdesktopzMac OSXz framework zruntime )r rgetr&unamernoder+environsystemr%get_iptyper(loggerdebug)Z runtime_envZ frameworkr1r(r!r!r" get_runtime-s*     r9cCs@ddl}|}z||}Wnty:|d}Yn0|S)zJFetch local runtime ip address. Returns: str: IP address rN localhost)socket gethostname gethostbyname Exception)r;r)Z public_ipr!r!r"r5Ls r5c seZdZUdZeeed<dZeed<eeed<eeed<edfdd Z e d d d d Z d'ee eeee eeeeefeed d ddZd(ee eeee eeeeefeed d ddZeeeeeeffdddZeeeeeeffdddZd)eedddZed*eeeeeeeedddZeeeed d d!d"Zed+eeeeeeedd#d$Zd,ee eeee eeeeefeeed d%d&ZZ S)-PebbloRetrievalAPIWrapperz!Wrapper for Pebblo Retrieval API.api_keylocalclassifier_locationclassifier_url cloud_url)kwargsc sLt|ddd|d<t|ddt|d<t|ddt|d<tjfi|dS) z%Validate that api key in environment.r@ZPEBBLO_API_KEYrCZPEBBLO_CLASSIFIER_URLrDZPEBBLO_CLOUD_URLN)r _DEFAULT_CLASSIFIER_URL_DEFAULT_PEBBLO_CLOUD_URLsuper__init__)selfrE __class__r!r"rJhsz"PebbloRetrievalAPIWrapper.__init__N)appr#c Csd}|jdd}|jdkrD|}|jtjj}|d|||}|jr|jdd}|rzt |j  d}| d|i| dti|jtjj}|d|||}dS) z Send app discovery request to Pebblo server & cloud. Args: app (App): App instance to be discovered. NTZ exclude_unsetrAPOST cloud_requestpebblo_server_versionZpebblo_client_version)dictrB _make_headersrCrrvalue make_requestr@jsonloadstextr0updatePLUGIN_VERSIONrD) rKrN pebblo_resppayloadheadersZapp_discover_urlrSZpebblo_cloud_url_r!r!r"send_app_discoverus"    z+PebbloRetrievalAPIWrapper.send_app_discoverF) app_name retrieverquestionanswer auth_contextdocsprompt_entities prompt_timeprompt_gov_enabledr#c  Csd} |||||||||| } |jdkrR|} |jtjj} |d| | | } |jr|jdkr~| rn| nd} | | | |jdd} |j tjj}|d|| | }n|jdkrt dtddSa Send prompt to Pebblo server for classification. Then send prompt to Daxa cloud(If api_key is present). Args: app_name (str): Name of the app. retriever (VectorStoreRetriever): Retriever instance. question (str): Question asked in the prompt. answer (str): Answer generated by the model. auth_context (Optional[AuthContext]): Authentication context. docs (List[Document]): List of documents retrieved. prompt_entities (Dict[str, Any]): Entities present in the prompt. prompt_time (str): Time when the prompt was generated. prompt_gov_enabled (bool): Whether prompt governance is enabled. NrArPTrQz pebblo-cloudz6API key is missing for sending prompt to Pebblo cloud.)build_prompt_qa_payloadrBrUrCrrrVrWr@rXupdate_cloud_payloadrDr7warning NameErrorrKrbrcrdrerfrgrhrirjr]r^r_Z prompt_urlZpebblo_cloud_prompt_urlr`r!r!r" send_prompts4      z%PebbloRetrievalAPIWrapper.send_promptc  sd} |||||||||| } |jdkrX|} |jtjj} |d| | | IdH} |jr|jdkrt| | | |jdd} |j tjj}|d|| | IdH}n|jdkrt dt ddSrk)rlrBrUrCrrrV amake_requestr@rmrDr7rnrorpr!r!r" asend_prompts6       z&PebbloRetrievalAPIWrapper.asend_prompt)rdr#cCs~d|i}idd}d}|jdkrv|}|jtjj}|d|||}|rv|di|d<|dd|d<||fS)  Check the validity of the given prompt using a remote classification service. This method sends a prompt to a remote classifier service and return entities present in prompt or not. Args: question (str): The prompt question to be validated. Returns: bool: True if the prompt is valid (does not contain deny list entities), False otherwise. dict: The entities present in the prompt rrentities entityCountTrArPrvrw) rBrUrCrr rVrWrXr0rKrdZprompt_payloadrhZis_valid_promptr_Zprompt_gov_api_urlr]r!r!r"check_prompt_validitys   z/PebbloRetrievalAPIWrapper.check_prompt_validitycs|d|i}idd}d}|jdkrt|}|jtjj}|d|||IdH}|rt|di|d<|d d|d <||fS) rtrrruTrArPNrvrw)rBrUrCrr rVrrr0rxr!r!r"acheck_prompt_validity0s   z0PebbloRetrievalAPIWrapper.acheck_prompt_validity)rRr#cCs4ddd}|r0|jr&|d|jin td|S)z Generate headers for the request. args: cloud_request (bool): flag indicating whether the request is for Pebblo cloud. returns: dict: Headers for the request. zapplication/json)Acceptz Content-Typez x-api-keyz,API key is missing for Pebblo cloud request.)r@r[r7rn)rKrRr_r!r!r"rUQs  z'PebbloRetrievalAPIWrapper._make_headers)methodurlr_r^timeoutr#c Cszt|||||d}td||jjtt|jjr6|jjngt|j|jtj krht d|jn>|jtj krt d|j n|jtj krt d|j|WStyt d|Yn0ty}zt d|WYd}~n d}~00dS) a Make a request to the Pebblo server/cloud API. Args: method (str): HTTP method (GET, POST, PUT, DELETE, etc.). url (str): URL for the request. headers (dict): Headers for the request. payload (Optional[dict]): Payload for the request (for POST, PUT, etc.). timeout (int): Timeout for the request in seconds. Returns: Optional[Response]: Response object if the request is successful. )r}r~r_rXrz5Request: method %s, url %s, len %s response status %sPebblo Server: Error $Pebblo received an invalid payload: -Pebblo returned an unexpected response code: Unable to reach server %sz'An Exception caught in make_request: %sN)rr7r8r~strlenbody status_coderINTERNAL_SERVER_ERRORrn BAD_REQUESTrZOKrr>)r}r~r_r^rresponseer!r!r"rWhs6     "z&PebbloRetrievalAPIWrapper.make_request)r^r]r#cCs|r|di}||didi|dd|di}||didi|dd|dg}|D]}|ddqxni|d<i|d<g|d<dS)z Update the payload with response, prompt and context from Pebblo response. Args: payload (dict): Payload to be updated. pebblo_resp (Optional[dict]): Response from Pebblo server. rZretrieval_datadataNrcontextdoc)r0r[pop)r^r]rrrZ context_datar!r!r"rms      z.PebbloRetrievalAPIWrapper.update_cloud_payloadc sXzt|d}t4IdH}|j|||||d4IdH}|jtjkr^td|jn>|jtj kr~td|j n|jtj krtd|j| IdH}WdIdHq1IdHs0YWdIdHq1IdHs0Y|WSt y"td|Yn2tyR} ztd| WYd} ~ n d} ~ 00dS) a Make a async request to the Pebblo server/cloud API. Args: method (str): HTTP method (GET, POST, PUT, DELETE, etc.). url (str): URL for the request. headers (dict): Headers for the request. payload (Optional[dict]): Payload for the request (for POST, PUT, etc.). timeout (int): Timeout for the request in seconds. Returns: Any: Response json if the request is successful. )totalN)r}r~rXr_rrrrrz(An Exception caught in amake_request: %s)r aiohttpZ ClientSessionrstatusrrr7rnrrZrrXrr>) r}r~r_r^rZclient_timeoutZasessionrZ response_jsonrr!r!r"rrs<     b"z'PebbloRetrievalAPIWrapper.amake_requestc stt|fdd|Dt||di|dd| dt|d||rF|jnd|r\t|d r\|jng|jd } | jd d S) a Build the QA payload for the prompt. Args: app_name (str): Name of the app. retriever (VectorStoreRetriever): Retriever instance. question (str): Question asked in the prompt. answer (str): Answer generated by the model. auth_context (Optional[AuthContext]): Authentication context. docs (List[Document]): List of documents retrieved. prompt_entities (Dict[str, Any]): Entities present in the prompt. prompt_time (str): Time when the prompt was generated. prompt_gov_enabled (bool): Whether prompt governance is enabled. Returns: dict: The QA payload for the prompt. c sHg|]@}t|trt|jd|jd|jjjj|jddqS) full_pathsource pb_checksum)Zretrieved_fromrZ vector_dbr) isinstancer rmetadatar0Z page_contentZ vectorstorerMr).0rrcr!r" s    zEPebbloRetrievalAPIWrapper.build_prompt_qa_payload..rvrwr)rrvrwrj)rr' user_auth)r$rrrriuserZuser_identitiesrBTrO)rrr0Zuser_idhasattrrrBrT) rKrbrcrdrerfrgrhrirjZqar!rr"rls,     z1PebbloRetrievalAPIWrapper.build_prompt_qa_payload)F)F)F)Nr|)Nr|)F)!rrrrrr__annotations__rBrrJrrar rrr rboolrqrsrryrzrTrU staticmethodintrrWrmrrrl __classcell__r!r!rLr"r?\s      )  G  > " !1; r?)2rXloggingr+r&enumrhttprtypingrrrrrrr Zlangchain_core.documentsr Zlangchain_core.envr Zlangchain_core.utilsr Zlangchain_core.vectorstoresr ZpydanticrrequestsrrZrequests.exceptionsrZ2langchain_community.chains.pebblo_retrieval.modelsrrrrrrr getLoggerrr7r\rGrHrrr9r5r?r!r!r!r"s0         $