a dg@s:ddlZddlmZmZmZddlmZGdddZdS)N)AnyDictOptional)ModerationPiiErrorc@szeZdZdZd eeeeeeeddddZdeeedddZdeeedd d Z eee eefedd d Z dS) ComprehendPIIzEClass to handle Personally Identifiable Information (PII) moderation.N)clientcallback unique_idchain_idreturncCs$||_|ddd|_||_||_dS)NZPIIZLABELS_NOT_FOUND)Zmoderation_chain_idZmoderation_typemoderation_status)rmoderation_beaconrr )selfrrr r r~/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_experimental/comprehend_moderation/pii.py__init__ szComprehendPII.__init__) prompt_valueconfigr cCs*|d}|r|j||dS|j||dS)Nredact)rr)get _detect_pii _contains_pii)rrrrrrrvalidates   zComprehendPII.validatecCs|jj|dd}|jr2|jjr2||jd<||jd<|d}|d}d}|dD]4}|d |krn|d |vs~|d |krR|sRd }qqR|jr|jjr|rd |jd <t|j|j|j |rt |S)aM Checks for Personally Identifiable Information (PII) labels above a specified threshold. Uses Amazon Comprehend Contains PII Entities API. See - https://docs.aws.amazon.com/comprehend/latest/APIReference/API_ContainsPiiEntities.html Args: prompt_value (str): The input text to be checked for PII labels. config (Dict[str, Any]): Configuration for PII check and actions. Returns: str: the original prompt Note: - The provided client should be initialized with valid AWS credentials. enTextZ LanguageCodemoderation_inputmoderation_output thresholdlabelsFZLabelsScoreNameT LABELS_FOUNDr ) rZcontains_pii_entitiesr pii_callbackr rasyncio create_task on_after_piir r)rrrpii_identifiedr pii_labels pii_foundentityrrrr$s4       zComprehendPII._contains_piic Cs|jj|dd}|jr2|jjr2||jd<||jd<|dgkrh|jrd|jjrdt|j|j|j|Sd}|s|dr|dD]}|ddkrd }qq|jr|jjr|rd |jd <t|j|j|j|rt n| d }| d }| d}d}|dD]}|r(|d|vr(|d|ks<|s|d|krd }|d} |d} | | d} || } |d| | || dd}q|jr|jjr|rd |jd <t|j|j|j|S)a Detects and handles Personally Identifiable Information (PII) entities in the given prompt text using Amazon Comprehend's detect_pii_entities API. The function provides options to redact or stop processing based on the identified PII entities and a provided configuration. Uses Amazon Comprehend Detect PII Entities API. Args: prompt_value (str): The input text to be checked for PII entities. config (Dict[str, Any]): A configuration specifying how to handle PII entities. Returns: str: The processed prompt text with redacted PII entities or raised exceptions. Raises: ValueError: If the prompt contains configured PII entities for stopping processing. Note: - If PII is not found in the prompt, the original prompt is returned. - The client should be initialized with valid AWS credentials. rrrrZEntitiesFr g?Tr"r rrZmask_characterTypeZ BeginOffsetZ EndOffsetN) rZdetect_pii_entitiesrr#r r$r%r&r rr) rrrr'r)r*rr(Z mask_markerZchar_offset_beginZchar_offset_endZ mask_lengthZ masked_partrrrrOsv                 zComprehendPII._detect_pii)NNN)N)N) __name__ __module__ __qualname____doc__rrstrrrrrrrrrrr s +r)r$typingrrrZGlangchain_experimental.comprehend_moderation.base_moderation_exceptionsrrrrrrs