a agj @s<ddlmZmZddlmZddlmZGdddeZdS))AnyUnion)parse_json_markdown)StringEvaluatorc seZdZdZeddfdd ZeedddZeedd d Z ee dd d Z ee e edeeee fd ddZeee dddZde e efe e efe e efee dddZZS)JsonSchemaEvaluatoraAn evaluator that validates a JSON prediction against a JSON schema reference. This evaluator checks if a given JSON prediction conforms to the provided JSON schema. If the prediction is valid, the score is True (no errors). Otherwise, the score is False (error occurred). Attributes: requires_input (bool): Whether the evaluator requires input. requires_reference (bool): Whether the evaluator requires reference. evaluation_name (str): The name of the evaluation. Examples: evaluator = JsonSchemaEvaluator() result = evaluator.evaluate_strings( prediction='{"name": "John", "age": 30}', reference={ "type": "object", "properties": { "name": {"type": "string"}, "age": {"type": "integer"} } } ) assert result["score"] is not None N)kwargsreturnc s6tz ddl}Wnty0tdYn0dS)zInitializes the JsonSchemaEvaluator. Args: kwargs: Additional keyword arguments. Raises: ImportError: If the jsonschema package is not installed. rNziThe JsonSchemaEvaluator requires the jsonschema package. Please install it with `pip install jsonschema`.)super__init__ jsonschema ImportError)selfrr  __class__v/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain/evaluation/parsing/json_schema.pyr #s   zJsonSchemaEvaluator.__init__)rcCsdS)z-Returns whether the evaluator requires input.Frr rrrrequires_input5sz"JsonSchemaEvaluator.requires_inputcCsdS)z1Returns whether the evaluator requires reference.Trrrrrrequires_reference:sz&JsonSchemaEvaluator.requires_referencecCsdS)z#Returns the name of the evaluation.Zjson_schema_validationrrrrrevaluation_name?sz#JsonSchemaEvaluator.evaluation_name)nodercCs:t|trt|St|dr6tt|dr6t|dS|S)Nschema) isinstancestrrhasattrcallablegetattr)r rrrr _parse_jsonDs   zJsonSchemaEvaluator._parse_json) predictionrrc Cs^ddlm}m}z|||dddiWS|yX}zdt|dWYd}~Sd}~00dS)Nr)ValidationErrorvalidate)instancerscoreTF)r"Z reasoning)r rr repr)r rrrr errr _validateLs zJsonSchemaEvaluator._validate)rinput referencerrcKs ||}||}|||S)N)rr%)r rr&r'rZparsed_predictionrrrr_evaluate_stringsWs  z%JsonSchemaEvaluator._evaluate_strings)NN)__name__ __module__ __qualname____doc__rr propertyboolrrrrrdictlistfloatintrr%r( __classcell__rrrrrs&"   rN)typingrrZlangchain_core.utils.jsonrZlangchain.evaluation.schemarrrrrrs