a ag6 @sdZddlmZddlZddlmZmZmZmZm Z m Z m Z m Z ddl mZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%ddl&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2ddl3m4Z4Gdddee#Z5ddddddddddddZ6ddddd Z7d!d"d#d$d%Z8de9ee9e"d&dd'ddd(d)d*d+d,d-d.d/ d0d1Z:ed2d3d4d5de9ee9e"d&dfd6ddd7d)d*d+d,d-d8d9 d:d;Z;de9ee9e"d&dd&d<d6ddd(d)d*d+d,d+d-d=d> d?d3Z>z5StructuredQueryOutputParser.parse..z Parsing text z raised following error: ) rlenr'getpopritems Exceptionr )selfr)Z expected_keysparseder/r3r4parse0s$    z!StructuredQueryOutputParser.parseNFOptional[Sequence[Comparator]]Optional[Sequence[Operator]]Optional[Sequence[str]]bool)allowed_comparatorsallowed_operatorsallowed_attributes fix_invalidr*cs8|rdddfdd }ntdj}||dS)z Create a structured query output parser from components. Args: allowed_comparators: allowed comparators allowed_operators: allowed operators Returns: a structured query output parser r(Optional[FilterDirective]) raw_filterr*cs*tttt|}t|d}|SNrDrErF)r rrrr?fix_filter_directive)rIr,fixedrFrDrEr/r4r'Zsz>StructuredQueryOutputParser.from_components..ast_parserK)r')rr?)clsrDrErFrGr'r/rNr4from_componentsEs z+StructuredQueryOutputParser.from_components)NNNF)__name__ __module__ __qualname____doc____annotations__r? classmethodrPr/r/r/r4r&*s r&rKrHr@rArB)r,rDrErFr*css s r|s|St|trFr0|jvr0dSrB|jvrBdS|St|trrb|jvrbdSfdd|jD}|sdSt|dkr|jtj tj fvr|dSt|j|dSn|SdS)ahFix invalid filter directive. Args: filter: Filter directive to fix. allowed_comparators: allowed comparators. Defaults to all comparators. allowed_operators: allowed operators. Defaults to all operators. allowed_attributes: allowed attributes. Defaults to all attributes. Returns: Fixed filter directive. Nc s*g|]"}|durttt|dqSrJ)r rrL)r0argrNr/r4 s z(fix_filter_directive..r)operator arguments) isinstancerZ comparator attributerrZr[r7rANDOR)r,rDrErFargsr/rNr4rLms<    rLz$Sequence[Union[AttributeInfo, dict]]r()infor*cCsBi}|D]}t|}|||d<qtj|ddddddS)Nnameindent{{{}}})dictr9jsondumpsreplace)raZ info_dictsiZi_dictr/r/r4_format_attribute_infos rozSequence[Tuple[str, dict]]z List[dict])input_output_pairsr*cCsVg}t|D]D\}\}}tj|dddddd}|d||d}||q |S) zConstruct examples from input-output pairs. Args: input_output_pairs: Sequence of input-output pairs. Returns: List of examples. rcrdrfrgrhrirY)rnZ user_querystructured_request) enumeraterkrlrmappend)rpexamplesrn_inputoutputrqZexampler/r/r4construct_exampless  rwFrtrDrE enable_limit schema_promptzOptional[Sequence]zSequence[Comparator]zSequence[Operator]rCzOptional[BasePromptTemplate]rr) document_contentsattribute_infortrDrEryrzkwargsr*cKs|rtnt}|p|}t|} |jd|d|d} |rzt|dtrzt|}t} t j| || d} t jt |dd} n8|p|rt nt }t} tj| d} tjt |d|| d} tft|| d g| | d |S) a#Create query construction prompt. Args: document_contents: The contents of the document to be queried. attribute_info: A list of AttributeInfo objects describing the attributes of the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. allowed_operators: Sequence of allowed operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A prompt template that can be used to construct queries. z | )rDrEr)schemacontent attributesrY)rn)r~)rnrrr+)rtexample_promptZinput_variablessuffixprefix)r"rroformatjoinr\tuplerwr$r!r#r7r rrrrrlist)r{r|rtrDrEryrzr}Zdefault_schema_promptZ attribute_strr~rrrr/r/r4get_query_constructor_prompts@   rz0.2.13load_query_constructor_runnablez1.0)Zsince alternativeZremovalr zOptional[List]r) llmr{r|rtrDrEryrzr}r*c Ksnt|||||||d} g} |D]"} | t| tr6| jn| dqtj||| d} | | _tf|| | d|S)aSLoad a query constructor chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: The contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. **kwargs: Arbitrary named params to pass to LLMChain. Returns: A LLMChain that can be used to construct queries. rxrbrK)rprompt output_parser) rrsr\r%rbr&rPrr) rr{r|rtrDrEryrzr}rrFainforr/r/r4load_query_constructor_chains*" r)rtrDrEryrzrGr) rr{r|rtrDrEryrzrGr}r*cKsht||f|||||d| } g} |D]"} | t| tr>| jn| dq&tj||| |d} | |B| BS)aLoad a query constructor runnable chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: Description of the page contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. fix_invalid: Whether to fix invalid filter directives by ignoring invalid operators, comparators and attributes. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A Runnable that can be used to construct queries. rxrb)rDrErFrG)rrsr\r%rbr&rP)rr{r|rtrDrEryrzrGr}rrFrrr/r/r4r?s0" )=rT __future__rrktypingrrrrrrr r Zlangchain_core._apir Zlangchain_core.exceptionsr Zlangchain_core.language_modelsr Zlangchain_core.output_parsersrZ"langchain_core.output_parsers.jsonrZlangchain_core.promptsrZlangchain_core.prompts.few_shotrZlangchain_core.runnablesrZlangchain_core.structured_queryrrrrrrZlangchain.chains.llmrZ)langchain.chains.query_constructor.parserrZ)langchain.chains.query_constructor.promptrrrrrr r!r"r#r$Z)langchain.chains.query_constructor.schemar%r&rLrorwrrrrr/r/r/r4s^ (          0 F:"? $: