a bg@s~dZddlZddlmZddlmZmZmZddlm Z ddl m Z e e ee eddd Zeed d d ZGd dde ZdS)zLoads .ipynb notebook files.N)Path)AnyListUnion)Document) BaseLoader)cellinclude_outputsmax_output_length tracebackreturnc Cs*|d}|d}|r4z |d}Wnty2Yn0|r|dkr|rd|dvr|dd}|dd}|r|dd}d |d |d |d |d |d Sd |d |d |d|d SnL|dddkr&|dd}t|t|} d |d |d|d| dSnd |d |dSdS)asCombine cells information in a readable format ready to be used. Args: cell: A dictionary include_outputs: Whether to include the outputs of the cell. max_output_length: Maximum length of the output to be displayed. traceback: Whether to return a traceback of the error. Returns: A string with the cell information. cell_typesourceoutputscodeZenamerZevaluer 'z ' cell: 'z' , gives error 'z', with description 'z' and traceback 'z' z',with description ' output_typestreamtextz' with output: 'N)KeyErrorkeysminlen) rr r r r routputZ error_nameZ error_valueZ min_outputr{/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/document_loaders/notebook.pyconcatenate_cells s@       r)xr cCsRt|tr|ddSt|tr.dd|DSt|trJdd|DS|SdS)zMRecursively remove newlines, no matter the data structure they are stored in. rcSsg|] }t|qSrremove_newlines).0elemrrr Fz#remove_newlines..cSsi|]\}}|t|qSrr r"kvrrr Hr%z#remove_newlines..N) isinstancestrreplacelistdictitemsrrrrr!@s    r!c@sBeZdZdZd eeefeeeedddZ e e ddd Z d S) NotebookLoaderz'Load `Jupyter notebook` (.ipynb) files.F )pathr r remove_newliner cCs"||_||_||_||_||_dS)aInitialize with a path. Args: path: The path to load the notebook from. include_outputs: Whether to include the outputs of the cell. Defaults to False. max_output_length: Maximum length of the output to be displayed. Defaults to 10. remove_newline: Whether to remove newlines from the notebook. Defaults to False. traceback: Whether to return a traceback of the error. Defaults to False. N) file_pathr r r4r )selfr3r r r4r rrr__init__Ps zNotebookLoader.__init__)r cstj}t|dd}t|}Wdn1s60Ydd|dD}jrfttt|}d ttfdd |}d t |i}t ||d gS) zLoad documents.utf8)encodingNcSsg|]}dd|DqS)cSsi|]\}}|dvr||qS))r rrrr&rrrr)ur%z2NotebookLoader.load...)r/)r"rrrrr$tsz'NotebookLoader.load..cellsrcst|jjjS)N)rr r r r0r6rrsz%NotebookLoader.load..r)Z page_contentmetadata) rr5openjsonloadr4r-mapr!joinr+r)r6pfdZ filtered_datarr=rr;rr@ks$ (  zNotebookLoader.loadN)Fr2FF) __name__ __module__ __qualname____doc__rr+rboolintr7rrr@rrrrr1Ms  r1)rIr?pathlibrtypingrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baserr.rJrKr+rr!r1rrrrs    4