a bg @sHddlZddlmZmZmZmZmZddlmZm Z GdddeZ dS)N)AnyListOptionalSequenceUnion)BaseDocumentTransformerDocumentc@sdeZdZdZd eeeeefeeeeefeee ddddZ e e e e e dd d Z dS) MarkdownifyTransformeramConverts HTML documents to Markdown format with customizable options for handling links, images, other tags and heading styles using the markdownify library. Arguments: strip: A list of tags to strip. This option can't be used with the convert option. convert: A list of tags to convert. This option can't be used with the strip option. autolinks: A boolean indicating whether the "automatic link" style should be used when a a tag's contents match its href. Defaults to True. heading_style: Defines how headings should be converted. Accepted values are ATX, ATX_CLOSED, SETEXT, and UNDERLINED (which is an alias for SETEXT). Defaults to ATX. kwargs: Additional options to pass to markdownify. Example: .. code-block:: python from langchain_community.document_transformers import MarkdownifyTransformer markdownify = MarkdownifyTransformer() docs_transform = markdownify.transform_documents(docs) More configuration options can be found at the markdownify GitHub page: https://github.com/matthewwithanm/python-markdownify NTATX)stripconvert autolinks heading_stylekwargsreturncKsBt|tr|gn||_t|tr&|gn||_||_||_||_dS)N) isinstancestrr r r radditional_options)selfr r r rrr/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/document_transformers/markdownify.py__init__s zMarkdownifyTransformer.__init__) documentsrrc Kszddlm}Wnty*tdYn0g}|D]X}|f|j|j|j|j|jd|jdd}t dd|}| t ||j d q4|S) Nr) markdownifyz`markdownify package not found, please install it with `pip install markdownify`)htmlr r r r  z\n\s*\nz )metadata)r ImportErrorZ page_contentr r r rrreplaceresubappendrr)rrrrZconverted_documentsdocZmarkdown_contentZcleaned_markdownrrrtransform_documents*s2    z*MarkdownifyTransformer.transform_documents)NNTr )__name__ __module__ __qualname____doc__rrrrboolrrrrr$rrrrr s" r ) r typingrrrrrZlangchain_core.documentsrrr rrrrs