a bg@sdddlmZddlmZddlmZmZmZmZddl Z ddl m Z ddl m Z Gddde ZdS) )BytesIO)Path)AnyListTupleUnionN)Document) BaseLoaderc @sveZdZdZd eeeeeeeeeffeedddZ ee dddZ e e eeeefe eefd d d Zd S)ImageCaptionLoaderzLoad image captions. By default, the loader utilizes the pre-trained Salesforce BLIP image captioning model. https://huggingface.co/Salesforce/blip-image-captioning-base %Salesforce/blip-image-captioning-base)imagesblip_processor blip_modelcCs0t|tttfr|g|_n||_||_||_dS)aaInitialize with a list of image data (bytes) or file paths Args: images: Either a single image or a list of images. Accepts image data (bytes) or file paths to images. blip_processor: The name of the pre-trained BLIP processor. blip_model: The name of the pre-trained BLIP model. N) isinstancestrrbytesr r r)selfr r rr/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/document_loaders/image_captions.py__init__s  zImageCaptionLoader.__init__)returnc Cszddlm}m}Wnty.tdYn0||j}||j}g}|jD].}|j|||d\}}t ||d} | | qR|S)z,Load from a list of image data or file pathsr)BlipForConditionalGeneration BlipProcessorzQ`transformers` package not found, please install with `pip install transformers`.)model processorimage)Z page_contentmetadata) Z transformersrr ImportErrorZfrom_pretrainedr rr _get_captions_and_metadatarappend) rrrrrresultsrcaptionrdocrrrload)s         zImageCaptionLoader.load)rrrrc Cs,zddlm}Wnty*tdYn0|}zpt|trR|t|d}nLt|tr| dsp| dr|t j |ddj d}n||d}Wn4t yt|trd }n d |}t|Yn0||d d d }|jfi|}||d} t|trddi} n dt|i} | | fS)zBHelper function for getting the captions and metadata of an image.r)ImagezA`PIL` package not found, please install with `pip install pillow`RGBzhttp://zhttps://T)streamz#Could not get image data from byteszCould not get image data for z an image ofpt)Zreturn_tensors image_sourcezImage bytes providedZ image_path)ZPILr$rrropenrconvertr startswithrequestsgetraw Exception ValueErrorgeneratedecode) rrrrr$r(msginputsoutputr!rrrrr@s:          z-ImageCaptionLoader._get_captions_and_metadataN)r r )__name__ __module__ __qualname____doc__rrrrrrrr#rrdictrrrrrr s   r )iorpathlibrtypingrrrrr,Zlangchain_core.documentsrZ)langchain_community.document_loaders.baser r rrrrs