a bgq@s^ddlZddlZddlmZmZmZmZddlmZddl m Z e e Z Gddde ZdS)N)DictListOptionalSequence)Document) BaseLoaderc @seZdZdZdddddeeeeeeeeeeeeddddZ e e dd d Z e e dd d Z eedd dZdeeeeedddZdS) MongodbLoaderzLoad MongoDB documents.NT)filter_criteria field_namesmetadata_names!include_db_collection_in_metadata)connection_stringdb_namecollection_namer r r r returnc Cszddlm}Wn.ty>} ztd| WYd} ~ n d} ~ 00|sLtd|sXtd|sdtd|||_||_||_|pg|_|pi|_|pg|_ ||_ |j ||_ |j ||_dS)a Initializes the MongoDB loader with necessary database connection details and configurations. Args: connection_string (str): MongoDB connection URI. db_name (str):Name of the database to connect to. collection_name (str): Name of the collection to fetch documents from. filter_criteria (Optional[Dict]): MongoDB filter criteria for querying documents. field_names (Optional[Sequence[str]]): List of field names to retrieve from documents. metadata_names (Optional[Sequence[str]]): Additional metadata fields to extract from documents. include_db_collection_in_metadata (bool): Flag to include database and collection names in metadata. Raises: ImportError: If the motor library is not installed. ValueError: If any necessary argument is missing. r)AsyncIOMotorClientzBCannot import from motor, please install with `pip install motor`.Nz#connection_string must be provided.zdb_name must be provided.z!collection_name must be provided.)Zmotor.motor_asyncior ImportError ValueErrorclientrrr r r r Z get_databasedbZget_collection collection) selfr rrr r r r rerz/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/document_loaders/mongodb.py__init__s.     zMongodbLoader.__init__)rcCst|S)aLoad data into Document objects. Attention: This implementation starts an asyncio event loop which will only work if running in a sync env. In an async env, it should fail since there is already an event loop running. This code should be updated to kick off the event loop from a separate thread if running within an async context. )asynciorunaload)rrrrloadJs zMongodbLoader.loadc sg}|j|jIdH}|}|j|j|2z3dHW}|j||jdd}|jrh||j |j d|j dur|j||j dd}dd| D}d |}nt|}|t||dq06t||krtd t|d |d |S) z0Asynchronously loads data into Document objects.N)default)ZdatabasercSsg|] }t|qSr)str).0valuerrr kz'MongodbLoader.aload.. )Z page_contentmetadataz6Only partial collection of documents returned. Loaded z docs, expected .)rZcount_documentsr _construct_projectionfind_extract_fieldsr r updaterrr valuesjoinr"appendrlenloggerwarning) rresultZ total_docsZ projectiondocr(fieldsZtextstextrrrrXs0    zMongodbLoader.aloadcCs:t|jp g}t|jpg}||}|r6dd|DSdS)zuConstructs the projection dictionary for MongoDB query based on the specified field names and metadata names.cSsi|] }|dqS)r)r#fieldrrr r&z7MongodbLoader._construct_projection..N)listr r )rr r Z all_fieldsrrrr*zsz#MongodbLoader._construct_projectionr )documentr6r!rc CsVi}|p gD]D}|}|dD]}|||}||krqs