a bg @sddZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z Gdd d e ZdS) z-Wrapper around Elasticsearch vector database.) annotationsN)AnyIterableList)CallbackManagerForRetrieverRun)Document) BaseRetrieverc@sdeZdZUdZded<ded<eddddddd d d Zdd dddddZddddddZdS)ElasticSearchBM25Retrievera?`Elasticsearch` retriever that uses `BM25`. To connect to an Elasticsearch instance that requires login credentials, including Elastic Cloud, use the Elasticsearch URL format https://username:password@es_host:9243. For example, to connect to Elastic Cloud, create the Elasticsearch URL with the required authentication details and pass it to the ElasticVectorSearch constructor as the named parameter elasticsearch_url. You can obtain your Elastic Cloud URL and login credentials by logging in to the Elastic Cloud console at https://cloud.elastic.co, selecting your deployment, and navigating to the "Deployments" page. To obtain your Elastic Cloud password for the default "elastic" user: 1. Log in to the Elastic Cloud console at https://cloud.elastic.co 2. Go to "Security" > "Users" 3. Locate the "elastic" user and click "Edit" 4. Click "Reset password" 5. Follow the prompts to reset the password The format for Elastic Cloud URLs is https://username:password@cluster_id.region_id.gcp.cloud.es.io:9243. rclientstr index_name@?float)elasticsearch_urlr k1breturnc Csfddlm}||}ddddiiidd||d id }d d d ddii}|jj|||d|||dS)aD Create a ElasticSearchBM25Retriever from a list of texts. Args: elasticsearch_url: URL of the Elasticsearch instance to connect to. index_name: Name of the index to use in Elasticsearch. k1: BM25 parameter k1. b: BM25 parameter b. Returns: r) ElasticsearchZanalyzerdefaulttypestandardZ custom_bm25ZBM25)rrr)Zanalysis similarity propertiescontenttext)rr)indexmappingssettings)r r )Z elasticsearchrindicescreate) clsrr rrresrrr#/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/retrievers/elastic_search_bm25.pyr ,s&   z!ElasticSearchBM25Retriever.createTz Iterable[str]boolz List[str])textsrefresh_indicesrc Cszddlm}Wnty*tdYn0g}g}t|D]8\}}tt}d|j||d} |||| q<||j ||r|j j j |jd|S)a.Run more texts through the embeddings and add to the retriever. Args: texts: Iterable of strings to add to the retriever. refresh_indices: bool to refresh ElasticSearch indices Returns: List of ids from adding the texts into the retriever. r)bulkzbCould not import elasticsearch python package. Please install it with `pip install elasticsearch`.r)Z_op_type_indexr_id)r) Zelasticsearch.helpersr( ImportError enumerater uuiduuid4r appendr rrefresh) selfr&r'r(requestsZidsirr*requestr#r#r$ add_textsYs*      z$ElasticSearchBM25Retriever.add_textsrzList[Document])query run_managerrcCsTddd|iii}|jj|j|d}g}|ddD]}|t|dddq2|S)Nr6matchr)rbodyhits_source)Z page_content)r searchr r/r)r1r6r7Z query_dictresdocsrr#r#r$_get_relevant_documentss z2ElasticSearchBM25Retriever._get_relevant_documentsN)r r)T) __name__ __module__ __qualname____doc____annotations__ classmethodr r5r@r#r#r#r$r s /'r )rD __future__rr-typingrrrZlangchain_core.callbacksrZlangchain_core.documentsrZlangchain_core.retrieversrr r#r#r#r$s