a bg@s|dZddlZddlmZddlmZmZmZddlm Z ddl m Z m Z m Z ddlmZdgZeeZGd dde e ZdS) z-written under MIT Licence, Michael Feil 2023.N) getLogger)AnyListOptional) Embeddings) BaseModel ConfigDictmodel_validator)SelfInfinityEmbeddingsLocalc@seZdZUdZeed<dZeeed<dZe ed<dZ eed<d Z eed <d Z e ed <dZeed <edddZeddedddZddddZeddddZeeeeedddZeeeddd Zeeeeedd!d"Zeeedd#d$ZdS)%r aOptimized Infinity embedding models. https://github.com/michaelfeil/infinity This class deploys a local Infinity instance to embed text. The class requires async usage. Infinity is a class to interact with Embedding Models on https://github.com/michaelfeil/infinity Example: .. code-block:: python from langchain_community.embeddings import InfinityEmbeddingsLocal async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) modelNrevision batch_sizeautodeviceZtorchbackendT model_warmupengineZforbid)extraZprotected_namespacesafter)mode)returncCsRzddlm}Wnty*tdYn0||j|j|j|j|j|jd|_ |S)z?Validate that api key and python package exists in environment.r)AsyncEmbeddingEnginezrPlease install the `pip install 'infinity_emb[optimum,torch]>=0.0.24'` package to use the InfinityEmbeddingsLocal.)Zmodel_name_or_pathrr rrr) Z infinity_embr ImportErrorr rr rrrr)selfrrr{/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/embeddings/infinity_local.pyvalidate_environmentBs  z,InfinityEmbeddingsLocal.validate_environmentcs|jIdHdS)aQstart the background worker. recommended usage is with the async with statement. async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) N)r __aenter__)rrrrrXs z"InfinityEmbeddingsLocal.__aenter__)argsrcs|jj|IdHdS)zUstop the background worker, required to free references to the pytorch model.N)r __aexit__)rr rrrr!esz!InfinityEmbeddingsLocal.__aexit__)textsrc s|jjsltd|4IdH,|j|IdH\}}WdIdHq`1IdHsV0Ytdn|j|IdH\}}|S)zAsync call out to Infinity's embedding endpoint. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. zeStarting Infinity engine on the fly. This is not recommended.Please start the engine before using it.Nz$Stopped infinity engine after usage.)rrunningloggerwarningZembed)rr" embeddings_rrraembed_documentsjs @ z(InfinityEmbeddingsLocal.aembed_documents)textrcs||gIdH}|dS)zAsync call out to Infinity's embedding endpoint. Args: text: The text to embed. Returns: Embeddings for the text. Nr)r()rr)r&rrr aembed_querys z$InfinityEmbeddingsLocal.aembed_querycCstdt||S)z, This method is async only. zQThis method is async only. Please use the async version `await aembed_documents`.)r$r%asynciorunr()rr"rrrembed_documentssz'InfinityEmbeddingsLocal.embed_documentscCstdt||S) zMThis method is async only. Please use the async version `await aembed_query`.)r$r%r+r,r*)rr)rrr embed_querysz#InfinityEmbeddingsLocal.embed_query)__name__ __module__ __qualname____doc__str__annotations__r rrintrrrboolrrrZ model_configr r rrr!rfloatr(r*r-r/rrrrr s(         )r3r+loggingrtypingrrrZlangchain_core.embeddingsrZpydanticrrr Ztyping_extensionsr __all__r0r$r rrrrs