a bg1@srddlmZddlmZmZmZddlmZddlm Z m Z m Z dZ dZ dZGdd d e eZGd d d eZd S) )Path)AnyDictList) Embeddings) BaseModel ConfigDictFieldzVs zMOpenVINOEmbeddings.__init__..require_model_export..z/openvino_model.xmlz.xmlz.binT)ris_direxists model_infoas_posixZsiblingsreplace Exception)rrrZ model_dirZhf_apir&Z model_filesZ ov_model_pathrr r"require_model_exportEs0   z9OpenVINOEmbeddings.__init__..require_model_exportZexportT) AutoTokenizerzQUnable to import transformers, please install with `pip install -U transformers`.)NN)super__init__Zoptimum.intel.openvinor ImportErrorZhuggingface_hubrstrrboolr Zfrom_pretrainedrr Z transformersr+r )selfrrer*r+ __class__rr"r-/sX#  zOpenVINOEmbeddings.__init__textrcCsdt|trttt|St|ds,dSt|dksFt|dtrNt|Stdd|DSdS)z Help function to get the length for the input text. Text can be either a list of ints (which means a single text as input), or a tuple of list of ints (representing several text inputs to the model). __len__rcSsg|] }t|qSr!)lenrtr!r!r"r#z3OpenVINOEmbeddings._text_length..N) isinstancedictr9nextitervalueshasattrintsumr1r6r!r!r" _text_length|s  zOpenVINOEmbeddings._text_lengthT) sentences batch_sizeshow_progress_barconvert_to_numpyconvert_to_tensor mean_poolingnormalize_embeddingsrc svz ddl}Wn.ty:} ztd| WYd} ~ n d} ~ 00zddlm} Wn.tyz} ztd| WYd} ~ n d} ~ 00z ddlWn.ty} ztd| WYd} ~ n d} ~ 00tttdfdd } |rd }d } ttstd sgd } g| fd dD} fdd| D}| dt |d| dD]}||||}j j j dd}|jrj|d d dd}nj|d|d dd}j fi|}|r| ||d}n|ddddf}|rjjj|ddd}|r|}|q>fdd| | D|rJt r@nn|rd|ddD| rrdS)aw Computes sentence embeddings. :param sentences: the sentences to embed. :param batch_size: the batch size used for the computation. :param show_progress_bar: Whether to output a progress bar. :param convert_to_numpy: Whether the output should be a list of numpy vectors. :param convert_to_tensor: Whether the output should be one large tensor. :param mean_pooling: Whether to pool returned vectors. :param normalize_embeddings: Whether to normalize returned vectors. :return: By default, a 2d numpy array with shape [num_inputs, output_dimension]. rNzCUnable to import numpy, please install with `pip install -U numpy`.)trangezAUnable to import tqdm, please install with `pip install -U tqdm`.zCUnable to import torch, please install with `pip install -U torch`.) model_outputattention_maskrcsD|d}|d|}||dj|dddS)Nrr8g& .>)min)Z unsqueezeexpandsizefloatrDclamp)rPrQZtoken_embeddingsZinput_mask_expanded)torchr!r"run_mean_poolings z3OpenVINOEmbeddings.encode..run_mean_poolingFr7Tcsg|]}| qSr!)rF)rZsenr1r!r"r#r<z-OpenVINOEmbeddings.encode..csg|] }|qSr!r!ridx)rHr!r"r#r<ZBatches)descdisabler8pt)padding truncationreturn_tensors max_length)r`rcrarbrQ)pdimcsg|] }|qSr!r!r[)all_embeddingsr!r"r#r<cSsg|] }|qSr!)numpy)rZembr!r!r"r#r<)rhr.ZtqdmrOrXrr=r/rBZargsortr9r requestinputsZget_partial_shapeZ is_dynamicr Z get_lengthnnZ functional normalizecpuextendstackZTensorZasarray)r1rHrIrJrKrLrMrNnpr2rOrYZinput_was_stringZlength_sorted_idxZsentences_sorted start_indexZsentences_batchlengthfeaturesZ out_features embeddingsr!)rgr1rHrXr"encodes        zOpenVINOEmbeddings.encodeZforbidr!)extraZprotected_namespacestextsrcCs4ttdd|}|j|fd|ji|j}|S)Compute doc embeddings using a HuggingFace transformer model. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. cSs |ddS)N  )r()xr!r!r" r<z4OpenVINOEmbeddings.embed_documents..rJ)listmaprurrtolistr1rxrtr!r!r"embed_documentss z"OpenVINOEmbeddings.embed_documentscCs||gdS)Compute query embeddings using a HuggingFace transformer model. Args: text: The text to embed. Returns: Embeddings for the text. r)rrEr!r!r" embed_querys zOpenVINOEmbeddings.embed_query) model_pathrcCs&|j|j||j|dS)NT)r ZhalfZsave_pretrainedr )r1rr!r!r" save_models   zOpenVINOEmbeddings.save_model)rGFTFFT)__name__ __module__ __qualname____doc__r r__annotations__r r/r r>rrrrr0r-rCrFrurZ model_configrrVrrr __classcell__r!r!r3r"r s>    M s  r cspeZdZUdZeZeed<dZeed<e dfdd Z e ee e e dd d Z ee e d d d ZZS)OpenVINOBgeEmbeddingsaOpenVNO BGE embedding models. Bge Example: .. code-block:: python from langchain_community.embeddings import OpenVINOBgeEmbeddings model_name = "BAAI/bge-large-en-v1.5" model_kwargs = {'device': 'CPU'} encode_kwargs = {'normalize_embeddings': True} ov = OpenVINOBgeEmbeddings( model_name_or_path=model_name, model_kwargs=model_kwargs, encode_kwargs=encode_kwargs ) query_instructionembed_instructionrc s&tjfi|d|jvr"t|_dS)rz-zhN)r,r-r DEFAULT_QUERY_BGE_INSTRUCTION_ZHr)r1rr3r!r"r-@s zOpenVINOBgeEmbeddings.__init__rwcs.fdd|D}j|fij}|S)rycsg|]}j|ddqS)rzr{)rr(r:rZr!r"r#Pr<z9OpenVINOBgeEmbeddings.embed_documents..)rurrrr!rZr"rGs z%OpenVINOBgeEmbeddings.embed_documentsr5cCs.|dd}|j|j|fi|j}|S)rrzr{)r(rurrr)r1r6Z embeddingr!r!r"rTs z!OpenVINOBgeEmbeddings.embed_query)rrrr DEFAULT_QUERY_BGE_INSTRUCTION_ENrr/rrrr-rrVrrrr!r!r3r"r)s    rN)pathlibrtypingrrrZlangchain_core.embeddingsrZpydanticrrr ZDEFAULT_QUERY_INSTRUCTIONrrr rr!r!r!r"s