a bg@sNddlZddlmZmZddlmZddlmZee Z GdddeZ dS)N)AnyOptional)LLM)IpexLLMc @seZdZdZedddddeeeeeeeee e dddZ edddeeeeee e d d d Z e ed d dZdS)BigdlLLMzWrapper around the BigdlLLM model Example: .. code-block:: python from langchain_community.llms import BigdlLLM llm = BigdlLLM.from_model_id(model_id="THUDM/chatglm-6b") NT) tokenizer_id load_in_4bitload_in_low_bit)model_id model_kwargsrrr kwargsreturncKs,tdz$ddlm}m}ddlm} m} WntyHtdYn0|dur\td|sht d|pni} |pv|} z| j | fi| } Wn$t y| j | fi| } Yn0z|j |fd d i| }Wn(t y|j |fd d i| }Yn0d | vrd d | D} |f||| | d|S)a5 Construct object from model_id Args: model_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. tokenizer_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. 4BigdlLLM was deprecated. Please use IpexLLM instead.r AutoModelAutoModelForCausalLM AutoTokenizerLlamaTokenizerpCould not import bigdl-llm or transformers. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.Nz`load_in_low_bit` option is not supported in BigdlLLM and is ignored. For more data types support with `load_in_low_bit`, use IpexLLM instead.zBigdlLLM only supports loading in 4-bit mode, i.e. load_in_4bit = True. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.rTtrust_remote_codecSsi|]\}}|dkr||qSr.0kvrrp/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/bigdl_llm.py ]sz*BigdlLLM.from_model_id..r model tokenizerr ) loggerwarningbigdl.llm.transformersrr transformersrr ImportError ValueErrorfrom_pretrained Exceptionitems)clsr r rrr r rrrr _model_kwargs _tokenizer_idr!r rrr from_model_idsd        zBigdlLLM.from_model_id)r)r r rr r c Kstdz$ddlm}m}ddlm}m}WntyHtdYn0|pPi} |pX|} z|j | fi| } Wn$t y|j | fi| } Yn0z|j |fi| } Wn$t y|j |fi| } Yn0d| vrdd| D} |f|| | | d |S) a Construct low_bit object from model_id Args: model_id: Path for the bigdl-llm transformers low-bit model folder. tokenizer_id: Path for the huggingface repo id or local model folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. rrrrrrcSsi|]\}}|dkr||qSrrrrrrrsz2BigdlLLM.from_model_id_low_bit..r) r"r#r$rrr%rrr&r(r)Z load_low_bitr*) r+r r rr rrrrr,r-r!r rrrfrom_model_id_low_bitis<     zBigdlLLM.from_model_id_low_bit)r cCsdS)Nz bigdl-llmr)selfrrr _llm_typeszBigdlLLM._llm_type)N)N)__name__ __module__ __qualname____doc__ classmethodstrrdictboolrrr.r/propertyr1rrrrr s: S@r) loggingtypingrrZ#langchain_core.language_models.llmsrZ!langchain_community.llms.ipex_llmr getLoggerr2r"rrrrrs