a bg8@sdZddlmZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZddlmZddlZddlmZddlmZmZdd lmZmZdd lmZmZm Z m!Z!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(dd l)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/e r*ddl0m1Z1m2Z2m3Z3m4Z4ddl5m6Z6e7e8Z9eGdddZ:dddddZ;dddddZdd%d&d'd(Z?ed)d*d+d,Gd-d.d.e*eZ@dS)/z1Wrapper around Google VertexAI chat-based models.) annotationsN) dataclassfield) TYPE_CHECKINGAnyDictIteratorListOptionalUnioncast)urlparse) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun) BaseChatModelgenerate_from_stream) AIMessageAIMessageChunk BaseMessage HumanMessage SystemMessage)ChatGenerationChatGenerationChunk ChatResult)pre_init)_VertexAICommonis_codey_modelis_gemini_model)load_image_from_gcsraise_vertex_import_error) ChatMessage ChatSessionCodeChatSessionInputOutputTextPair)Contentc@s0eZdZUdZeedZded<dZded<dS) _ChatHistoryz/Represents a context and a history of messages.)default_factoryzList['ChatMessage']historyN Optional[str]context) __name__ __module__ __qualname____doc__rlistr(__annotations__r*r1r1v/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/chat_models/vertexai.pyr&6s r&List[BaseMessage])r(returnc Csddlm}gd}}t|D]\}}tt|j}|dkrJt|trJ|}qt|trn||jdd}| |qt|t r||jdd}| |qt dt |d|d qt ||d }|S) aParse a sequence of messages into history. Args: history: The list of messages to re-create the history of the chat. Returns: A parsed chat history. Raises: ValueError: If a sequence of message has a SystemMessage not at the first place. r)r!NZbot)contentauthoruserUnexpected message with type  at the position .)r*r()vertexai.language_modelsr! enumerater strr5 isinstancerrappendr ValueErrortyper&) r(r!vertex_messagesr*imessager5vertex_messageZ chat_historyr1r1r2_parse_chat_history>s"        rFr=bool)sr4c CsVzt|}t|j|jgWStyP}ztd|WYd}~dSd}~00dS)NzUnable to parse URL: F)r allschemenetloc Exceptionloggerdebug)rHresulter1r1r2_is_url^s rQr)zList['Content'])r(projectr4c sddlm}mmdddfdd g}t|D]\}}|dkr\t|tr\tdn:t|trld }n*t|t r|d }ntd t |d |d |j }t|t r|g}fdd|D}|||d} | | q8|S)Nr)r%ImagePartzUnion[str, Dict]rT)partr4cst|tr|St|ts2tdt|d|ddkrL|dS|ddkr|dd}|dr|t|d}q|d rt d |}|r| d }ntd  t |}qt|rt|}| |j}q|}ntd |S)Nz0Message's content is expected to be a dict, got !rAtextZ image_urlurlzgs://)pathrRz data:image/zdata:image/\w{2,4};base64,(.*)zdInvalid image uri. It should be in the format data:image/;base64,.z,Only text and image_url types are supported!)r>r=Z from_textrr@rA startswithrresearchgroup from_bytesbase64 b64decoderQrequestsgetraise_for_statusr5Zload_from_fileZ from_image)rUrYimageencodedresponse)rSrTrRr1r2_convert_to_promptls6            z6_parse_chat_history_gemini.._convert_to_promptz%SystemMessages are not yet supported!modelr7r8r9r:csg|] }|qSr1r1).0rU)rhr1r2 z._parse_chat_history_gemini..)roleparts)"vertexai.preview.generative_modelsr%rSrTr<r>rr@rrrAr5r=r?) r(rRr%rBrCrDrmZ raw_contentrnrEr1)rSrTrhrRr2_parse_chat_history_geminigs(#      rpzList['InputOutputTextPair'])examplesr4cCsddlm}t|ddkr0tdt|dg}d}t|D]\}}|ddkr~t|tsxtdt|d|d|j}|dd kr@t|t std t|d|d|||jd }| |q@|S) Nr)r$z8Expect examples to have an even amount of messages, got r:z;Expected the first message in a part to be from human, got z for the z th message.rZz9Expected the second message in a part to be from AI, got ) input_textZ output_text) r;r$lenr@r<r>rrAr5rr?)rqr$Z example_pairsrsrCZexamplepairr1r1r2_parse_exampless@      rvr)messagesr4cCs4|s td|d}t|ts0td|jd|S)zMGet the human message at the end of a list of input messages to a chat model.z:You should provide at least one message to start the chat!z3Last message in the list should be from human, got r:)r@r>rrA)rwquestionr1r1r2 _get_questions  rzz0.0.12z1.0z&langchain_google_vertexai.ChatVertexAI)ZsinceZremovalZalternative_importc@seZdZUdZdZded<dZded<edd d d Zed d d dZ e dddddZ d(dddddddddZ d)ddddddddZ d*ddddd dd!d"Zd#dd$d%d&d'ZdS)+ ChatVertexAIz+`Vertex AI` Chat large language models API.z chat-bisonr= model_nameNzOptional[List[BaseMessage]]rqrG)r4cCsdS)NTr1)selfr1r1r2is_lc_serializableszChatVertexAI.is_lc_serializablez List[str]cCsgdS)z*Get the namespace of the langchain object.)Z langchainZ chat_modelsZvertexair1)clsr1r1r2get_lc_namespaceszChatVertexAI.get_lc_namespacer)valuesr4cCst|d}||z$ddlm}m}|r8ddlm}WntyRtYn0|rl||dd|d<n(t |dr~|}n|}| |d|d<|S)z7Validate that the python package exists in environment.r|r) ChatModel CodeChatModel)GenerativeModel)r|client) rZ_try_init_vertexair;rrror ImportErrorr rZfrom_pretrained)rrZ is_geminirrrZ model_clsr1r1r2validate_environments     z!ChatVertexAI.validate_environmentr3zOptional[List[str]]z"Optional[CallbackManagerForLLMRun]zOptional[bool]rr)rwstop run_managerstreamkwargsr4cKs|dur |n|j}|r6|j|f||d|}t|St|}|jf|dd|} i} d| vrn| d| d<|jrt||jd} | } |j j | d} | j | | d}nVt |dd }| d p|j}|rt|| d <|j|fi| } | j |jfi| }d d |jD}t|d S)a>Generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. stream: Whether to use the streaming endpoint. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. N)rrFrrcandidate_countrRr(generation_configrxrqcSsg|]}tt|jddqSr5rDrrrWrjrr1r1r2rk,sz*ChatVertexAI._generate.. generations)Z streaming_streamrrz_prepare_paramspop_is_gemini_modelrprRr start_chat send_messagerFrcrqrv _start_chatr5 candidatesr)r}rwrrrrZ should_streamZ stream_iterryparams msg_paramshistory_geminirDchatrgr(rqrr1r1r2 _generates< zChatVertexAI._generatez'Optional[AsyncCallbackManagerForLLMRun])rwrrrr4csd|vr|dtd|jfd|i|}i}d|vrJ|d|d<|jrt||jd}|}|jj|d} | j ||dIdH} n`t |} t |dd } | d d} | rt | |d <|j| fi|} | j | jfi|IdH} d d | jD}t|d S)aAsynchronously generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. rz8ChatVertexAI does not currently support async streaming.rrrrrNrxrqcSsg|]}tt|jddqSrrrr1r1r2rk^sz+ChatVertexAI._agenerate..r)rrMwarningrrrprRrrZsend_message_asyncrzrFrcrvrr5rr)r}rwrrrrrrrDrrgryr(rqrr1r1r2 _agenerate2s.    zChatVertexAI._ageneratezIterator[ChatGenerationChunk]cks|jf|dd|}|jrRt||jd}|}|jj|d}|j|d|d} nZt|} t |dd} | dd} | rt | |d<|j | fi|}|j | jfi|} | D]0} tt| jdd }|r|j| j|d |VqdS) NTrrr)rrrxrqrr)chunk)rrrprRrrrrrzrFrcrvrZsend_message_streamingr5rrrWZon_llm_new_token)r}rwrrrrrrDr responsesryr(rqrgrr1r1r2rds(  zChatVertexAI._streamr&z#Union[ChatSession, CodeChatSession])r(rr4cKs>|js"|jjf|j|jd|S|jjfd|ji|SdS)N)r*message_historyr)rrrr*r()r}r(rr1r1r2rszChatVertexAI._start_chat)NNN)NN)NN)r+r,r-r.r|r0rq classmethodr~rrrrrrrr1r1r1r2r{s(   95r{)Ar. __future__rr`loggingr\ dataclassesrrtypingrrrrr r r r urllib.parser rbZlangchain_core._api.deprecationrZlangchain_core.callbacksrrZ*langchain_core.language_models.chat_modelsrrZlangchain_core.messagesrrrrrZlangchain_core.outputsrrrZlangchain_core.utilsrZ!langchain_community.llms.vertexairrrZ&langchain_community.utilities.vertexairr r;r!r"r#r$ror% getLoggerr+rMr&rFrQrprvrzr{r1r1r1r2sB (       >