a bg@sdZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z ddlmZddlmZmZdd lmZmZmZdd lmZeeZe d d d dGdddeZdS)z,Wrapper around Together AI's Completion API.N)AnyDictListOptional) ClientSession) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLMconvert_to_secret_strget_from_dict_or_env) ConfigDict SecretStrmodel_validator)Requestsz0.0.12z1.0zlangchain_together.Together)ZsinceZremovalZalternative_importc@sLeZdZUdZdZeed<eed<eed<dZe e ed<dZ e e ed<dZ e e ed <dZe e ed <dZe e ed <dZe e ed <ed dZeddeeedddZeedddZeedddZeedddZeeeefdddZd#ee eee e eeddd Z!d$ee eee e"eedd!d"Z#dS)%TogetheraLLLM models from `Together`. To use, you'll need an API key which you can find here: https://api.together.xyz/settings/api-keys. This can be passed in as init param ``together_api_key`` or set as environment variable ``TOGETHER_API_KEY``. Together AI API reference: https://docs.together.ai/reference/inference z"https://api.together.xyz/inferencebase_urltogether_api_keymodelN temperaturetop_ptop_k max_tokensrepetition_penaltylogprobsZforbid)extrabefore)mode)valuesreturncCstt|dd|d<|S)z,Validate that api key exists in environment.rZTOGETHER_API_KEYr )clsrr"o/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/together.pyvalidate_environmentIs zTogether.validate_environment)r cCsdS)zReturn type of model.Ztogetherr"selfr"r"r# _llm_typeRszTogether._llm_type)outputr cCs|ddddS)Nr(choicesrtextr")r&r(r"r"r#_format_outputWszTogether._format_outputcCsddlm}d|S)Nr __version__z langchain/)Zlangchain_communityr-r,r"r"r#get_user_agentZs zTogether.get_user_agentcCs|j|j|j|j|j|jdS)Nrrrrrrr/r%r"r"r#default_params`szTogether.default_params)promptstop run_managerkwargsr c Ksd|jdd}|r.t|dkr.|dn|}i|j||d|}dd|D}t|d }|j|j|d } | jd krt d | jn>| jd krt d| j n"| jdkrt d| jd| j | } | ddkr| dd} t | || } | S)zCall out to Together's text generation endpoint. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model.. Bearer application/json Authorizationz Content-Typerr1r2cSsi|]\}}|dur||qSNr".0kvr"r"r# z"Together._call..)headers)urldataTogether Server: Error &Together received an invalid payload: 5Together returned an unexpected response with status : statusfinishederrorUndefined Error)rget_secret_valuelenr0itemsrpostr status_code Exception ValueErrorr*jsongetr+) r&r1r2r3r4rB stop_to_usepayloadrequestresponserDerr_msgr(r"r"r#_callksB      zTogether._callc sd|jdd}|r.t|dkr.|dn|}i|j||d|}dd|D}t4Id H}|j|j||d 4Id H} | jd krt d | jn>| jd krt d| j n"| jdkrt d| jd| j | Id H} | ddkr| dd} t | || } | Wd Id HWd Id HS1Id HsZ0YWd Id Hq1Id Hs0Yd S)zCall Together model to get predictions based on the prompt. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. r5r6r7r9rr:cSsi|]\}}|dur||qSr;r"r<r"r"r#r@rAz#Together._acall..N)rWrBrErFrGrHrIrJrKrLrMrNrO)rrPrQr0rRrrSrrLrUrVr*rWrXr+) r&r1r2r3r4rBrYrZsessionr\Z response_jsonr]r(r"r"r#_acallsL      zTogether._acall)NN)NN)$__name__ __module__ __qualname____doc__rstr__annotations__rrrfloatrrintrrrrZ model_configr classmethodrrr$propertyr'dictr+ staticmethodr.r0rr r^rr`r"r"r"r#rsR     7 r)rdloggingtypingrrrrZaiohttprZlangchain_core._api.deprecationrZlangchain_core.callbacksrr Z#langchain_core.language_models.llmsr Zlangchain_core.utilsr r ZpydanticrrrZ&langchain_community.utilities.requestsr getLoggerraloggerrr"r"r"r#s