a bg @svddlmZmZmZmZmZddlZddlmZddl m Z ddl m Z ddl mZGdddZGd d d e ZdS) )AnyDictListMappingOptionalN)CallbackManagerForLLMRun)LLM) ConfigDict)enforce_stop_tokensc@sJeZdZdZeeeeefeeefdddZeeedddZ dS) ContentHandlerAmazonAPIGatewayzAdapter to prepare the inputs from Langchain to a format that LLM model expects. It also provides helper function to extract the generated text from the model response.)prompt model_kwargsreturncCs ||dS)N)inputs parameters)clsr r rry/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/amazon_api_gateway.pytransform_inputsz.ContentHandlerAmazonAPIGateway.transform_input)responsercCs|ddS)NrZgenerated_text)json)rrrrrtransform_outputsz/ContentHandlerAmazonAPIGateway.transform_outputN) __name__ __module__ __qualname____doc__ classmethodstrrrrrrrrrr s  r c@seZdZUdZeed<dZeeed<dZ eeed<e Z e ed<e ddZ eeeefd d d Zeed d d ZdeeeeeeeedddZdS)AmazonAPIGatewayz6Amazon API Gateway to access LLM models hosted on AWS.api_urlNheadersr content_handlerZforbid)extra)rcCs$|jpi}i|j|jdd|iS)zGet the identifying parameters.)rr r )r rr )self _model_kwargsrrr_identifying_params3s   z$AmazonAPIGateway._identifying_paramscCsdS)zReturn type of llm.Zamazon_api_gatewayr)r#rrr _llm_type<szAmazonAPIGateway._llm_type)r stop run_managerkwargsrc Ks|jpi}|j||}z$tj|j|j|d}|j|}Wn2tyn} zt d| WYd} ~ n d} ~ 00|durt ||}|S)abCall out to Amazon API Gateway model. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = se("Tell me a joke.") )r rzError raised by the service: N) r r!rrequestspostrr r Exception ValueErrorr ) r#r r'r(r)r$payloadrtexterrorrrr_callAs $ zAmazonAPIGateway._call)NN)rrrrr__annotations__r rrr r r!r Z model_configpropertyrrr%r&rrr1rrrrrs*  r)typingrrrrrr*Zlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZpydanticr Zlangchain_community.llms.utilsr r rrrrrs