a bgX@s\ddlZddlZddlZddlmZmZmZmZddl m Z ddl m Z Gddde Z dS)N)AnyListMappingOptional)CallbackManagerForLLMRun)LLMc@s~eZdZUdZeeed<dZeeed<e edddZ deee eee e ed d d Ze eee fdd d ZdS)NIBittensorLLMaNIBittensor LLMs NIBittensorLLM is created by Neural Internet (https://neuralinternet.ai/), powered by Bittensor, a decentralized network full of different AI models. To analyze API_KEYS and logs of your usage visit https://api.neuralinternet.ai/api-keys https://api.neuralinternet.ai/logs Example: .. code-block:: python from langchain_community.llms import NIBittensorLLM llm = NIBittensorLLM() system_promptr top_responses)returncCsdS)Nrselfr r p/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/llms/bittensor.py _llm_type"szNIBittensorLLM._llm_typeN)promptstop run_managerkwargsr c Kst}d|_tjjd|d}t|jtr8t d|j}nd}d}|j durT|d} n|t |j } | d d | } | d d d dd } t| } | dd} dd| dd}|j d d|d| }|d d d dd }t|}t|tr|r|s|D]}zt|gd| dd|dgd}| dd||| }|d d d dd }t|}d|vrWq|dddd}||WStyYqYn0qzt|d| dd|dgd}| dd||| }|d d d dd }|r@||WSt|}|dddd}||WSty}z*|j d d |d!||dWYd}~d"Sd}~00dS)#a Wrapper around the bittensor top miner models. Its built by Neural Internet. Call the Neural Internet's BTVEP Server and return the output. Parameters (optional): system_prompt(str): A system prompt defining how your model should respond. top_responses(int): Total top miner responses to retrieve from Bittensor protocol. Return: The generated response(s). Example: .. code-block:: python from langchain_community.llms import NIBittensorLLM llm = NIBittensorLLM(system_prompt="Act like you are programmer with 5+ years of experience.") Tztest.neuralinternet.ai)contextdrzwYou are an assistant which is created by Neural Internet(NI) in decentralized network named as a Bittensor.Nz? Your task is to provide accurate response based on user promptGETz/admin/api-keys/zutf-8  api_keyzapplication/jsonzBearer z 2023-05-19)z Content-Type AuthorizationzEndpoint-Versionz/top_miner_uids)headerssystem)Zrolecontentuser)uidsmessagesPOSTz/chatchoicesmessager)top_nr"z /error_msg?e=z&p=zBSorry I am unable to provide response now, Please try again later.)sslcreate_default_contextcheck_hostnamehttpclientHTTPSConnection isinstancer intminr strrequest getresponsereaddecodereplacejsonloadslistdumpsclose Exception)rrrrrrconnr&Zdefault_promptr Zapi_key_responseZ api_keys_dataZ api_keys_jsonrrZminer_responseZ miner_datar!uidpayloadZ init_responseZ init_dataZ init_jsonZreplyresponseZ utf_stringZ json_resper r r_call&s            zNIBittensorLLM._callcCs|j|jdS)zGet the identifying parameters.r r rBr r r r_identifying_paramssz"NIBittensorLLM._identifying_params)NN)__name__ __module__ __qualname____doc__rr0__annotations__r r.propertyrrrrrArrCr r r rr s"    r) http.clientr*r6r'typingrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrrr r r rs