a bg"@shddlmZmZmZmZmZddlmZddlm Z ddl m Z m Z erTddl mZGddde ZdS) ) TYPE_CHECKINGAnyCallableDictOptional)Document)get_from_dict_or_env) BaseModelmodel_validatorApifyDatasetLoaderc @s8eZdZUdZeed<eed<dZeeed<e dde e edd d Z dddd ee e e gefeeeeeed d ddZdddd ee e e gefeeeeeed d ddZdddd ee e e gefeeeeeed dddZdddd ee e e gefeeeeeed dddZdS) ApifyWrapperzWrapper around Apify. To use, you should have the ``apify-client`` python package installed, and the environment variable ``APIFY_API_TOKEN`` set with your API key, or pass `apify_api_token` as a named parameter to the constructor. apify_clientapify_client_asyncNapify_api_tokenbefore)mode)valuesreturnc Cst|dd}zxddlm}m}||}t|jd}rH|jdd7<||}t|jd}rr|jdd7<||d <||d <Wntytd Yn0|S) zValidate environment. Validate that an Apify API token is set and the apify-client Python package exists in the current environment. rZAPIFY_API_TOKENr) ApifyClientApifyClientAsync httpx_clientz user-agentz; Origin/langchainhttpx_async_clientrrz`Could not import apify-client Python package. Please install it with `pip install apify-client`.)rrrrgetattr http_clientheaders ImportError) clsrrrrclientrZ async_clientrrq/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/utilities/apify.pyvalidate_environments(   z!ApifyWrapper.validate_environment)build memory_mbytes timeout_secsr )actor_id run_inputdataset_mapping_functionr"r#r$rc Cs6ddlm}|j|j||||d}||d|dS)aRun an Actor on the Apify platform and wait for results to be ready. Args: actor_id (str): The ID or name of the Actor on the Apify platform. run_input (Dict): The input object of the Actor that you're trying to run. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the Actor run's default dataset. rr r&r"r#r$defaultDatasetIdZ dataset_idr')$langchain_community.document_loadersr ractorcall selfr%r&r'r"r#r$r Z actor_callrrr call_actor8s  zApifyWrapper.call_actorc s<ddlm}|j|j||||dIdH}||d|dS)aRun an Actor on the Apify platform and wait for results to be ready. Args: actor_id (str): The ID or name of the Actor on the Apify platform. run_input (Dict): The input object of the Actor that you're trying to run. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the Actor run's default dataset. rr r(Nr)r*)r+r rr,r-r.rrr acall_actor`s   zApifyWrapper.acall_actor)task_id task_inputr'r"r#r$rc Cs6ddlm}|j|j||||d}||d|dS)Run a saved Actor task on Apify and wait for results to be ready. Args: task_id (str): The ID or name of the task on the Apify platform. task_input (Dict): The input object of the task that you're trying to run. Overrides the task's saved input. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. build (str, optional): Optionally specifies the actor build to run. It can be either a build tag or build number. memory_mbytes (int, optional): Optional memory limit for the run, in megabytes. timeout_secs (int, optional): Optional timeout for the run, in seconds. Returns: ApifyDatasetLoader: A loader that will fetch the records from the task run's default dataset. rr r3r"r#r$r)r*)r+r rtaskr- r/r2r3r'r"r#r$r Z task_callrrr call_actor_tasks  zApifyWrapper.call_actor_taskc s<ddlm}|j|j||||dIdH}||d|dS)r4rr r5Nr)r*)r+r rr6r-r7rrr acall_actor_tasks   zApifyWrapper.acall_actor_task)__name__ __module__ __qualname____doc__r__annotations__rrstrr classmethodrr!rrintr0r1r8r9rrrr r sn &  .  .  / r N)typingrrrrrZlangchain_core.documentsrZlangchain_core.utilsrZpydanticr r r+r r rrrr s