a bgh@shdZddlZddlmZddlmZmZmZm Z m Z GdddeZ d e e efe ee dd d ZdS) zDocument loader helpers.N)Path)List NamedTupleOptionalUnioncastc@s2eZdZUdZeeed<eed<eeed<dS) FileEncodingz File encoding as the NamedTuple.encoding confidencelanguageN)__name__ __module__ __qualname____doc__rstr__annotations__floatrrz/var/www/html/cobodadashboardai.evdpl.com/venv/lib/python3.9/site-packages/langchain_community/document_loaders/helpers.pyrs   r) file_pathtimeoutreturnc sddlt|}tttdfdd }tjR}|||}z|j|d}Wn$tjj ytt d|Yn0Wdn1s0Yt dd |Drt d |d d |DS) aTry to detect the file encoding. Returns a list of `FileEncoding` tuples with the detected encodings ordered by confidence. Args: file_path: The path to the file to detect the encoding for. timeout: The timeout in seconds for the encoding detection. rN)rrcsFt|d}|}Wdn1s(0Yttt|S)Nrb)openreadrrdict detect_all)rfrawdatachardetrrread_and_detect#s &z.detect_file_encodings..read_and_detect)rz-Timeout reached while detecting encoding for css|]}|dduVqdSr Nr).0r rrr 1z(detect_file_encodings..zCould not detect encoding for cSs&g|]}|ddurtfi|qSr#)r)r$encrrr 3r&z)detect_file_encodings..) r!rrr concurrentfuturesThreadPoolExecutorsubmitresult TimeoutErrorall RuntimeError)rrr"executorfuture encodingsrr rdetect_file_encodingss   (r4)r)rconcurrent.futuresr)pathlibrtypingrrrrrrrintr4rrrrs