o Q`:@sdZddlmZmZddlZddlmZddlmZddl m Z m Z m Z m Z ddlmZdd lmZejrQdd lmZmZmZmZdd lmZeeeeegefZ   dd d Z   dddZddZddZddZddZ dddZ!   dddZ"   dddZ#dS) z6Functions for copying resources *between* filesystem. )print_functionunicode_literalsN)FSError manage_fs)abspathcombinefrombasenormpath)is_thread_safe)Walker)CallableOptionalTextUnion)FSc Ct|d|d|||dS)aCopy the contents of one filesystem to another. Arguments: src_fs (FS or str): Source filesystem (URL or instance). dst_fs (FS or str): Destination filesystem (URL or instance). walker (~fs.walk.Walker, optional): A walker object that will be used to scan for files in ``src_fs``. Set this if you only want to consider a sub-set of the resources in ``src_fs``. on_copy (callable): A function callback called after a single file copy is executed. Expected signature is ``(src_fs, src_path, dst_fs, dst_path)``. workers (int): Use `worker` threads to copy data, or ``0`` (default) for a single-threaded copy. /walkeron_copyworkers)copy_dirsrc_fsdst_fsrrrr)/usr/lib/python3/dist-packages/fs/copy.pycopy_fssrc Cr)aCopy the contents of one filesystem to another, checking times. If both source and destination files exist, the copy is executed only if the source file is newer than the destination file. In case modification times of source or destination files are not available, copy file is always executed. Arguments: src_fs (FS or str): Source filesystem (URL or instance). dst_fs (FS or str): Destination filesystem (URL or instance). walker (~fs.walk.Walker, optional): A walker object that will be used to scan for files in ``src_fs``. Set this if you only want to consider a sub-set of the resources in ``src_fs``. on_copy (callable):A function callback called after a single file copy is executed. Expected signature is ``(src_fs, src_path, dst_fs, dst_path)``. workers (int): Use ``worker`` threads to copy data, or ``0`` (default) for a single-threaded copy. rr)copy_dir_if_newerrrrrcopy_fs_if_newer1sr!cCs`z%||r#d}|||j}|dur#|||j}|dup!||kWSWdSty/YdSw)aDetermine if source file is newer than destination file. Arguments: src_fs (FS): Source filesystem (instance or URL). src_path (str): Path to a file on the source filesystem. dst_fs (FS): Destination filesystem (instance or URL). dst_path (str): Path to a file on the destination filesystem. Returns: bool: `True` if the source file is newer than the destination file or file modification time cannot be determined, `False` otherwise. ZdetailsmodifiedNT)existsZgetinfor#r)rsrc_pathrdst_path namespace src_modified dst_modifiedrrr_source_is_newerRs  r*c CsRt|dd}t|ddz}||ur|j||ddne|Y|E||rG||d}|||Wdn1sAwYn||}|||Wdn1s]wYWdn1slwYWdn1s{wYWdn1swYWddSWddS1swYdS)aCopy a file from one filesystem to another. If the destination exists, and is a file, it will be first truncated. Arguments: src_fs (FS or str): Source filesystem (instance or URL). src_path (str): Path to a file on the source filesystem. dst_fs (FS or str): Destination filesystem (instance or URL). dst_path (str): Path to a file on the destination filesystem. FZ writeableTZcreateZ overwritewN)rcopylock hassyspathopenbindownloadupload)rr%rr&_src_fs_dst_fs write_file read_filerrr copy_fileos,  "r9cCs||ur|j||dddS||r2||d}|||WddS1s+wYdS||}|||WddS1sIwYdS)aLow level copy, that doesn't call manage_fs or lock. If the destination exists, and is a file, it will be first truncated. This method exists to optimize copying in loops. In general you should prefer `copy_file`. Arguments: src_fs (FS): Source filesystem. src_path (str): Path to a file on the source filesystem. dst_fs (FS: Destination filesystem. dst_path (str): Path to a file on the destination filesystem. Tr-r.N)r/r1r2r3r4)rr%rr&r7r8rrrcopy_file_internals " "r:c Cst|dd}t|dd}||ur?t||||r0|j||dd WdWddS WdWddS|Y|Et||||rrt|||| WdWdWdWddS WdWdWdWddS1swYWdn1swYWdn1swYWddSWddS1swYdS)aCopy a file from one filesystem to another, checking times. If the destination exists, and is a file, it will be first truncated. If both source and destination files exist, the copy is executed only if the source file is newer than the destination file. In case modification times of source or destination files are not available, copy is always executed. Arguments: src_fs (FS or str): Source filesystem (instance or URL). src_path (str): Path to a file on the source filesystem. dst_fs (FS or str): Destination filesystem (instance or URL). dst_path (str): Path to a file on the destination filesystem. Returns: bool: `True` if the file copy was executed, `False` otherwise. Fr+Tr,r-N)rr*r/r0r:)rr%rr&r5r6rrrcopy_file_if_newers8     . "r;c Cs|pt}t|^}t|dd?}|+|||D] }|j|ddq Wdn1s4wYWdn1sCwYWdn1sRwYWddSWddS1sjwYdS)aCopy directories (but not files) from ``src_fs`` to ``dst_fs``. Arguments: src_fs (FS or str): Source filesystem (instance or URL). dst_fs (FS or str): Destination filesystem (instance or URL). walker (~fs.walk.Walker, optional): A walker object that will be used to scan for files in ``src_fs``. Set this if you only want to consider a sub-set of the resources in ``src_fs``. Tr,ZrecreateN)r rr0dirsmakedir)rrrr5r6dir_pathrrrcopy_structures  "r@c s|pdd}|p t}tt|}tt|}fdd} fdd} ddlm} | } | } | | nt| | }| |rE|nd d P}| j|d d || |D]:\}}}t |t ||}|D] }| j| |d d qf|D]}| |}| |}| | || ||| || |quqWWd n1swYWd n1swYWd n1swYWd n1swYWd d SWd d S1swYd S)alCopy a directory from one filesystem to another. Arguments: src_fs (FS or str): Source filesystem (instance or URL). src_path (str): Path to a directory on the source filesystem. dst_fs (FS or str): Destination filesystem (instance or URL). dst_path (str): Path to a directory on the destination filesystem. walker (~fs.walk.Walker, optional): A walker object that will be used to scan for files in ``src_fs``. Set this if you only want to consider a sub-set of the resources in ``src_fs``. on_copy (callable, optional): A function callback called after a single file copy is executed. Expected signature is ``(src_fs, src_path, dst_fs, dst_path)``. workers (int): Use ``worker`` threads to copy data, or ``0`` (default) for a single-threaded copy. cWdSNrargsrrrzcopy_dir..c tddSNFr+rrrrrsrc zcopy_dir..srccrGNTr,rrrrrdstrKzcopy_dir..dstrCopierrZ num_workersTr<N) r rr _bulkrPr0r r>walkr r Z make_pathr/)rr%rr&rrr _src_path _dst_pathrJrNrPr5r6 _thread_safecopierr?r=files copy_pathinforrrrrs<          Prcs$|pdd}|p t}tt|}tt|}fdd} fdd} ddlm} | } | } | | t| | }| |rE|nd d y}| j|d d d }dd|| ||D}dd|| ||D}|D]M\}}t |t ||}|j r| j|d d qm|j rz |j }||j }Wn tyd }Yn w|dup|dup||k}|r|| || ||| || |qmWdn1swYWdn1swYWdn1swYWdn1swYWddSWddS1s wYdS)apCopy a directory from one filesystem to another, checking times. If both source and destination files exist, the copy is executed only if the source file is newer than the destination file. In case modification times of source or destination files are not available, copy is always executed. Arguments: src_fs (FS or str): Source filesystem (instance or URL). src_path (str): Path to a directory on the source filesystem. dst_fs (FS or str): Destination filesystem (instance or URL). dst_path (str): Path to a directory on the destination filesystem. walker (~fs.walk.Walker, optional): A walker object that will be used to scan for files in ``src_fs``. Set this if you only want to consider a sub-set of the resources in ``src_fs``. on_copy (callable, optional): A function callback called after a single file copy is executed. Expected signature is ``(src_fs, src_path, dst_fs, dst_path)``. workers (int): Use ``worker`` threads to copy data, or ``0`` (default) for a single-threaded copy. cWrArBrrCrrrrEPrFz#copy_dir_if_newer..crGrHrrrIrrrJUrKzcopy_dir_if_newer..srccrGrLrrrMrrrNXrKzcopy_dir_if_newer..dstrrOrrQTr<r"cSsi|] \}}|jr||qSr)is_file.0pathrZrrr cs z%copy_dir_if_newer..cSsg|]\}}||fqSrrr]rrr hsz%copy_dir_if_newer..N)r rr rRrPr0r r>rZr r is_dirr\r#KeyErrorr/)rr%rr&rrrrTrUrJrNrPr5r6rVrWr'Z dst_stateZ src_stater?Z copy_inforYr(r)Zdo_copyrr[rr 0s^           Rr )NNrrB)$__doc__Z __future__rrtypingerrorsrZopenerrr_rr r r Ztoolsr rSr Z TYPE_CHECKINGrrrrbaserobjectZ_OnCopyrr!r*r9r:r;r@rr rrrrsD       !#!0  =