3
�Qg�� � ' @ s( d Z dZdZdZdZdZddlmZ ddl Z ddl
Z
ddl Z ddl Z ddl
Z
ddlZddlZddlZddlZddlZy ddlZW n ek
r� dZY nX y ddlZW n ek
r� dZY nX eefZyeef7 ZW n ek
r� Y nX d d
d d d
ddddddddddgZdZ dZ dZ dZ e d Z d Z!d Z"d Z#d Z$d Z%d!Z&dZ'd"Z(d#Z)d$Z*d%Z+d&Z,d'Z-d(Z.d)Z/d*Z0d+Z1d,Z2d-Z3d.Z4dZ5d/Z6d0Z7e6Z8e&e'e(e)e,e-e.e*e+e/e0e1f Z9e&e'e.e1fZ:e/e0e1fZ;d�Z<d1d2d7d8hZ=e>e>e>e?e?e?d9�Z@e
jAd:k�r�d;ZBne jC� ZBd<d=� ZDd>d?� ZEd@dA� ZFdBe8fdCdD�ZGdEdF� ZHdedfdGdH�ZIdIdJ� ZJdKdL� ZKG dMd � d eL�ZMG dNd� deM�ZNG dOd
� d
eM�ZOG dPd� deM�ZPG dQd� deM�ZQG dRd� deM�ZRG dSdT� dTeR�ZSG dUdV� dVeR�ZTG dWdX� dXeR�ZUG dYdZ� dZeR�ZVG d[d\� d\eR�ZWG d]d^� d^�ZXG d_d`� d`�ZYG dadb� dbeZ�Z[G dcdd� ddeZ�Z\G dedf� dfe j]�Z^G dgdh� dheM�Z_G didj� dje_�Z`G dkdl� dle_�ZaG dmdn� dne_�ZbG dodp� dpe_�ZcG dqdr� dre_�Zdd�dsdt�Zedudv� Zfdwdx� Zgdydz� Zhefegehd{�ZieZ� Zjejkd|�ZlG d}d
� d
eZ�ZmG d~d � d eZ�Zndd � ZoenjZd�d�� Zpeqd�k�r$ep� dS )�z,Read from and write to tar format archives.
z0.9.0u" Lars Gustäbel ([email protected])z5$Date: 2011-02-25 17:42:01 +0200 (Fri, 25 Feb 2011) $z?$Id: tarfile.py 88586 2011-02-25 15:42:01Z marc-andre.lemburg $u4 Gustavo Niemeyer, Niels Gustäbel, Richard Townsend.� )�openN�TarFile�TarInfo�
is_tarfile�TarError� ReadError�CompressionError� StreamError� ExtractError� HeaderError�ENCODING� USTAR_FORMAT�
GNU_FORMAT�
PAX_FORMAT�DEFAULT_FORMATr Tz/etc/python/tarfile.cfg� i � s ustar s ustar 00�d � � 0� 1� 2� 3� 4� 5� 6� 7� L� K� S� x� g� X� � �path�linkpath�size�mtime�uid�gid�uname�gname)ZatimeZctimer( r) r* r' �ntzutf-8c C s8 | dkrt d��| j||�} | d|� |t| � t S )z8Convert a string to a null-terminated bytes object.
Nz metadata cannot contain None)�
ValueError�encode�len�NUL)�s�length�encoding�errors� r6 � /usr/lib64/python3.6/tarfile.py�stn� s r8 c C s* | j d�}|dkr | d|� } | j||�S )z8Convert a null-terminated bytes object to a string.
r r# N���)�find�decode)r2 r4 r5 �pr6 r6 r7 �nts� s
r= c C s� | d d krfd}x0t t| �d �D ] }|dK }|| |d 7 }q"W | d dkr�dt| �d | }n@y"t| dd�} t| j� p�d d�}W n tk
r� td
��Y nX |S ) z/Convert a number field to a python number.
r � � r# � � �ascii�strict�0zinvalid header)r> r? )�ranger0 r= �int�stripr. �InvalidHeaderError)r2 �n�ir6 r6 r7 �nti� s rK r@ c C s� t | �} d| ko"d|d k n rDtd|d | f d�t }n�|tkr�d|d | kopd|d k n r�| dkr�tdg�}ntdg�}d| | } x6t|d �D ] }|jd| d@ � | dL } q�W ntd ��|S )
z/Convert a python number to a number field.
r r@ r# z%0*orB rA r> r? zoverflow in number field)rF �bytesr1 r � bytearrayrE �insertr. )rI �digits�formatr2 rJ r6 r6 r7 �itn� s 2
rQ c C s0 dt tjd| �� }dt tjd| �� }||fS )a� Calculate the checksum for a member's header by summing up all
characters except for the chksum field which is treated as if
it was filled with spaces. According to the GNU tar sources,
some tars (Sun and NeXT) calculate chksum with signed char,
which will be different if there are chars in the buffer with
the high bit set. So we calculate two checksums, unsigned and
signed.
rA Z
148B8x356BZ
148b8x356b)�sum�structZ unpack_from)�bufZunsigned_chksumZ
signed_chksumr6 r6 r7 � calc_chksums� s rU c C s� |pd}|dkrdS |dkr.t j| ||� dS t||�\}}x8t|�D ],}| j|�}t|�|k rh|d��|j|� qFW |dkr�| j|�}t|�|k r�|d��|j|� dS )zjCopy length bytes from fileobj src to fileobj dst.
If length is None, copy the entire content.
� i r Nzunexpected end of datai @ )�shutil� copyfileobj�divmodrE �readr0 �write) �src�dstr3 � exception�bufsize�blocks� remainder�brT r6 r6 r7 rX � s$
rX c C s ddl }|jdtd� tj| �S )z/Deprecated in this location; use stat.filemode.r Nz$deprecated in favor of stat.filemoder$ )�warnings�warn�DeprecationWarning�stat�filemode)�moderc r6 r6 r7 rg s rg c C s8 t tjdd �}|d k r(| j|d�j|�} t| dd� d S )Nr4 �backslashreplace� )�end)�getattr�sys�stdoutr/ r; �print)r2 r4 r6 r6 r7 � _safe_print s rp c @ s e Zd ZdZdS )r zBase exception.N)�__name__�
__module__� __qualname__�__doc__r6 r6 r6 r7 r s c @ s e Zd ZdZdS )r
z%General exception for extract errors.N)rq rr rs rt r6 r6 r6 r7 r
! s c @ s e Zd ZdZdS )r z&Exception for unreadable tar archives.N)rq rr rs rt r6 r6 r6 r7 r $ s c @ s e Zd ZdZdS )r z.Exception for unavailable compression methods.N)rq rr rs rt r6 r6 r6 r7 r ' s c @ s e Zd ZdZdS )r z=Exception for unsupported operations on stream-like TarFiles.N)rq rr rs rt r6 r6 r6 r7 r * s c @ s e Zd ZdZdS )r z!Base exception for header errors.N)rq rr rs rt r6 r6 r6 r7 r - s c @ s e Zd ZdZdS )�EmptyHeaderErrorz Exception for empty headers.N)rq rr rs rt r6 r6 r6 r7 ru 0 s ru c @ s e Zd ZdZdS )�TruncatedHeaderErrorz Exception for truncated headers.N)rq rr rs rt r6 r6 r6 r7 rv 3 s rv c @ s e Zd ZdZdS )�EOFHeaderErrorz"Exception for end of file headers.N)rq rr rs rt r6 r6 r6 r7 rw 6 s rw c @ s e Zd ZdZdS )rH z Exception for invalid headers.N)rq rr rs rt r6 r6 r6 r7 rH 9 s rH c @ s e Zd ZdZdS )�SubsequentHeaderErrorz3Exception for missing and invalid extended headers.N)rq rr rs rt r6 r6 r6 r7 rx < s rx c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
S ) �
_LowLevelFilez�Low-level file object. Supports reading and writing.
It is used instead of a regular file object for streaming
access.
c C sF t jt jt jB t jB d�| }tt d�r2|t jO }t j||d�| _d S )N)�r�w�O_BINARYi� ) �os�O_RDONLY�O_WRONLY�O_CREAT�O_TRUNC�hasattrr| r �fd)�self�namerh r6 r6 r7 �__init__I s
z_LowLevelFile.__init__c C s t j| j� d S )N)r} �closer� )r� r6 r6 r7 r� R s z_LowLevelFile.closec C s t j| j|�S )N)r} rZ r� )r� r' r6 r6 r7 rZ U s z_LowLevelFile.readc C s t j| j|� d S )N)r} r[ r� )r� r2 r6 r6 r7 r[ X s z_LowLevelFile.writeN)rq rr rs rt r� r� rZ r[ r6 r6 r6 r7 ry C s
ry c @ st e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z d dd�Z d dd�Z
dd� Zdd� ZdS ) �_Streama� Class that serves as an adapter between TarFile and
a stream-like object. The stream-like object only
needs to have a read() or write() method and is accessed
blockwise. Use of gzip or bzip2 compression is possible.
A stream-like object could be for example: sys.stdin,
sys.stdout, a socket, a tape device etc.
_Stream is intended to be used only internally.
c C s� d| _ |dkr t||�}d| _ |dkr6t|�}|j� }|p<d| _|| _|| _|| _|| _d| _ d| _
d| _ �yL|dkr�y ddl }W n t
k
r� td ��Y nX || _ |jd�| _|d
kr�| j� |j| _n| j� n�|d k�r:y ddl}W n t
k
�r
td ��Y nX |d
k�r.d| _|j� | _t| _n
|j� | _n||d
k�r�y ddl}W n t
k
�rn td��Y nX |d
k�r�d| _|j � | _|j | _n
|j � | _n|dk�r�td| ��W n& | j �s�| jj � d| _ � Y nX dS )z$Construct a _Stream object.
TNF�*� � r �gzz zlib module is not availablerz �bz2zbz2 module is not available�xzz lzma module is not available�tarzunknown compression type %r) � _extfileobjry � _StreamProxy� getcomptyper� rh �comptype�fileobjr_ rT �pos�closed�zlib� ImportErrorr �crc32�crc�
_init_read_gz�errorr^ �_init_write_gzr� �dbufZBZ2Decompressor�cmp�OSErrorZ
BZ2Compressor�lzmaZLZMADecompressor� LZMAErrorZLZMACompressorr� ) r� r� rh r� r� r_ r� r� r� r6 r6 r7 r� f sl
z_Stream.__init__c C s t | d�r| j r| j� d S )Nr� )r� r� r� )r� r6 r6 r7 �__del__� s z_Stream.__del__c C s� | j jd| j j| j j | j jd�| _tjdtt j � ��}| j
d| d � | j j d�rf| j dd � | _ | j
| j j
d d
�t � dS ) z6Initialize for writing with gzip compression.
� r z<Ls �s �z.gzN� z
iso-8859-1�replace���)r� Z compressobjZDEFLATED� MAX_WBITSZ
DEF_MEM_LEVELr� rS �packrF �time�_Stream__writer� �endswithr/ r1 )r� Z timestampr6 r6 r7 r� � s z_Stream._init_write_gzc C sR | j dkr | jj|| j�| _| jt|�7 _| j dkrD| jj|�}| j|� dS )z&Write string s to the stream.
r� r� N) r� r� r� r� r� r0 r� �compressr� )r� r2 r6 r6 r7 r[ � s
z
_Stream.writec C sR | j |7 _ x>t| j �| jkrL| jj| j d| j� � | j | jd� | _ qW dS )z]Write string s to the stream if a whole new block
is ready to be written.
N)rT r0 r_ r� r[ )r� r2 r6 r6 r7 Z__write� s z_Stream.__writec C s� | j r
dS d| _ z�| jdkr:| jdkr:| j| jj� 7 _| jdkr�| jr�| jj| j� d| _| jdkr�| jjtj d| j
�� | jjtj d| j d@ �� W d| j s�| jj
� X dS ) z[Close the _Stream object. No operation should be
done on it afterwards.
NTr{ r� r� r� z<Ll �� )r� rh r� rT r� �flushr� r[ rS r� r� r� r� r� )r� r6 r6 r7 r� � s
z
_Stream.closec C s� | j j| j j �| _d| _| jd�dkr0td��| jd�dkrFtd��t| jd��}| jd� |d @ r�t| jd��d
t| jd�� }| j |� |d @ r�x | jd�}| s�|t
kr�P q�W |d @ r�x | jd�}| s�|t
kr�P q�W |d@ r�| jd� d
S )z:Initialize for reading a gzip compressed fileobj.
r� r$ s �znot a gzip filer# � z unsupported compression method� � rA r@ rV N) r� Z
decompressobjr� r� r� �
_Stream__readr r �ordrZ r1 )r� �flagZxlenr2 r6 r6 r7 r� � s.
z_Stream._init_read_gzc C s | j S )z3Return the stream's file pointer position.
)r� )r� r6 r6 r7 �tell s z _Stream.tellr c C s\ || j dkrNt|| j | j�\}}x t|�D ]}| j| j� q.W | j|� ntd��| j S )zXSet the stream's file pointer to pos. Negative seeking
is forbidden.
r z seeking backwards is not allowed)r� rY r_ rE rZ r )r� r� r` ra rJ r6 r6 r7 �seek s z _Stream.seekNc C sZ |dkr:g }x | j | j�}|s P |j|� qW dj|�}n
| j |�}| jt|�7 _|S )z�Return the next size number of bytes from the stream.
If size is not defined, return all bytes of the stream
up to EOF.
Nr� )�_readr_ �append�joinr� r0 )r� r' �trT r6 r6 r7 rZ s
z _Stream.readc C s� | j dkr| j|�S t| j�}| jg}xd||k r�| j| j�}|sBP y| jj|�}W n | jk
rp td��Y nX |j |� |t|�7 }q(W dj
|�}||d� | _|d|� S )z+Return size bytes from the stream.
r� zinvalid compressed datar� N) r� r� r0 r� r_ r� Z
decompressr^ r r� r� )r� r' �cr� rT r6 r6 r7 r� * s"
z
_Stream._readc C sn t | j�}| jg}x6||k rH| jj| j�}|s0P |j|� |t |�7 }qW dj|�}||d� | _|d|� S )zsReturn size bytes from stream. If internal buffer is empty,
read another block from the stream.
r� N)r0 rT r� rZ r_ r� r� )r� r' r� r� rT r6 r6 r7 Z__read@ s
z_Stream.__read)r )N)rq rr rs rt r� r� r� r[ r� r� r� r� r� rZ r� r� r6 r6 r6 r7 r� [ s F
r� c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
S ) r� zsSmall proxy class that enables transparent compression
detection for the Stream interface (mode 'r|*').
c C s || _ | j jt�| _d S )N)r� rZ � BLOCKSIZErT )r� r� r6 r6 r7 r� V s z_StreamProxy.__init__c C s | j j| _| jS )N)r� rZ rT )r� r' r6 r6 r7 rZ Z s
z_StreamProxy.readc C sP | j jd�rdS | j dd� dkr8| j dd� dkr8d S | j jd�rHd S d
S d S )Ns �r� r r� s BZhr� �
s 1AY&SYr� � ] �� �7zXZr� r� )r� r� )rT �
startswith)r� r6 r6 r7 r� ^ s $ z_StreamProxy.getcomptypec C s | j j� d S )N)r� r� )r� r6 r6 r7 r� h s z_StreamProxy.closeN)rq rr rs rt r� rZ r� r� r6 r6 r6 r7 r� Q s
r� c @ sj e Zd ZdZddd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z e
j fdd�Z ddd�Z
dd� Zdd� ZdS )� _FileInFilezA thin wrapper around an existing file object that
provides a part of its data as an individual file
object.
Nc C s� || _ || _|| _d| _t|dd �| _d| _|d kr>d|fg}d| _g | _d}| j}xT|D ]L\}}||kr~| jj d||d f� | jj d||| |f� ||7 }|| }qZW || jk r�| jj d|| jd f� d S )Nr r� FT)
r� �offsetr' �positionrl r� r� � map_index�mapr� )r� r� r� r' Z blockinfoZlastposZrealposr6 r6 r7 r� u s(
z_FileInFile.__init__c C s d S )Nr6 )r� r6 r6 r7 r� � s z_FileInFile.flushc C s dS )NTr6 )r� r6 r6 r7 �readable� s z_FileInFile.readablec C s dS )NFr6 )r� r6 r6 r7 �writable� s z_FileInFile.writablec C s
| j j� S )N)r� �seekable)r� r6 r6 r7 r� � s z_FileInFile.seekablec C s | j S )z*Return the current file position.
)r� )r� r6 r6 r7 r� � s z_FileInFile.tellc C s� |t jkr tt|d�| j�| _nj|t jkr\|dk rFt| j| d�| _q�t| j| | j�| _n.|t jkr�tt| j| | j�d�| _ntd��| jS )z(Seek to a position in the file.
r zInvalid argument) �io�SEEK_SET�min�maxr' r� �SEEK_CUR�SEEK_ENDr. )r� r� �whencer6 r6 r7 r� � s
z_FileInFile.seekc C s |dkr| j | j }nt|| j | j �}d}x�|dk�r xZ| j| j \}}}}|| j kob|k n rlP q:| jd7 _| jt| j�kr:d| _q:W t||| j �}|r�| jj|| j| � | jj|�}t|�|kr�t d��||7 }n |t
| 7 }||8 }| j|7 _q.W |S )z!Read data from the file.
Nr� r r# zunexpected end of data) r' r� r� r� r� r0 r� r� rZ r r1 ) r� r' rT �data�start�stopr� r3 rb r6 r6 r7 rZ � s.
z_FileInFile.readc C s& | j t|��}||d t|��< t|�S )N)rZ r0 )r� rb rT r6 r6 r7 �readinto� s z_FileInFile.readintoc C s
d| _ d S )NT)r� )r� r6 r6 r7 r� � s z_FileInFile.close)N)N)rq rr rs rt r� r� r� r� r� r� r� r� r� rZ r� r� r6 r6 r6 r7 r� o s
r� c s e Zd Z� fdd�Z� ZS )� ExFileObjectc s& t |j|j|j|j�}t� j|� d S )N)r� r� � offset_datar' �sparse�superr� )r� �tarfile�tarinfor� )� __class__r6 r7 r� � s
zExFileObject.__init__)rq rr rs r� �
__classcell__r6 r6 )r� r7 r� � s r� c @ s e Zd ZdS )� FilterErrorN)rq rr rs r6 r6 r6 r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�AbsolutePathErrorc s || _ t� jd|j�d�� d S )Nzmember z has an absolute path)r� r� r� r� )r� r� )r� r6 r7 r� � s zAbsolutePathError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�OutsideDestinationErrorc s. || _ || _t� j|j�d|�d�d � d S )Nz would be extracted to z, z which is outside the destination)r� �_pathr� r� r� )r� r� r% )r� r6 r7 r� � s z OutsideDestinationError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�SpecialFileErrorc s || _ t� j|j�d�� d S )Nz is a special file)r� r� r� r� )r� r� )r� r6 r7 r� � s zSpecialFileError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�AbsoluteLinkErrorc s || _ t� j|j�d�� d S )Nz! is a symlink to an absolute path)r� r� r� r� )r� r� )r� r6 r7 r� � s zAbsoluteLinkError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�LinkOutsideDestinationErrorc s. || _ || _t� j|j�d|�d�d � d S )Nz would link to z, z which is outside the destination)r� r� r� r� r� )r� r� r% )r� r6 r7 r� � s z$LinkOutsideDestinationError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c C s� i }| j }tjj|�}|jdtjf�r@| jjdtj � }|d< tjj|�rTt| ��tjjtjj ||��}tjj
||g�|kr�t | |��| j }|d k �r |d@ }|r�| j
� s�| j� r�|d@ s�|d M }|dO }n | j� s�| j� r�d }nt| ��|| j k�r ||d< |�r�| jd k �rd |d< | jd k �r.d |d < | jd k �rBd |d
< | jd k �rVd |d < | j� �sj| j� �r�tjj| j��r�t| ��| j� �r�tjj |tjj|�| j�}ntjj || j�}tjj|�}tjj
||g�|k�r�t| |��|S )
N�/r� i� �@ �I i� rh r) r* r+ r, i����)r� r} r% �realpathr� �sep�lstrip�isabsr� r� �
commonpathr� rh �isreg�islnk�isdir�issymr� r) r* r+ r, �linknamer� �dirnamer� )�member� dest_pathZfor_data� new_attrsr� Z target_pathrh r6 r6 r7 �_get_filtered_attrs sZ
r� c C s | S )Nr6 )r� r� r6 r6 r7 �fully_trusted_filterC s r� c C s( t | |d�}|r$| jf |ddi��S | S )NF�deep)r� r� )r� r� r� r6 r6 r7 �
tar_filterF s r� c C s( t | |d�}|r$| jf |ddi��S | S )NTr� F)r� r� )r� r� r� r6 r6 r7 � data_filterL s r� )Z
fully_trustedr� r� s ([0-9]{1,20}) c @ s� e Zd ZdZdmZdndd�Zdd� Zdd � Zeee�Z d d � Z
d d � Z ee
e �Z d!d"� Z
eeeeeeeed#ed$�
d%d&�Zd'd(� Zeed)fd*d+�Zd,d-� Zd.d/� Zd0d1� Zed2d3� �Zd4d5� Zed6d7� �Zed8d9� �Z ed:d;� �Z ed<d=� �Z ed>d?� �Z ed@dA� �Z dBdC� Z!dDdE� Z"dFdG� Z#dHdI� Z$dJdK� Z%dLdM� Z&dNdO� Z'dPdQ� Z(dRdS� Z)dTdU� Z*dVdW� Z+dXdY� Z,dZd[� Z-d\d]� Z.d^d_� Z/d`da� Z0dbdc� Z1ddde� Z2dfdg� Z3dhdi� Z4djdk� Z5dlS )or a Informational class which holds the details about an
archive member given by a tar header block.
TarInfo objects are returned by TarFile.getmember(),
TarFile.getmembers() and TarFile.gettarinfo() and are
usually created internally.
r� rh r) r* r' r( �chksum�typer� r+ r, �devmajor�devminorr� r� � pax_headersr� r� �_sparse_structs� _link_targetr� c C sj || _ d| _d| _d| _d| _d| _d| _t| _d| _ d| _
d| _ d| _ d| _
d| _d| _d| _i | _dS )zXConstruct a TarInfo object. name is the optional name
of the member.
i� r r� N)r� rh r) r* r' r( r� �REGTYPEr� r� r+ r, r� r� r� r� r� r� )r� r� r6 r6 r7 r� p s" zTarInfo.__init__c C s | j S )N)r� )r� r6 r6 r7 �_getpath� s zTarInfo._getpathc C s
|| _ d S )N)r� )r� r� r6 r6 r7 �_setpath� s zTarInfo._setpathc C s | j S )N)r� )r� r6 r6 r7 � _getlinkpath� s zTarInfo._getlinkpathc C s
|| _ d S )N)r� )r� r� r6 r6 r7 � _setlinkpath� s zTarInfo._setlinkpathc C s d| j j| jt| �f S )Nz<%s %r at %#x>)r� rq r� �id)r� r6 r6 r7 �__repr__� s zTarInfo.__repr__T)
r� r( rh r� r) r* r+ r, r� �_KEEPc
C s� | rt j| �} n
t j | �} ||
k r(|| _||
k r6|| _||
k rD|| _||
k rR|| _||
k r`|| _||
k rn|| _||
k r||| _||
k r�|| _ | S )zGReturn a deep copy of self with the given attributes replaced.
)
�copy�deepcopyr� r( rh r� r) r* r+ r, ) r� r� r( rh r� r) r* r+ r, r� r �resultr6 r6 r7 r� � s(
zTarInfo.replacec C s� | j dkrd}n
| j d@ }| j|| j| j| j| j| j| j| j| j | j
| j | j d�
}|d t
kr~|d jd� r~|d d7 < |S )z9Return the TarInfo's attributes as a dictionary.
Ni� )
r� rh r) r* r' r( r� r� r� r+ r, r� r� r� r� r� )rh r� r) r* r' r( r� r� r� r+ r, r� r� �DIRTYPEr� )r� rh �infor6 r6 r7 �get_info� s&
zTarInfo.get_info�surrogateescapec C s~ | j � }x(|j� D ] \}}|dkrtd| ��qW |tkrH| j|||�S |tkr^| j|||�S |tkrr| j||�S td��dS )z<Return a tar header as a string of 512 byte blocks.
Nz%s may not be Nonezinvalid format) r
�itemsr. r
�create_ustar_headerr �create_gnu_headerr �create_pax_header)r� rP r4 r5 r r� �valuer6 r6 r7 �tobuf� s z
TarInfo.tobufc C sn t |d< t|d j||��tkr(td��t|d j||��tkr^| j|d ||�\|d< |d< | j|t||�S )z3Return the object as a ustar header block.
�magicr� zlinkname is too longr� �prefix) � POSIX_MAGICr0 r/ � LENGTH_LINKr. � LENGTH_NAME�_posix_split_name�_create_headerr
)r� r r4 r5 r6 r6 r7 r � s zTarInfo.create_ustar_headerc C s� t |d< d}t|d j||��tkr<|| j|d t||�7 }t|d j||��tkrl|| j|d t||�7 }|| j|t ||� S )z:Return the object as a GNU header block sequence.
r r� r� r� )
� GNU_MAGICr0 r/ r �_create_gnu_long_header�GNUTYPE_LONGLINKr �GNUTYPE_LONGNAMEr r )r� r r4 r5 rT r6 r6 r7 r � s zTarInfo.create_gnu_headerc
C s4 t |d< | jj� }x�ddtfddtfddfD ]h\}}}||kr@q,y|| jd d
� W n" tk
rv || ||< w,Y nX t|| �|kr,|| ||< q,W xldD ]d\}}||kr�d||< q�|| }d| ko�d |d k n � s�t|t �r�t
|�||< d||< q�W |�r | j |t |�} nd} | | j
|td d� S ) z�Return the object as a ustar header block. If it cannot be
represented this way, prepend a pax extended header sequence
with supplement information.
r r� r% r� r& r+ � r, rB rC r) r@ r* r' � r( r r# r� r� )r+ r+ r )r, r, r �r) r@ �r* r@ �r' r! �r( r! )r" r# r$ r% )r r� r r r r/ �UnicodeEncodeErrorr0 �
isinstance�float�str�_create_pax_generic_header�XHDTYPEr r
)
r� r r4 r� r� Zhnamer3 rO �valrT r6 r6 r7 r � s4
. zTarInfo.create_pax_headerc C s | j |td�S )zAReturn the object as a pax global header block sequence.
zutf-8)r* �XGLTYPE)�clsr� r6 r6 r7 �create_pax_global_header. s z TarInfo.create_pax_global_headerc C s� |j d�}xltdt|��D ]R}dj|d|� �}dj||d� �}t|j||��tkrt|j||��tkrP qW td��||fS )zUSplit a name longer than 100 chars into a prefix
and a name part.
r� r# Nzname is too long)�splitrE r0 r� r/ �
LENGTH_PREFIXr r. )r� r� r4 r5 Z
componentsrJ r r6 r6 r7 r 4 s
zTarInfo._posix_split_namec C s� | j d�ttfk}|r@t| j dd�d|�}t| j dd�d|�}n tdd||�}tdd||�}| j dt�}|dkrxtd��t| j d d�d
||�t| j d d�d @ d|�t| j d
d�d|�t| j dd�d|�t| j dd�d|�t| j dd�d|�d|t| j dd�d
||�| j dt�t| j dd�d||�t| j dd�d||�t| j dd�d|�t| j dd�d|�t| j dd�d||�g}tj dt
dj |��} t | t
d� �d }
| dd � t
d |
d � | d!d� } | S )"z�Return a header block. info is a dictionary with file
information, format must be one of the *_FORMAT constants.
r� r� r r@ r� r� Nz TarInfo.type must not be Noner� r rh i� r) r* r' r! r( s r� r r+ r r, r r z%dsr� il z%06o rB ie i����i����)�get�CHRTYPE�BLKTYPErQ r8 r r. r rS r� r� r� rU rL ) r rP r4 r5 Zhas_device_fieldsr� r� Zfiletype�partsrT r� r6 r6 r7 r D s8
&zTarInfo._create_headerc C s. t t| �t�\}}|dkr*| t| t 7 } | S )zdReturn the string payload filled with zero bytes
up to the next 512 byte border.
r )rY r0 r� r1 )Zpayloadr` ra r6 r6 r7 �_create_payloadn s zTarInfo._create_payloadc C sR |j ||�t }i }d|d< ||d< t|�|d< t|d< | j|t||�| j|� S )zTReturn a GNUTYPE_LONGNAME or GNUTYPE_LONGLINK sequence
for name.
z
././@LongLinkr� r� r' r )r/ r1 r0 r r r
r6 )r. r� r� r4 r5 r r6 r6 r7 r x s z TarInfo._create_gnu_long_headerc C s: d}x@|j � D ]4\}}y|jdd� W q tk
r@ d}P Y qX qW d}|rV|d7 }x�|j � D ]�\}}|jd�}|r�|j|d�}n
|jd�}t|�t|� d }d } }
x"|tt|
�� } | |
kr�P | }
q�W |tt|
�d
�d | d | d
7 }q`W i } d| d< || d< t|�| d< t| d< | j| td
d�| j |� S )z�Return a POSIX.1-2008 extended or global header sequence
that contains a list of keyword, value pairs. The values
must be strings.
Fzutf-8rC Tr� s 21 hdrcharset=BINARY
r r� r rB � � =�
z././@PaxHeaderr� r� r' r r� )
r r/ r& r0 r) rL r r r
r6 ) r. r� r� r4 Zbinary�keywordr Zrecords�lrI r< r r6 r6 r7 r* � s<
* z"TarInfo._create_pax_generic_headerc C st t |�dkrtd��t |�tkr(td��|jt�tkr>td��t|dd� �}|t|�krbt d��| � }t
|dd� ||�|_ t|dd � �|_ t|d d
� �|_
t|d
d � �|_t|d d � �|_t|d d� �|_||_|dd
� |_t
|d
d� ||�|_t
|dd� ||�|_t
|dd� ||�|_t|dd� �|_t|dd� �|_t
|dd� ||�}|jtk�r�|j jd��r�t|_|jtk�r6d}g }xrt d�D ]f} y0t|||d � �}
t||d |d � �} W n t k
�r� P Y nX |j |
| f� |d7 }�q�W t |d �} t|dd � �}
|| |
f|_ |j!� �rN|j j"d�|_ |�rp|jt#k�rp|d |j |_ |S ) zAConstruct a TarInfo object from a 512 byte bytes object.
r z empty headerztruncated headerzend of file header� � z bad checksumr �l �t �| � � i i i) iI iQ iY i� r� i� r� r! � i� i� i� )$r0 ru r� rv �countr1 rw rK rU rH r= r� rh r) r* r' r( r� r� r� r+ r, r� r� �AREGTYPEr� r �GNUTYPE_SPARSErE r. r� �boolr� r� �rstrip� GNU_TYPES)r. rT r4 r5 r� �objr r� �structsrJ r� �numbytes�
isextended�origsizer6 r6 r7 �frombuf� sZ
zTarInfo.frombufc C s8 |j jt�}| j||j|j�}|j j� t |_|j|�S )zOReturn the next TarInfo object from TarFile object
tarfile.
) r� rZ r� rO r4 r5 r� r� � _proc_member)r. r� rT rJ r6 r6 r7 � fromtarfile� s zTarInfo.fromtarfilec C sT | j ttfkr| j|�S | j tkr,| j|�S | j tttfkrF| j |�S | j
|�S dS )zYChoose the right processing method depending on
the type and call it.
N) r� r r �
_proc_gnulongrF � _proc_sparser+ r- �SOLARIS_XHDTYPE� _proc_pax�
_proc_builtin)r� r� r6 r6 r7 rP s
zTarInfo._proc_memberc C sR |j j� | _| j}| j� s$| jtkr4|| j| j�7 }||_| j |j
|j |j � | S )zfProcess a builtin type or an unknown type which
will be treated as a regular file.
)
r� r� r� r� r� �SUPPORTED_TYPES�_blockr' r� �_apply_pax_infor� r4 r5 )r� r� r� r6 r6 r7 rV s zTarInfo._proc_builtinc C s� |j j| j| j��}y| j|�}W n tk
r> td��Y nX | j|_| jt krft
||j |j �|_
n | jtkr�t
||j |j �|_|S )zSProcess the blocks that hold a GNU longname
or longlink member.
z missing or bad subsequent header)r� rZ rX r' rQ r rx r� r� r r= r4 r5 r� r r� )r� r� rT �nextr6 r6 r7 rR . s
zTarInfo._proc_gnulongc
C s� | j \}}}| ` x�|r�|jjt�}d}xvtd�D ]j}y0t|||d � �}t||d |d � �} W n tk
rz P Y nX |r�| r�|j|| f� |d7 }q0W t|d �}qW || _ |jj
� | _ | j | j | j
� |_|| _
| S )z8Process a GNU sparse header plus extra headers.
r � r! rC i� )r� r� rZ r� rE rK r. r� rG r� r� r� rX r' r� )
r� r� rK rM rN rT r� rJ r� rL r6 r6 r7 rS D s( zTarInfo._proc_sparsec C s� |j j| j| j��}| jtkr&|j}n
|jj� }d}d}g }�x0t|�|koV|| dk�rnt j
||�}|srt d��yt |j
d��}W n tk
r� t d��Y nX |dk r�t d��|| t|�kr�t d��|jd�| d } ||jd�d | � }
|
jd�\} } }
| �s"| dk�s"|| dk�r*t d��|j|| |
f� | dk�rd|dk�rd|
d k�r`|j}nd
}||7 }q@W |dk�r~d
}x`|D ]X\}} }
| j| d
d
|j�}|tk�r�| j|
||j|j�}n| j|
d
d
|j�}|||< �q�W y| j|�}W n tk
�r td ��Y nX d |k�r&| j||� nFd
|k�r>| j||� n.|j d�dk�rl|j d�dk�rl| j |||� | jt t fk�r�|j ||j|j� | j!|_!d|k�r�|j"}|j#� �s�|jt$k�r�||j|j�7 }||_!|S )zVProcess an extended or global header as described in
POSIX.1-2008.
r Nzinvalid headerr# � r8 r� s
hdrcharsets BINARYzutf-8z missing or bad subsequent headerzGNU.sparse.mapzGNU.sparse.sizezGNU.sparse.major�1zGNU.sparse.minorrD r' )%r� rZ rX r' r� r- r� r r0 �_header_length_prefix_re�matchrH rF �groupr. r� rk � partitionr� r4 �_decode_pax_fieldr5 �PAX_NAME_FIELDSrQ r rx �_proc_gnusparse_01�_proc_gnusparse_00r2 �_proc_gnusparse_10r+ rT rY r� r� r� rW )r� r� rT r� r� r4 � raw_headersr_ r3 Zheader_value_end_offsetZkeyword_and_valueZ raw_keywordZequalsZ raw_valuer: r rZ r� r6 r6 r7 rU ` sx
zTarInfo._proc_paxc C s� g }g }x�|D ]�\}}}|dkrVy|j t|j� �� W q� tk
rR td��Y q�X q|dkry|j t|j� �� W q tk
r� td��Y qX qW tt||��|_dS )z?Process a GNU tar extended sparse header, version 0.0.
s GNU.sparse.offsetzinvalid headers GNU.sparse.numbytesN)r� rF r; r. rH �list�zipr� )r� rZ rg ZoffsetsrL �_r: r r6 r6 r7 re � s zTarInfo._proc_gnusparse_00c C s@ dd� |d j d�D �}tt|ddd� |ddd� ��|_dS )z?Process a GNU tar extended sparse header, version 0.1.
c S s g | ] }t |��qS r6 )rF )�.0�xr6 r6 r7 �
<listcomp>� s z.TarInfo._proc_gnusparse_01.<locals>.<listcomp>zGNU.sparse.map�,Nr$ r# )r0 rh ri r� )r� rZ r� r� r6 r6 r7 rd � s zTarInfo._proc_gnusparse_01c C s� d}g }|j jt�}|jdd�\}}t|�}xJt|�|d k rvd|krV||j jt�7 }|jdd�\}}|jt|�� q.W |j j� |_t t
|ddd� |ddd� ��|_ dS )z?Process a GNU tar extended sparse header, version 1.0.
Nr9 r# r$ ) r� rZ r� r0 rF r0 r� r� r� rh ri r� )r� rZ r� r� Zfieldsr� rT Znumberr6 r6 r7 rf � s zTarInfo._proc_gnusparse_10c
C s� x�|j � D ]�\}}|dkr(t| d|� q
|dkrBt| dt|�� q
|dkr\t| dt|�� q
|tkr
|tkr�yt| |�}W n tk
r� d}Y nX |dkr�|jd�}t| ||� q
W |j� | _dS ) zoReplace fields with supplemental information from a previous
pax extended or global header.
zGNU.sparse.namer% zGNU.sparse.sizer' zGNU.sparse.realsizer r� N) r �setattrrF �
PAX_FIELDS�PAX_NUMBER_FIELDSr. rH r r� )r� r� r4 r5 r: r r6 r6 r7 rY s"
zTarInfo._apply_pax_infoc C s. y |j |d�S tk
r( |j ||�S X dS )z1Decode a single field from a pax record.
rC N)r; �UnicodeDecodeError)r� r r4 Zfallback_encodingZfallback_errorsr6 r6 r7 rb s zTarInfo._decode_pax_fieldc C s" t |t�\}}|r|d7 }|t S )z_Round up a byte count by BLOCKSIZE and return it,
e.g. _block(834) => 1024.
r# )rY r� )r� rD r` ra r6 r6 r7 rX # s zTarInfo._blockc C s
| j tkS )N)r� �
REGULAR_TYPES)r� r6 r6 r7 r� , s z
TarInfo.isregc C s | j � S )N)r� )r� r6 r6 r7 �isfile. s zTarInfo.isfilec C s
| j tkS )N)r� r )r� r6 r6 r7 r� 0 s z
TarInfo.isdirc C s
| j tkS )N)r� �SYMTYPE)r� r6 r6 r7 r� 2 s z
TarInfo.issymc C s
| j tkS )N)r� �LNKTYPE)r� r6 r6 r7 r� 4 s z
TarInfo.islnkc C s
| j tkS )N)r� r3 )r� r6 r6 r7 �ischr6 s z
TarInfo.ischrc C s
| j tkS )N)r� r4 )r� r6 r6 r7 �isblk8 s z
TarInfo.isblkc C s
| j tkS )N)r� �FIFOTYPE)r� r6 r6 r7 �isfifo: s zTarInfo.isfifoc C s
| j d k S )N)r� )r� r6 r6 r7 �issparse< s zTarInfo.issparsec C s | j tttfkS )N)r� r3 r4 ry )r� r6 r6 r7 �isdev> s z
TarInfo.isdevN)r� rh r) r* r' r( r� r� r� r+ r, r� r� r� r� r� r� r� r� r� )r� )6rq rr rs rt � __slots__r� r r �propertyr% r r r& r r r� r
r r r r r r � classmethodr/ r � staticmethodr r6 r r* rO rQ rP rV rR rS rU re rd rf rY rb rX r� rt r� r� r� rw rx rz r{ r| r6 r6 r6 r7 r b sf
1 *
3 ?
z c
@ s� e Zd ZdZdZdZdZdZeZ e
Z dZ e
ZeZdZdfdd �Zedddefd
d ��Zedgd d
��Zedhdd��Zedidd��Zedjdd��Zddddd�Zdd� Zd d � Z d d � Z d d!� Z dkd"d#�Z dldd%�d&d'�Z dmdd(�d)d*�Z!dnd+d,�Z"d-d.� Z#doddd0�d1d2�Z$dpddd0�d4d5�Z%d6d7� Z&d8d9� Z'd:d;� Z(d<d=� Z)d>d?� Z*dqd@dA�Z+dBdC� Z,dDdE� Z-dFdG� Z.dHdI� Z/dJdK� Z0dLdM� Z1dNdO� Z2dPdQ� Z3dRdS� Z4dTdU� Z5drdVdW�Z6dXdY� Z7dsdZd[�Z8d\d]� Z9d^d_� Z:d`da� Z;dbdc� Z<ddde� Z=dS )tr z=The TarFile Class provides an interface to tar archives.
r Fr# Nrz r c C s� ddddd�}||kr t d��|| _|| | _|sj| jdkrVtjj|� rVd| _d| _t|| j�}d | _n@|d
kr�t|d �r�t |j
t t f�r�|j
}t|d �r�|j| _d
| _|r�tjj
|�nd
| _
|| _|d
k r�|| _|d
k r�|| _|d
k r�|| _|d
k �r || _|d
k �r|| _| | _|
d
k �r4| jtk�r4|
| _ni | _| d
k �rJ| | _| d
k �rZ| | _|
| _d | _g | _d | _ | jj � | _ i | _ � y�| jdk�r�d
| _ | j!� | _ | jdk�r8x�| jj"| j � y | jj#| �}| jj$|� W nT t%k
�r | jj"| j � P Y n0 t&k
�r0 } zt't |���W Y d
d
}~X nX �q�W | jdk�r�d
| _ | j�r�| jj(| jj)� �}| jj*|� | j t+|�7 _ W n& | j�s�| jj,� d
| _� Y nX d
S )a� Open an (uncompressed) tar archive `name'. `mode' is either 'r' to
read from an existing archive, 'a' to append data to an existing
file or 'w' to create a new file overwriting an existing one. `mode'
defaults to 'r'.
If `fileobj' is given, it is used for reading or writing data. If it
can be determined, `mode' is overridden by `fileobj's mode.
`fileobj' is not closed, when TarFile is closed.
�rbzr+b�wbZxb)rz �ar{ rl z!mode must be 'r', 'a', 'w' or 'x'r� r{ FNr� rh Trz rl )r� r{ rl )-r. rh �_moder} r% �exists� bltn_openr� r� r' r� r) rL �abspathr� rP r� � dereference� ignore_zerosr4 r5 r r� �debug�
errorlevel� copybufsizer� �members�_loadedr� r� �inodes� firstmemberrZ r� rQ r� rw r r r/ r r[ r0 r� )r� r� rh r� rP r� r� r� r4 r5 r� r� r� r� Zmodes�erT r6 r6 r7 r� ^ s�
$
zTarFile.__init__c
s� | r| rt d��|dkr�� fdd�}xtt� j|d�D ]b}t� � j| �}|dk r\|j� } y||d|f|�S ttfk
r� |dk r�|j| � w8Y q8X q8W td���nd |k�r |jd d
�\}
}|
p�d}
|p�d }|� jkr�t� � j| �}n td | ��|||
|f|�S d
|k�r�|jd
d
�\}
}|
�p.d}
|�p8d }|
dk�rLt d��t ||
|||�} y� ||
| f|�} W n | j
� � Y nX d| _ | S |dk�r�� j |||f|�S t d��dS )a� Open a tar archive for reading, writing or appending. Return
an appropriate TarFile class.
mode:
'r' or 'r:*' open for reading with transparent compression
'r:' open for reading exclusively uncompressed
'r:gz' open for reading with gzip compression
'r:bz2' open for reading with bzip2 compression
'r:xz' open for reading with lzma compression
'a' or 'a:' open for appending, creating the file if necessary
'w' or 'w:' open for writing without compression
'w:gz' open for writing with gzip compression
'w:bz2' open for writing with bzip2 compression
'w:xz' open for writing with lzma compression
'x' or 'x:' create a tarfile exclusively without compression, raise
an exception if the file is already created
'x:gz' create a gzip compressed tarfile, raise an exception
if the file is already created
'x:bz2' create a bzip2 compressed tarfile, raise an exception
if the file is already created
'x:xz' create an lzma compressed tarfile, raise an exception
if the file is already created
'r|*' open a stream of tar blocks with transparent compression
'r|' open an uncompressed stream of tar blocks for reading
'r|gz' open a gzip compressed stream of tar blocks
'r|bz2' open a bzip2 compressed stream of tar blocks
'r|xz' open an lzma compressed stream of tar blocks
'w|' open an uncompressed stream for writing
'w|gz' open a gzip compressed stream for writing
'w|bz2' open a bzip2 compressed stream for writing
'w|xz' open an lzma compressed stream for writing
znothing to openrz �r:*c s � j | dkS )N�taropen)� OPEN_METH)r� )r. r6 r7 �not_compressed� s z$TarFile.open.<locals>.not_compressed)�keyNz%file could not be opened successfully�:r# r� zunknown compression type %r�|r{ zmode must be 'r' or 'w'Fr� rl zundiscernible mode)rz r� )rz r{ )r� r{ rl )
r. �sortedr� rl r� r r r� r0 r� r� r� r� )
r. r� rh r� r_ �kwargsr� r� �funcZ saved_posrg �streamr� r6 )r. r7 r � sP %
z TarFile.openc K s |dkrt d��| |||f|�S )zCOpen uncompressed tar archive name for reading or writing.
rz r� r{ rl z!mode must be 'r', 'a', 'w' or 'x')rz r� r{ rl )r. )r. r� rh r� r� r6 r6 r7 r� ( s zTarFile.taropenr� c K s� |d krt d��yddl}|j W n ttfk
rB td��Y nX y|j||d ||�}W n. tk
r� |dk r�|dkr�td ��� Y nX y| j|||f|�}W nB tk
r� |j � |dkr�td ��� Y n |j � � Y nX d
|_
|S ) zkOpen gzip compressed tar archive name for reading or writing.
Appending is not allowed.
rz r{ rl z mode must be 'r', 'w' or 'x'r Nz gzip module is not availablerb znot a gzip fileF)rz r{ rl ) r. �gzipZGzipFiler� �AttributeErrorr r� r r� r� r� )r. r� rh r� �
compresslevelr� r� r� r6 r6 r7 �gzopen0 s2
zTarFile.gzopenc K s� |d krt d��y ddl}W n tk
r8 td��Y nX |j|pD|||d�}y| j|||f|�}W nF ttfk
r� |j� |dkr�t d ��� Y n |j� � Y nX d
|_
|S ) zlOpen bzip2 compressed tar archive name for reading or writing.
Appending is not allowed.
rz r{ rl z mode must be 'r', 'w' or 'x'r Nzbz2 module is not available)r� znot a bzip2 fileF)rz r{ rl ) r. r� r� r ZBZ2Filer� r� �EOFErrorr� r r� )r. r� rh r� r� r� r� r� r6 r6 r7 �bz2openR s( zTarFile.bz2openc K s� |d krt d��y ddl}W n tk
r8 td��Y nX |j|pD|||d�}y| j|||f|�}W nH |jtfk
r� |j� |dkr�t d ��� Y n |j� � Y nX d
|_
|S ) zkOpen lzma compressed tar archive name for reading or writing.
Appending is not allowed.
rz r{ rl z mode must be 'r', 'w' or 'x'r Nz lzma module is not available)�presetznot an lzma fileF)rz r{ rl ) r. r� r� r ZLZMAFiler� r� r� r� r r� )r. r� rh r� r� r� r� r� r6 r6 r7 �xzopeno s& zTarFile.xzopenr� r� r� r� )r� r� r� r� c
C s� | j r
dS d| _ z`| jdkrn| jjttd � | jtd 7 _t| jt�\}}|dkrn| jjtt| � W d| j s�| jj
� X dS ) zlClose the TarFile. In write-mode, two finishing zero blocks are
appended to the archive.
NTr� r{ rl r$ r )r� r{ rl ) r� rh r� r[ r1 r� r� rY �
RECORDSIZEr� r� )r� r` ra r6 r6 r7 r� � s
z
TarFile.closec C s" | j |�}|dkr td| ��|S )a Return a TarInfo object for member `name'. If `name' can not be
found in the archive, KeyError is raised. If a member occurs more
than once in the archive, its last occurrence is assumed to be the
most up-to-date version.
Nzfilename %r not found)�
_getmember�KeyError)r� r� r� r6 r6 r7 � getmember� s
zTarFile.getmemberc C s | j � | js| j� | jS )z�Return the members of the archive as a list of TarInfo objects. The
list has the same order as the members in the archive.
)�_checkr� �_loadr� )r� r6 r6 r7 �
getmembers� s zTarFile.getmembersc C s dd� | j � D �S )z�Return the members of the archive as a list of their names. It has
the same order as the list returned by getmembers().
c S s g | ]
}|j �qS r6 )r� )rk r� r6 r6 r7 rm � s z$TarFile.getnames.<locals>.<listcomp>)r� )r� r6 r6 r7 �getnames� s zTarFile.getnamesc C sp | j d� |dk r|j}|dkr$|}tjj|�\}}|jtjd�}|jd�}| j� }| |_ |dkr�t
td�r�| j r�tj |�}q�tj
|�}ntj|j� �}d}|j}t
j|��r|j|jf} | j r�|jdkr�| | jkr�|| j| kr�t}
| j| }nt}
| d �rx|| j| < nht
j|��r"t}
nVt
j|��r4t}
nDt
j |��rPt }
tj |�}n(t
j |��rbt }
nt
j!|��rtt"}
ndS ||_||_#|j$|_%|j&|_'|
tk�r�|j(|_)nd|_)|j*|_+|
|_,||_-t.�r�yt.j/|j%�d |_0W n t1k
�r� Y nX t2�r*yt2j3|j'�d |_4W n t1k
�r( Y nX |
t t"fk�rlt
td��rlt
td ��rltj5|j6�|_7tj8|j6�|_9|S )
a� Create a TarInfo object from the result of os.stat or equivalent
on an existing file. The file is either named by `name', or
specified as a file object `fileobj' with a file descriptor. If
given, `arcname' specifies an alternative name for the file in the
archive, otherwise, the name is taken from the 'name' attribute of
'fileobj', or the 'name' argument. The name should be a text
string.
�awxNr� �lstatr� r# r �major�minor):r� r� r} r% �
splitdriver� r� r� r� r� r� r� r� rf �fstat�fileno�st_mode�S_ISREG�st_ino�st_dev�st_nlinkr� rv r �S_ISDIRr �S_ISFIFOry �S_ISLNKru �readlink�S_ISCHRr3 �S_ISBLKr4 rh �st_uidr) �st_gidr* �st_sizer' �st_mtimer( r� r� �pwd�getpwuidr+ r� �grpZgetgrgidr, r� �st_rdevr� r� r� ) r� r� �arcnamer� Zdrvr� Zstatresr� Zstmd�inoder� r6 r6 r7 �
gettarinfo� s~
zTarFile.gettarinfoT)r� c C s0 | j � |dkr| }�x|D �]
}|r�|jdkr:td� nttj|j�� td|jpX|j|jpb|jf � |j � sz|j
� r�tdd|j |j f � ntd|j
� |jdkr�td� n tdtj|j�dd � � t|j|j� r�d
nd � |�r"|j� �r
td |j � |j� �r"td
|j � t� q W dS )a Print a table of contents to sys.stdout. If `verbose' is False, only
the names of the members are printed. If it is True, an `ls -l'-like
output is produced. `members' is optional and must be a subset of the
list returned by getmembers().
Nz
??????????z%s/%sz%10sz%d,%dz%10dz????-??-?? ??:??:??z%d-%02d-%02d %02d:%02d:%02dr� r� r� z-> zlink to )r� rh rp rf rg r+ r) r, r* rw rx r� r� r' r( r� Z localtimer� r� r� r� r� ro )r� �verboser� r� r6 r6 r7 rh * s2
z TarFile.list)�filterc
C sv | j d� |dkr|}|dk rPddl}|jdtd� ||�rP| jdd| � dS | jdk r�tjj|�| jkr�| jdd| � dS | jd|� | j ||�}|dkr�| jdd | � dS |dk r�||�}|dkr�| jdd| � dS |j
� �rt |d
��}| j ||� W dQ R X nd|j
� �rh| j |� |�rrxHtj|�D ].}| jtjj||�tjj||�|||d � �q4W n
| j |� dS ) a~ Add the file `name' to the archive. `name' may be any type of file
(directory, fifo, symbolic link, etc.). If given, `arcname'
specifies an alternative name for the file in the archive.
Directories are added recursively by default. This can be avoided by
setting `recursive' to False. `exclude' is a function that should
return True for each filename to be excluded. `filter' is a function
that expects a TarInfo object argument and returns the changed
TarInfo object, if it returns None the TarInfo object will be
excluded from the archive.
r� Nr z use the filter argument insteadr$ ztarfile: Excluded %rztarfile: Skipped %rr# z tarfile: Unsupported type %rr� )r� )r� rc rd re �_dbgr� r} r% r� r� r� r� �addfiler� �listdir�addr� ) r� r� r� � recursiveZexcluder� rc r� �fr6 r6 r7 r� P sB
z TarFile.addc C s� | j d� tj|�}|j| j| j| j�}| jj|� | jt |�7 _| j
}|dk r�t || j|j |d� t
|j t�\}}|dkr�| jjtt| � |d7 }| j|t 7 _| jj|� dS )a Add the TarInfo object `tarinfo' to the archive. If `fileobj' is
given, it should be a binary file, and tarinfo.size bytes are read
from it and added to the archive. You can create TarInfo objects
directly, or by using gettarinfo().
r� N)r_ r r# )r� r r rP r4 r5 r� r[ r� r0 r� rX r' rY r� r1 r� r� )r� r� r� rT r_ r` ra r6 r6 r7 r� � s
zTarFile.addfilec " C sH |d k�r| j }|d k� r�tjjd�}|d kr�y tt�}W n tk
rN Y nBX dd l}|jd dd�}|� |j |� W d Q R X |jdddd�}|r�y t
| }W n& t k
r� t d|�d ��d �Y nX || _ |S t
� r�tjdt� tS tS t|t��r td ��|S t|��r|S yt
| S t k
�rB t d|�d ��d �Y nX d S ) NZ PYTHON_TARFILE_EXTRACTION_FILTERr �#)Z
interpolationZcomment_prefixesr� r� )Zfallbackzfilter z
not foundz4The default behavior of tarfile extraction has been z$changed to disallow common exploits z(including CVE-2007-4559). z1By default, absolute/parent paths are disallowed z and some mode bits are cleared. z/See https://access.redhat.com/articles/7004769 zfor more details.z#String names are not supported for z2TarFile.extraction_filter. Use a function such as z tarfile.data_filter directly.)r� zXThe default behavior of tarfile extraction has been changed to disallow common exploits zsThe default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. See https://access.redhat.com/articles/7004769 a The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. See https://access.redhat.com/articles/7004769 for more details.zUString names are not supported for TarFile.extraction_filter. Use a function such as zrString names are not supported for TarFile.extraction_filter. Use a function such as tarfile.data_filter directly.)�extraction_filterr} �environr2 r� �_CONFIG_FILENAME�FileNotFoundError� configparserZ ConfigParserZ read_file�_NAMED_FILTERSr� r. �_RH_SAFER_DEFAULTrc rd �RuntimeWarningr� r� r' r) � TypeError�callable)r� r� r� �filer� Zconfr6 r6 r7 �_get_filter_function� sR
z TarFile._get_filter_function�.)�
numeric_ownerr� c C s� g }| j |�}|dkr| }xN|D ]F}| j|||�}|dkr<q |j� rN|j|� | j|||j� |d� q W |jdd� dd� xv|D ]n}tjj||j �} y,| j
|| |d� | j || � | j || � W q� t
k
r� }
z| j|
� W Y dd}
~
X q�X q�W dS )a� Extract all members from the archive to the current working
directory and set owner, modification time and permissions on
directories afterwards. `path' specifies a different directory
to extract to. `members' is optional and must be a subset of the
list returned by getmembers(). If `numeric_owner` is True, only
the numbers for user/group names are used and not the names.
The `filter` function will be called on each member just
before extraction.
It can return a changed TarInfo or None to skip the member.
String names of common filters are accepted.
N)� set_attrsr� c S s | j S )N)r� )r� r6 r6 r7 �<lambda>� s z$TarFile.extractall.<locals>.<lambda>T)r� �reverse)r� )r� �_get_extract_tarinfor� r� � _extract_one�sortr} r% r� r� �chown�utime�chmodr
�_handle_nonfatal_error) r� r% r� r� r� Z directories�filter_functionr� r� �dirpathr� r6 r6 r7 �
extractall� s*
zTarFile.extractallr� c C s4 | j |�}| j|||�}|dk r0| j||||� dS )a� Extract a member from the archive to the current working directory,
using its full name. Its file information is extracted as accurately
as possible. `member' may be a filename or a TarInfo object. You can
specify a different directory using `path'. File attributes (owner,
mtime, mode) are set unless `set_attrs' is False. If `numeric_owner`
is True, only the numbers for user/group names are used and not
the names.
The `filter` function will be called before extraction.
It can return a changed TarInfo or None to skip the member.
String names of common filters are accepted.
N)r� r� r� )r� r� r% r� r� r� r� r� r6 r6 r7 �extract s
zTarFile.extractc C s� t |t�r| j|�}n|}|}y|||�}W nZ ttfk
r\ } z| j|� W Y dd}~X n, tk
r� } z| j|� W Y dd}~X nX |dkr�| jdd|j � dS |j
� r�t j |�}t j
j||j�|_|S )z@Get filtered TarInfo (or None) from member, which might be a strNr$ ztarfile: Excluded %r)r' r) r� r� r� �_handle_fatal_errorr
r� r� r� r� r r} r% r� r� r� )r� r� r� r% r� Z
unfilteredr� r6 r6 r7 r� s"
z TarFile._get_extract_tarinfoc C s� | j d� y"| j|tjj||j�||d� W nV tk
rX } z| j|� W Y dd}~X n, tk
r� } z| j |� W Y dd}~X nX dS )z%Extract from filtered tarinfo to diskrz )r� r� N)
r� �_extract_memberr} r% r� r� r� r� r
r� )r� r� r% r� r� r� r6 r6 r7 r� 2 s
zTarFile._extract_onec C s" | j dkr� n| jdd| � dS )z=Handle non-fatal error (ExtractError) according to errorlevelr# z tarfile: %sN)r� r� )r� r� r6 r6 r7 r� ? s
z TarFile._handle_nonfatal_errorc C sn | j dkr� n\t|t�rP|jdkr6| jdd|j � qj| jdd|j|jf � n| jddt|�j|f � dS )z1Handle "fatal" error according to self.errorlevelr Nr# z tarfile: %sztarfile: %s %rztarfile: %s %s)r� r' r� �filenamer� �strerrorr� rq )r� r� r6 r6 r7 r� F s
zTarFile._handle_fatal_errorc C s� | j d� t|t�r | j|�}n|}|j� s6|jtkrB| j| |�S |j� sR|j � rzt| j
t �rht d��q~| j
| j|��S ndS dS )z�Extract a member from the archive as a file object. `member' may be
a filename or a TarInfo object. If `member' is a regular file or a
link, an io.BufferedReader object is returned. Otherwise, None is
returned.
rz z'cannot extract (sym)link as file objectN)r� r' r) r� r� r� rW �
fileobjectr� r� r� r� r � extractfile�_find_link_target)r� r� r� r6 r6 r7 r� R s
zTarFile.extractfilec C sV |j d�}|jdtj�}tjj|�}|r@tjj|� r@tj|� |j� sP|j � rj| j
dd|j |j f � n| j
d|j � |j
� r�| j||� n�|j� r�| j||� nx|j� r�| j||� nb|j� s�|j� r�| j||� nD|j� s�|j � r�| j||� n&|jtk�r| j||� n | j||� |�rR| j|||� |j � �sR| j||� | j ||� dS )z\Extract the TarInfo object tarinfo to a physical
file called targetpath.
r� r# z%s -> %sN) rH r� r} r� r% r� r� �makedirsr� r� r� r� r� r� �makefiler� �makedirrz �makefiforw rx �makedev�makelinkr� rW � makeunknownr� r� r� )r� r� �
targetpathr� r� Z upperdirsr6 r6 r7 r� q s4
zTarFile._extract_memberc C s@ y&|j dkrtj|� n tj|d� W n tk
r: Y nX dS )z,Make a directory called targetpath.
Ni� )rh r} �mkdir�FileExistsError)r� r� r� r6 r6 r7 r� � s
zTarFile.makedirc C s� | j }|j|j� | j}t|d��f}|jdk rrx,|jD ]"\}}|j|� t|||t|� q6W |j|j� |j � nt|||jt|� W dQ R X dS )z'Make a file called targetpath.
r� N)
r� r� r� r� r� r� rX r r' �truncate)r� r� r� �sourcer_ �targetr� r' r6 r6 r7 r� � s
zTarFile.makefilec C s" | j ||� | jdd|j � dS )zYMake a file from a TarInfo object with an unknown type
at targetpath.
r# z9tarfile: Unknown file type %r, extracted as regular file.N)r� r� r� )r� r� r� r6 r6 r7 r� � s zTarFile.makeunknownc C s" t td�rtj|� ntd��dS )z'Make a fifo called targetpath.
�mkfifoz fifo not supported by systemN)r� r} r r
)r� r� r� r6 r6 r7 r� � s
zTarFile.makefifoc C sn t td� st td� r td��|j}|dkr2d}|j� rF|tjO }n
|tjO }tj||tj |j
|j �� dS )z<Make a character or block device called targetpath.
�mknodr� z'special devices not supported by systemNi� ) r� r} r
rh rx rf �S_IFBLK�S_IFCHRr r� r� r� )r� r� r� rh r6 r6 r7 r� � s
zTarFile.makedevc C s� yL|j � rtj|j|� n0tjj|j�r8tj|j|� n| j| j |�|� W nH t
k
r� y| j| j |�|� W n t k
r� t d��Y nX Y nX dS )z�Make a (symbolic) link called targetpath. If it cannot be created
(platform limitation), we try to make a copy of the referenced file
instead of a link.
z%unable to resolve link inside archiveN)
r� r} �symlinkr� r% r� r� �linkr� r� �symlink_exceptionr� r
)r� r� r� r6 r6 r7 r� � s
zTarFile.makelinkc C s� t td�r�tj� dkr�|j}|j}|s�y trB|jrBtj|j�d }W n tk
rX Y nX y t rv|j
rvt j |j
�d }W n tk
r� Y nX |dkr�d}|dkr�d }y4|j � r�t td�r�tj
|||� ntj|||� W n tk
r� td��Y nX dS )
z�Set owner of targetpath according to tarinfo. If numeric_owner
is True, use .gid/.uid instead of .gname/.uname. If numeric_owner
is False, fall back to .gid/.uid when the search based on name
fails.
�geteuidr r$ Nr# �lchownzcould not change ownerr9 r9 )r� r} r
r* r) r� r, Zgetgrnamr� r� r+ �getpwnamr� r r� r� r
)r� r� r� r� �g�ur6 r6 r7 r� � s0
z
TarFile.chownc C sL |j dkrdS ttd�rHytj||j � W n tk
rF td��Y nX dS )zASet file permissions of targetpath according to tarinfo.
Nr� zcould not change mode)rh r� r} r� r� r
)r� r� r� r6 r6 r7 r�
s
z
TarFile.chmodc C sV |j }|dkrdS ttd�s dS ytj|||f� W n tk
rP td��Y nX dS )zBSet modification time of targetpath according to tarinfo.
Nr� z"could not change modification time)r( r� r} r� r� r
)r� r� r� r( r6 r6 r7 r� $
s
z
TarFile.utimec C s� | j d� | jdk r$| j}d| _|S | j| jj� krZ| jj| jd � | jjd�sZtd��d}�xby| jj | �}W �nH t
k
r� } z2| j r�| j dd| j|f � | jt
7 _wbW Y dd}~X n� tk
�r, } zN| j �r| j dd| j|f � | jt
7 _wbn| jdk�r tt|���W Y dd}~X n� tk
�rT | jdk�rPtd��Y nj tk
�r� } z | jdk�r~tt|���W Y dd}~X n0 tk
�r� } ztt|���W Y dd}~X nX P qbW |dk �r�| jj|� nd | _|S )
z�Return the next member of the archive as a TarInfo object, when
TarFile is opened for reading. Return None if there is no more
available.
ZraNr# zunexpected end of datar$ z0x%X: %sr z
empty fileT)r� r� r� r� r� r� rZ r r� rQ rw r� r� r� rH r) ru rv rx r� r� r� )r� �mr� r� r6 r6 r7 rZ 2
sL
z TarFile.nextc C s� | j � }d}|dk rHy|j|�}W n tk
r: d}Y nX |d|� }|rXtjj|�}xLt|�D ]@}|r||j|jkrbd}qb|r�tjj|j�}n|j}||krb|S qbW |r�t|��dS )z}Find an archive member by name from bottom to top.
If tarinfo is given, it is used as the starting point.
FNT) r� �indexr. r} r% �normpath�reversedr� r� ) r� r� r� � normalizer� Zskippingr r� � member_namer6 r6 r7 r� h
s,
zTarFile._getmemberc C s" x| j � }|dkrP qW d| _dS )zWRead through the entire archive file and look for readable
members.
NT)rZ r� )r� r� r6 r6 r7 r� �
s
z
TarFile._loadc C s: | j rtd| jj ��|dk r6| j|kr6td| j ��dS )znCheck if TarFile is still open, and if the operation's mode
corresponds to TarFile's mode.
z %s is closedNzbad operation for mode %r)r� r� r� rq rh )r� rh r6 r6 r7 r� �
s zTarFile._checkc C s` |j � r.djtdtjj|j�|jf��}d}n
|j}|}| j||dd�}|dkr\t d| ��|S )zZFind the target member of a symlink or hardlink member in the
archive.
r� NT)r� r zlinkname %r not found)
r� r� r� r} r% r� r� r� r� r� )r� r� r� �limitr� r6 r6 r7 r� �
s zTarFile._find_link_targetc c s� | j r| jE dH dS d}| jdk r:| j� }|d7 }|V xN|t| j�k rV| j| }n"| j st| j� }|sxd| _ dS ndS |d7 }|V q<W dS )z$Provide an iterator object.
Nr r# T)r� r� r� rZ r0 )r� r r� r6 r6 r7 �__iter__�
s&
zTarFile.__iter__c C s || j krt|tjd� dS )z.Write debugging output to sys.stderr.
)r� N)r� ro rm �stderr)r� �level�msgr6 r6 r7 r� �
s
z TarFile._dbgc C s | j � | S )N)r� )r� r6 r6 r7 � __enter__�
s zTarFile.__enter__c C s, |d kr| j � n| js"| jj � d| _d S )NT)r� r� r� r� )r� r� r � tracebackr6 r6 r7 �__exit__�
s
zTarFile.__exit__)
Nrz NNNNNNr NNNN)rz N)rz Nr� )rz Nr� )rz NN)NNN)T)NTN)N)r� N)r� T)TF)NF)N)>rq rr rs rt r� r� r� r� r rP r r4 r5 r r� r� r� r� r� r r� r r� r� r� r� r� r� r� r� r� r� rh r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� rZ r� r� r� r� r r� r r r6 r6 r6 r7 r B s�
lZ !
d&=
5,
0! 6
(
c C s. yt | �}|j� dS tk
r( dS X dS )zfReturn True if name points to a tar archive that we
are able to handle, else return False.
TFN)r r� r )r� r� r6 r6 r7 r �
s c C s dd l } d}| j|d�}|jdddddd � |jd
d td d
� |j� }|jddddd� |jdddd5dd� |jdddd6d d� |jd d dd d� |j� }|jr�|j r�|jd!d"� |j �r*|j }t
|��rt |d#�� }|j � t
|j � tjd$� W d Q R X |j�r&t
d%j|�� n|jd!d&j|�� �n�|j�r�|j}t
|��rjtj |d'��}|j|jd(� W d Q R X n|jd!d&j|�� �n�|j�rPt|j�d!k�r�|jd }tj}n,t|j�d)k�r�|j\}}n|jd!|j� � t
|��r<tj |d'��}|j||jd*� W d Q R X |j�rN|d+k�r&d,j|�} n d-j||�} t
| � n|jd!d&j|�� n�|j�r�|jjd�}
tjj |
�\} } d.d.d/d/d0d0d0d0d1�}
| |
k�r�d2|
| nd3}|j}tj |
|�� }x|D ]}|j |� �q�W W d Q R X |j�rt
d4j|
�� n|jd!|j� � d S )7Nr z3A simple command line interface for tarfile module.)� descriptionz-vz --verbose�
store_trueFzVerbose output)�action�default�helpz--filterz <filtername>zFilter for extraction)�metavar�choicesr! z-lz--list� <tarfile>zShow listing of a tarfile)r" r! z-ez --extract�+� <output_dir>z Extract tarfile into target dir)�nargsr" r! z-cz--create�<name>�<file>zCreate tarfile from sourcesz-tz--testzTest if a tarfile is validr# z&--filter is only valid for extraction
rz )r� z{!r} is a tar archive.z{!r} is not a tar archive.
zr:*)r� r$ )r% r� r� z{!r} file is extracted.z+{!r} file is extracted into {!r} directory.r� r� r� )z.gzz.tgzz.xzz.txzz.bz2z.tbzz.tbz2z.tb2zw:r{ z{!r} file created.)r$ r& )r( r) ) �argparse�ArgumentParser� add_argumentr� Z add_mutually_exclusive_group�
parse_argsr� r� �exitZtestr r r� ro rm r r� rP rh r r0 r} �curdirZ format_helpr� Zcreate�popr% �splitextr� )r* r �parserr` �argsr\ r� Ztfr/ r Ztar_namerj ZextZ compressionsZtar_modeZ tar_files� file_namer6 r6 r7 �main�
s�
r5 �__main__)r% r& r' r( r) r* r+ r, )T)rrt �version�
__author__Z__date__Z __cvsid__� __credits__�builtinsr r� rm r} r� rW rf r� rS r �rerc r� r� r� r� �NotImplementedErrorr r� � NameError�__all__r� r� r1 r� r� r r r r r1 r rE rv ru r3 r4 r ry ZCONTTYPEr r rF r+ r- rT r
r r r rW rs rI rp rc r( rF rq r� r �getfilesystemencodingr8 r= rK rQ rU rX rg rp � Exceptionr r
r r r r ru rv rw rH rx ry r� �objectr� r� �BufferedReaderr� r� r� r� r� r� r� r� r� r� r� r� r �compiler^ r r r r5 rq r6 r6 r6 r7 �<module> s
w h
?
e 4 b