HEX

File: //opt/gsutil/third_party/apitools/apitools/base/py/__pycache__/compression.cpython-39.pyc
a

�z�g�@s@dZddlmZddlmZdgZddd�ZGd	d
�d
e�ZdS)z!Compression support for apitools.�)�deque)�gzip�CompressStreamN��c
Cs�d}d}t�}tjd||d��R}|r.|j|krb|�|�}t|�}	|�|�||	7}|	|kr d}qbq Wd�n1sv0Y|||fS)a�Compresses an input stream into a file-like buffer.

    This reads from the input stream until either we've stored at least length
    compressed bytes, or the input stream has been exhausted.

    This supports streams of unknown size.

    Args:
        in_stream: The input stream to read from.
        length: The target number of compressed bytes to buffer in the output
            stream. If length is none, the input stream will be compressed
            until it's exhausted.

            The actual length of the output buffer can vary from the target.
            If the input stream is exhaused, the output buffer may be smaller
            than expected. If the data is incompressible, the maximum length
            can be exceeded by can be calculated to be:

              chunksize + 5 * (floor((chunksize - 1) / 16383) + 1) + 17

            This accounts for additional header data gzip adds. For the default
            16MiB chunksize, this results in the max size of the output buffer
            being:

              length + 16Mib + 5142 bytes

        compresslevel: Optional, defaults to 2. The desired compression level.
        chunksize: Optional, defaults to 16MiB. The chunk size used when
            reading data from the input stream to write into the output
            buffer.

    Returns:
        A file-like output buffer of compressed bytes, the number of bytes read
        from the input stream, and a flag denoting if the input stream was
        exhausted.
    rF�wb)�mode�fileobj�
compresslevelTN)�StreamingBufferr�GzipFile�length�read�len�write)
Z	in_streamr
r
�	chunksizeZin_readZin_exhaustedZ
out_streamZcompress_stream�data�data_length�r�@/opt/gsutil/third_party/apitools/apitools/base/py/compression.pyrs"'�

"c@sFeZdZdZdd�Zdd�Zdd�Zedd	��Zd
d�Z	dd
d�Z
dS)rz�Provides a file-like object that writes to a temporary buffer.

    When data is read from the buffer, it is permanently removed. This is
    useful when there are memory constraints preventing the entire buffer from
    being stored in memory.
    cCst�|_d|_dS)Nr)r�_StreamingBuffer__buf�_StreamingBuffer__size��selfrrr�__init__aszStreamingBuffer.__init__cCs|jS�N�rrrrr�__len__gszStreamingBuffer.__len__cCs
t|j�Sr)�boolrrrrr�__nonzero__jszStreamingBuffer.__nonzero__cCs|jSrrrrrrr
oszStreamingBuffer.lengthcCs.|dur*|r*|j�|�|jt|�7_dSr)r�appendrr)rrrrrrtszStreamingBuffer.writeNcCs�|dur|j}g}|dkrB|jrB|j��}|t|�8}|�|�q|dkr||dd|�|d|d�|d<}|j�|�d�|�}|jt|�8_|S)aMRead at most size bytes from this buffer.

        Bytes read from this buffer are consumed and are permanently removed.

        Args:
          size: If provided, read no more than size bytes from the buffer.
            Otherwise, this reads the entire buffer.

        Returns:
          The bytes read from this buffer.
        Nr����)rr�popleftrr �
appendleft�join)r�sizeZret_listr�	remainder�retrrrr{s
&
zStreamingBuffer.read)N)�__name__�
__module__�__qualname__�__doc__rrr�propertyr
rrrrrrrXs
r)Nrr)	r,�collectionsr�apitools.base.pyr�__all__r�objectrrrrr�<module>s��
: