File: //opt/gsutil/third_party/apitools/apitools/base/py/__pycache__/http_wrapper.cpython-39.pyc
a
�z�g]< � @ sh d Z ddlZddlZddlZddlZddlZddlZddlZddlm Z ddl
m Z ddl m
Z
ddl mZ zddlmZ W n ey� ddlmZ Y n0 g d �Zd
Zd Ze je je je jefZe� d g d
��Z ej d)dd��Z G dd� de �Z!G dd� de� dg d���Z"dd� Z#dd� Z$dd� Z%d d � Z&d d d e&e#fd!d"�Z'd e#fd#d$�Z(g Z)d%d&� Z*d'd(� Z+dS )*zpHTTP wrapper for apitools.
This library wraps the underlying http library we use, which is
currently httplib2.
� N)� http_client)�parse)�
exceptions)�util)�HttpAccessTokenRefreshError)�AccessTokenRefreshError)�
CheckResponse�GetHttp�)HandleExceptionsAndRebuildHttpConnections� MakeRequest�RebuildHttpConnections�Request�Response�RethrowExceptionHandler�4 i� �ExceptionRetryArgs)�http� http_request�exc� num_retries�max_retry_wait�total_wait_secc c s� | j du rdV dS tj}i }|t_|dur^|j�� D ]&\}}d|vrHq6|j||< |�|� q6dV |t_|dur�|�� D ]"\}}||jv rz|j| �|� qzdS )a� Temporarily change the value of httplib2.debuglevel, if necessary.
If http_request has a `loggable_body` distinct from `body`, then we
need to prevent httplib2 from logging the full body. This sets
httplib2.debuglevel for the duration of the `with` block; however,
that alone won't change the value of existing HTTP connections. If
an httplib2.Http object is provided, we'll also change the level on
any cached connections attached to it.
Args:
http_request: a Request we're logging.
level: (int) the debuglevel for logging.
http: (optional) an httplib2.Http whose connections we should
set the debuglevel on.
Yields:
None.
N�:)�
loggable_body�httplib2�
debuglevel� connections�items�set_debuglevel)r �levelr Z old_levelZ http_levelsZconnection_key�
connection� r! �A/opt/gsutil/third_party/apitools/apitools/base/py/http_wrapper.py�_Httplib2DebuglevelK s$
r# c @ sN e Zd ZdZd
dd�Zedd� �Zejd d� �Zed
d � �Zejd d � �ZdS )r
z1Class encapsulating the data for an HTTP request.� �GETNc C s, || _ || _|pi | _d | _d | _|| _d S �N)�url� http_method�headers�_Request__body�_Request__loggable_body�body)�selfr' r( r) r, r! r! r" �__init__{ s
zRequest.__init__c C s | j S r& )r+ �r- r! r! r" r � s zRequest.loggable_bodyc C s | j d u rt�d��|| _d S )Nz0Cannot set loggable body on request with no body)r, r � RequestErrorr+ )r- �valuer! r! r" r � s
�c C s | j S r& )r* r/ r! r! r" r, � s z Request.bodyc C sb || _ |dur6t| j dd�p$t| j �}t|�| jd< n| j�dd� t|td�tj f�s^d| _
dS )z>Sets the request body; handles logging and length measurement.N�length�content-lengthz <media body>) r* �getattr�len�strr) �pop�
isinstance�type�six� string_typesr )r- r1 � body_lengthr! r! r" r, � s ��)r$ r% Nr$ ) �__name__�
__module__� __qualname__�__doc__r. �propertyr �setterr, r! r! r! r" r
w s
r
c @ sL e Zd ZdZdZdd� Zedd� �Zedd� �Zed d
� �Z ed d � �Z
d
S )r z.Class encapsulating data for an HTTP response.r! c C s | j S r& )r2 r/ r! r! r" �__len__� s zResponse.__len__c C sf dd� }d| j v r*d| j v r*|| j d �S d| j v rDt| j �d��S d| j v r\|| j d �S t| j�S )z�Return the length of this response.
We expose this as an attribute since using len() directly can fail
for responses larger than sys.maxint.
Returns:
Response length (as int or long)
c S sD | � d�\}}}|� d�\}}}|� d�\}}}t|�t|� d S )N� �/�-� )� partition�int)Z
content_range�_Z
range_specZ
byte_range�start�endr! r! r" �ProcessContentRange� s z,Response.length.<locals>.ProcessContentRangez-content-encodingz
content-ranger3 )�inforI �getr5 �content)r- rM r! r! r" r2 � s
zResponse.lengthc C s t | jd �S )N�status)rI rN r/ r! r! r" � status_code� s zResponse.status_codec C s d| j v rt| j d �S d S )Nz retry-after)rN rI r/ r! r! r" � retry_after� s
zResponse.retry_afterc C s | j tv od| jv S )N�location)rR �_REDIRECT_STATUS_CODESrN r/ r! r! r" � is_redirect� s
�zResponse.is_redirectN) r= r> r? r@ � __slots__rC rA r2 rR rS rV r! r! r! r" r � s
r Z HttpResponse)rN rP � request_urlc C sR | d u rt �d| j ��n4| jdks.| jtkr<t j�| ��n| jrNt j�| ��d S )Nz,Request to url %s did not return a response.�� ) r r0 rX rR �TOO_MANY_REQUESTS�BadStatusCodeError� FromResponserS �RetryAfterError)�responser! r! r" r � s ��
�r c C s4 t | dd�r0t| j�� �D ]}d|v r| j|= qdS )a� Rebuilds all http connections in the httplib2.Http instance.
httplib2 overloads the map in http.connections to contain two different
types of values:
{ scheme string: connection class } and
{ scheme + authority string : actual http connection }
Here we remove all of the entries for actual connections so that on the
next request httplib2 will rebuild them from the connection types.
Args:
http: An httplib2.Http instance.
r Nr )r4 �listr �keys)r �conn_keyr! r! r" r � s
r c G s � d S r& r! )Z unused_argsr! r! r" r � s r c C s� d}t | jtjtjtjf�r8t�dt| j�j | j� �nHt | jt
j �rXt�d| j� �n(t | jt
j �rxt�d| j� �nt | jt
j
�r�t�d| j� n�t | jtj�r�t�d| j� n�t | jt�r�t�d| j� n�t | jt��rt| jd��r| jjtk�s| jjd k�rt�d
| j� nht | jtj��r4t�d � nLt | jtj��rVt�d | jj� n*t | jtj��rzt�d
� | jj}n| j�t| j � t�d| j j | j� t � |�p�t!j"| j#| j$d�� dS )z�Exception handler for http failures.
This catches known failures and rebuilds the underlying HTTP connections.
Args:
retry_args: An ExceptionRetryArgs tuple.
Nz"Caught HTTP error %s, retrying: %sz!Caught socket error, retrying: %sz)Caught socket address error, retrying: %sz)Caught socket timeout error, retrying: %sz+Caught server not found error, retrying: %sz+Response content was invalid (%s), retryingrQ rY z8Caught transient credential refresh error (%s), retryingz&Request returned no response, retryingz%Response returned status %s, retryingz0Response returned a retry-after header, retryingz-Retrying request to url %s after exception %s)�max_wait)%r8 r r �
BadStatusLine�IncompleteRead�ResponseNotReady�logging�debugr9 r= �socket�error�gaierror�timeoutr �ServerNotFoundError�
ValueError�TokenRefreshError�hasattrrQ rZ r r0 r[ rR r] rS r r r r' �time�sleepr �CalculateWaitForRetryr r )Z
retry_argsrS r! r! r" r
� sp
����� �
�
�
�� �
�
��r
� �< � c C s� d}t � � }t| d�r(t| j�dh | _zt| |||d�W S ty� } zB|d7 }||kr^� n"t � � | }
|t| || |||
�� W Y d} ~ q(d} ~ 0 0 q(dS )a� Send http_request via the given http, performing error/retry handling.
Args:
http: An httplib2.Http instance, or a http multiplexer that delegates to
an underlying http, for example, HTTPMultiplexer.
http_request: A Request to send.
retries: (int, default 7) Number of retries to attempt on retryable
replies (such as 429 or 5XX).
max_retry_wait: (int, default 60) Maximum number of seconds to wait
when retrying.
redirections: (int, default 5) Number of redirects to follow.
retry_func: Function to handle retries on exceptions. Argument is an
ExceptionRetryArgs tuple.
check_response_func: Function to validate the HTTP response.
Arguments are (Response, response content, url).
Raises:
InvalidDataFromServerError: if there is no response after retries.
Returns:
A Response object.
r �redirect_codesr )� redirections�check_response_funcrG N)rp ro �setrv �_MakeRequestNoRetry� Exceptionr ) r r �retriesr rw �
retry_funcrx �retryZfirst_req_time�er r! r! r" r 9 s"
� �r c
C s� d}t | dd�r6t�|j�j}|r6|| jv r6| j| }tjdkrDdnd}t||| d��: | j t
|j�t
|j �|j |j
||d�\}}W d � n1 s�0 Y |du r�t�� �t|||j�} || � | S )a� Send http_request via the given http.
This wrapper exists to handle translation between the plain httplib2
request/response types and the Request and Response types above.
Args:
http: An httplib2.Http instance, or a http multiplexer that delegates to
an underlying http, for example, HTTPMultiplexer.
http_request: A Request to send.
redirections: (int, default 5) Number of redirects to follow.
check_response_func: Function to validate the HTTP response.
Arguments are (Response, response content, url).
Returns:
A Response object.
Raises:
RequestError if no response could be parsed.
Nr � r )r )�methodr, r) rw �connection_type)r4 r �urlsplitr' �schemer r r r# �requestr6 r( r, r) r r0 r )
r r rw rx r� Z
url_schemeZnew_debuglevelrN rP r^ r! r! r" rz k s"
�(rz c C s t �| � d S r& )�_HTTP_FACTORIES�append)�factoryr! r! r" �_RegisterHttpFactory� s r� c K s8 t D ]"}|f i | ��}|d ur| S qtjf i | ��S r& )r� r �Http)�kwdsr� r r! r! r" r � s
r )N),r@ � collections�
contextlibrf rh rp r r: � six.movesr Zsix.moves.urllibr �apitools.base.pyr r �oauth2client.clientr rn � ImportErrorr �__all__ZRESUME_INCOMPLETErZ �MOVED_PERMANENTLY�FOUND� SEE_OTHER�TEMPORARY_REDIRECTrU �
namedtupler �contextmanagerr# �objectr
r r r r r
r rz r� r� r r! r! r! r" �<module> s`
� � +-�3
=�
2�
/