a !f@sXdZddlZddlZddlZddlmZddlmZddlZddlZddl Z ddl Z ddl Z ddl Z ddl mZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddl m!Z!ddl m"Z"ddl m#Z#dZ$GdddeZ%Gddde&Z'Gddde&Z(ddZ)dS)z2Create / interact with Google Cloud Storage blobs.N)BytesIO)UnsupportedOperationquote)_rfc3339_to_datetime) _to_bytes)_bytes_to_unicode)generate_signed_url)NotFound)make_exception)_PropertyMixin)_scalar_property) ObjectACL)Request)make_api_request)Download)RESUMABLE_UPLOAD)Uploadhttps://storage.googleapis.comcseZdZdZdZdZdQfdd ZeddZej ddZe d d Z ed d Z d dZ eddZeddZeddZdRddZdSddZdTddZdUddZdVddZdWd d!Ze d"d#ZdXd&d'ZdYd(d)ZdZd+d,Zd[d-d.Zed/Zed0Zed1Zed2Z ed3Z!ed4Z"ed5d6Z#ed7d8Z$ed9d:Z%ed;d<Z&ed=Z'ed>d?Z(ed@dAZ)e)j dBdAZ)edCdDZ*edEdFZ+edGdHZ,edIdJZ-edKdLZ.edMdNZ/edOdPZ0Z1S)\BlobaA wrapper around Cloud Storage's concept of an ``Object``. :type name: string :param name: The name of the blob. This corresponds to the unique path of the object in the bucket. :type bucket: :class:`gcloud.storage.bucket.Bucket` :param bucket: The bucket to which this blob belongs. :type chunk_size: integer :param chunk_size: The size of a chunk of data whenever iterating (1 MB). This must be a multiple of 256 KB per the API specification. Nics,tt|j|d||_||_t||_dS)N)name)superr__init__ chunk_sizebucketr_acl)selfrrr __class__T/var/www/html/python-backend/venv/lib/python3.9/site-packages/gcloud/storage/blob.pyrGsz Blob.__init__cCs|jS)zGet the blob's default chunk size. :rtype: integer or ``NoneType`` :returns: The current blob's chunk size, if it is set. ) _chunk_sizerrrr rNszBlob.chunk_sizecCs0|dur&||jdkr&td|jf||_dS)aSet the blob's default chunk size. :type value: integer or ``NoneType`` :param value: The current blob's chunk size, if it is set. :raises: :class:`ValueError` if ``value`` is not ``None`` and is not a multiple of 256 KB. Nrz$Chunk size must be a multiple of %d.)_CHUNK_SIZE_MULTIPLE ValueErrorr!rvaluerrr rWs cCs|dt|ddS)a$Relative URL path for a blob. :type bucket_path: string :param bucket_path: The URL path for a bucket. :type blob_name: string :param blob_name: The name of the blob. :rtype: string :returns: The relative URL path for ``blob_name``. z/o/safer)Z bucket_pathZ blob_namerrr path_helperfs zBlob.path_helpercCs|jS)zCreate our ACL on demand.)rr"rrr acluszBlob.aclcCs"|jr|jj}nd}d||jfS)Nz)rr)r bucket_namerrr __repr__zs z Blob.__repr__cCs |jstd||jj|jS)z|Getter property for the URL path to this Blob. :rtype: string :returns: The URL path to this Blob. z*Cannot determine path without a blob name.)rr$r*rpathr"rrr r.sz Blob.pathcCs|jjS)zThe client bound to this blob.)rclientr"rrr r/sz Blob.clientcCsdjd|jjt|jdddS)zyThe public URL for this blob's object. :rtype: `string` :returns: The public URL for this blob. z.{storage_base_url}/{bucket_name}/{quoted_name}rr'r()Zstorage_base_urlr, quoted_name)formatrrrr"rrr public_urls  zBlob.public_urlGETc CsPdj|jjt|jddd} |dur6||}|jj}t|| t||||||d S)a Generates a signed URL for this blob. .. note:: If you are on Google Compute Engine, you can't generate a signed URL. Follow `Issue 922`_ for updates on this. If you'd like to be able to generate a signed URL from GCE, you can use a standard service account from a JSON file rather than a GCE service account. .. _Issue 922: https://github.com/GoogleCloudPlatform/ gcloud-python/issues/922 If you have a blob that you want to allow access to for a set amount of time, you can use this method to generate a URL that is only valid within a certain time period. This is particularly useful if you don't want publicly accessible blobs, but don't want to require users to explicitly log in. :type expiration: int, long, datetime.datetime, datetime.timedelta :param expiration: When the signed URL should expire. :type method: str :param method: The HTTP verb that will be used when requesting the URL. :type content_type: str :param content_type: (Optional) The content type of the object referenced by ``resource``. :type generation: str :param generation: (Optional) A value that indicates which generation of the resource to fetch. :type response_disposition: str :param response_disposition: (Optional) Content disposition of responses to requests for the signed URL. For example, to enable the signed URL to initiate a file of ``blog.png``, use the value ``'attachment; filename=blob.png'``. :type response_type: str :param response_type: (Optional) Content type of responses to requests for the signed URL. Used to over-ride the content type of the underlying blob/object. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: (Optional) The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :type credentials: :class:`oauth2client.client.OAuth2Credentials` or :class:`NoneType` :param credentials: (Optional) The OAuth2 credentials to use to sign the URL. Defaults to the credentials stored on the client used. :rtype: str :returns: A signed URL you can use to access the resource until expiration. z/{bucket_name}/{quoted_name}r'r()r,r0N)resourceZapi_access_endpoint expirationmethod content_type response_typeresponse_disposition generation) r1rrr_require_client _connection credentialsr _API_ACCESS_ENDPOINT) rr5r6r7r:r9r8r/r=r4rrr r s B  zBlob.generate_signed_urlcCsH||}z$ddi}|jjd|j|ddWdStyBYdS0dS)akDetermines whether or not this blob exists. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :rtype: boolean :returns: True if the blob exists in Cloud Storage. fieldsrr3N)r6r. query_paramsZ_target_objectTF)r; connectionZ api_requestr.r )rr/r@rrr existss   z Blob.existscCs|jj|j|dS)aDeletes a blob from Cloud Storage. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :rtype: :class:`Blob` :returns: The blob that was just deleted. :raises: :class:`gcloud.exceptions.NotFound` (propagated from :meth:`gcloud.storage.bucket.Bucket.delete_blob`). r/)rZ delete_blobrrr/rrr delete s z Blob.deletecCsp||}|jdur||j}t|}|jdur>|j|_i}|rPt||t|d|}| ||j j dS)aeDownload the contents of this blob into a file-like object. .. note:: If the server-set property, :attr:`media_link`, is not yet initialized, makes an additional API request to load it. Downloading a file that has been encrypted with a `customer-supplied`_ encryption key:: >>> from gcloud import storage >>> from gcloud.storage import Blob >>> client = storage.Client(project='my-project') >>> bucket = client.get_bucket('my-bucket') >>> encryption_key = 'aa426195405adee2c8081bb9e7e74b19' >>> blob = Blob('secure-data', bucket) >>> with open('/tmp/my-secure-file', 'wb') as file_obj: >>> blob.download_to_file(file_obj, ... encryption_key=encryption_key) The ``encryption_key`` should be a str or bytes with a length of at least 32. .. _customer-supplied: https://cloud.google.com/storage/docs/ encryption#customer-supplied :type file_obj: file :param file_obj: A file handle to which to write the blob's data. :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :raises: :class:`gcloud.exceptions.NotFound` Nr3) r; media_linkreloadr from_streamr chunksize_set_encryption_headersrZinitialize_downloadr<http)rfile_objencryption_keyr/ download_urldownloadheadersrequestrrr download_to_files)      zBlob.download_to_filecCs`t|d }|j|||dWdn1s00Yt|j}t|j||fdS)a`Download the contents of this blob into a named file. :type filename: string :param filename: A filename to be passed to ``open``. :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :raises: :class:`gcloud.exceptions.NotFound` wbrMr/N) openrRtimemktimeupdated timetupleosutimer)rfilenamerMr/rLmtimerrr download_to_filename_s  $zBlob.download_to_filenamecCst}|j|||d|S)aBDownload the contents of this blob as a string. :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :rtype: bytes :returns: The data stored in this blob. :raises: :class:`gcloud.exceptions.NotFound` rT)rrRgetvalue)rrMr/ string_bufferrrr download_as_stringvs zBlob.download_as_stringcCsL|j}t|d}d|kr&dksHntd|i}t||j|jddS)z$Helper for :meth:`upload_from_file`.statusi,) error_infoN)infointhttplib2Responser contenturl)rQ http_responsererbZ faux_responserrr _check_response_errors zBlob._check_response_errorFc Cs||}|j}|p"|jdp"d}|r6|dtj|} | durxt|drxzt| j } Wnt t fyvYn0dd|j d} |rt|| t||| d d } |jdur|j| _| durt| _n| durtd t|jj|jd } t} |jd }|j||jjdd}t|d| }| | || | j}|jd }|j||jjd|d|_| ||j!| jtkrz| j"dd}nt#|j!||d}|$|||j%}t&|t'j(s|)d}|*t+,|dS)a Upload the contents of this blob from a file-like object. The content type of the upload will either be - The value passed in to the function (if any) - The value stored on the current blob - The default value of 'application/octet-stream' .. note:: The effect of uploading to an existing blob depends on the "versioning" and "lifecycle" policies defined on the blob's bucket. In the absence of those policies, upload will overwrite any existing contents. See the `object versioning `_ and `lifecycle `_ API documents for details. Uploading a file with a `customer-supplied`_ encryption key:: >>> from gcloud import storage >>> from gcloud.storage import Blob >>> client = storage.Client(project='my-project') >>> bucket = client.get_bucket('my-bucket') >>> encryption_key = 'aa426195405adee2c8081bb9e7e74b19' >>> blob = Blob('secure-data', bucket) >>> with open('my-file', 'rb') as my_file: >>> blob.upload_from_file(my_file, ... encryption_key=encryption_key) The ``encryption_key`` should be a str or bytes with a length of at least 32. .. _customer-supplied: https://cloud.google.com/storage/docs/ encryption#customer-supplied :type file_obj: file :param file_obj: A file handle open for reading. :type rewind: boolean :param rewind: If True, seek to the beginning of the file handle before writing the file to Cloud Storage. :type size: int :param size: The number of bytes to read from the file handle. If not provided, we'll try to guess the size using :func:`os.fstat`. (If the file handle is not from the filesystem this won't be possible.) :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type content_type: string or ``NoneType`` :param content_type: Optional type of content being uploaded. :type num_retries: integer :param num_retries: Number of upload retries. Defaults to 6. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. :raises: :class:`ValueError` if size is not passed in and can not be determined; :class:`gcloud.exceptions.GCloudError` if the upload response returns an error status. contentTypezapplication/octet-streamrNfilenozapplication/jsonz gzip, deflate)AcceptzAccept-Encodingz User-AgentF)Z auto_transferzstotal bytes could not be determined. Please pass an explicit size, or supply a chunk size for a streaming transfer.)r, object_namez/uploadz/o) api_base_urlr.POST)rrr.r@T)Z use_chunks)retriesutf-8)-r;r< _propertiesgetseekrZSEEK_SEThasattrfstatrost_sizeOSErrorrZ USER_AGENTrJrrrIrZstrategyr$ _UrlBuilderrr _UploadConfigZ API_BASE_URLZ build_api_urlr.rZconfigure_requestr@rjZinitialize_uploadrKZ stream_filerrlri isinstancesix string_typesdecodeZ_set_propertiesjsonloads)rrLrewindsizerMr7Z num_retriesr/rA total_bytesrPuploadZ url_builderZ upload_configbase_urlZ upload_urlrQr@rkZresponse_contentrrr upload_from_filestG            zBlob.upload_from_filecCsf|p|jd}|dur&t|\}}t|d"}|j||||dWdn1sX0YdS)a\Upload this blob's contents from the content of a named file. The content type of the upload will either be - The value passed in to the function (if any) - The value stored on the current blob - The value given by mimetypes.guess_type .. note:: The effect of uploading to an existing blob depends on the "versioning" and "lifecycle" policies defined on the blob's bucket. In the absence of those policies, upload will overwrite any existing contents. See the `object versioning `_ and `lifecycle `_ API documents for details. :type filename: string :param filename: The path to the file. :type content_type: string or ``NoneType`` :param content_type: Optional type of content being uploaded. :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. rnNrb)r7rMr/)rvrw mimetypes guess_typerUr)rr\r7rMr/_rLrrr upload_from_filename-s" zBlob.upload_from_filename text/plaincCsDt|tjr|d}t}|||j|dt||||ddS)aUpload contents of this blob from the provided string. .. note:: The effect of uploading to an existing blob depends on the "versioning" and "lifecycle" policies defined on the blob's bucket. In the absence of those policies, upload will overwrite any existing contents. See the `object versioning `_ and `lifecycle `_ API documents for details. :type data: bytes or text :param data: The data to store in this blob. If the value is text, it will be encoded as UTF-8. :type content_type: string :param content_type: Optional type of content being uploaded. Defaults to ``'text/plain'``. :type encryption_key: str or bytes :param encryption_key: Optional 32 byte encryption key for customer-supplied encryption. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. ruT)rLrrr7rMr/N)rr text_typeencoderwriterlen)rdatar7rMr/r`rrr upload_from_stringWs   zBlob.upload_from_stringcCs |j|jj|ddS)aMake this blob public giving all users read access. :type client: :class:`gcloud.storage.client.Client` or ``NoneType`` :param client: Optional. The client to use. If not passed, falls back to the ``client`` stored on the blob's bucket. rCN)r+allZ grant_readsaverDrrr make_public~szBlob.make_publicZ cacheControlZcontentDispositionZcontentEncodingZcontentLanguagerncrc32ccCs |jd}|durt|SdS)aNumber of underlying components that make up this object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: integer or ``NoneType`` :returns: The component count (in case of a composed object) or ``None`` if the property is not set locally. This property will not be set on objects not created via ``compose``. ZcomponentCountNrvrwrf)rcomponent_countrrr rs zBlob.component_countcCs |jdS)a+Retrieve the ETag for the object. See: http://tools.ietf.org/html/rfc2616#section-3.11 and https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: string or ``NoneType`` :returns: The blob etag or ``None`` if the property is not set locally. etagrvrwr"rrr rs z Blob.etagcCs |jd}|durt|SdS)aRetrieve the generation for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: integer or ``NoneType`` :returns: The generation of the blob or ``None`` if the property is not set locally. r:Nr)rr:rrr r:s zBlob.generationcCs |jdS)zRetrieve the ID for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: string or ``NoneType`` :returns: The ID of the blob or ``None`` if the property is not set locally. idrr"rrr rs zBlob.idZmd5HashcCs |jdS)aRetrieve the media download URI for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: string or ``NoneType`` :returns: The media link for the blob or ``None`` if the property is not set locally. Z mediaLinkrr"rrr rF s zBlob.media_linkcCst|jdS)a1Retrieve arbitrary/application specific metadata for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: dict or ``NoneType`` :returns: The metadata associated with the blob or ``None`` if the property is not set locally. metadatacopydeepcopyrvrwr"rrr rs z Blob.metadatacCs|d|dS)zUpdate arbitrary/application specific metadata for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :type value: dict or ``NoneType`` :param value: The blob metadata to set. rN)Z_patch_propertyr%rrr r"s cCs |jd}|durt|SdS)aRetrieve the metageneration for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: integer or ``NoneType`` :returns: The metageneration of the blob or ``None`` if the property is not set locally. metagenerationNr)rrrrr r-s zBlob.metagenerationcCst|jdS)aRetrieve info about the owner of the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: dict or ``NoneType`` :returns: Mapping of owner's role/ID. If the property is not set locally, returns ``None``. ownerrr"rrr r;s z Blob.ownercCs |jdS)aRetrieve the URI for the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: string or ``NoneType`` :returns: The self link for the blob or ``None`` if the property is not set locally. ZselfLinkrr"rrr self_linkGs zBlob.self_linkcCs |jd}|durt|SdS)aSize of the object, in bytes. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: integer or ``NoneType`` :returns: The size of the blob or ``None`` if the property is not set locally. rNr)rrrrr rSs z Blob.sizecCs |jdS)aRetrieve the storage class for the object. See: https://cloud.google.com/storage/docs/storage-classes https://cloud.google.com/storage/docs/nearline-storage https://cloud.google.com/storage/docs/durable-reduced-availability :rtype: string or ``NoneType`` :returns: If set, one of "STANDARD", "NEARLINE", or "DURABLE_REDUCED_AVAILABILITY", else ``None``. Z storageClassrr"rrr storage_classas zBlob.storage_classcCs |jd}|durt|SdS)aRetrieve the timestamp at which the object was deleted. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: :class:`datetime.datetime` or ``NoneType`` :returns: Datetime object parsed from RFC3339 valid timestamp, or ``None`` if the property is not set locally. If the blob has not been deleted, this will never be set. Z timeDeletedNrvrwrr%rrr time_deletedos zBlob.time_deletedcCs |jd}|durt|SdS)aMRetrieve the timestamp at which the object was updated. See: https://cloud.google.com/storage/docs/json_api/v1/objects :rtype: :class:`datetime.datetime` or ``NoneType`` :returns: Datetime object parsed from RFC3339 valid timestamp, or ``None`` if the property is not set locally. rXNrr%rrr rX~s z Blob.updated)N)r3NNNNNN)N)N)NN)NN)NN)FNNNrmN)NNN)rNN)N)2__name__ __module__ __qualname____doc__r!r#rpropertyrsetter staticmethodr*r+r-r.r/r2r rBrErRr^rarlrrrrr Z cache_controlcontent_dispositioncontent_encodingZcontent_languager7rrrr:rZmd5_hashrFrrrrrrrrX __classcell__rrrr r2s        S   C     * '                     rc@s*eZdZdZdgZdZdZdZdZdZ dS)rzFaux message FBO apitools' 'configure_request'. Values extracted from apitools 'samples/storage_sample/storage/storage_v1_client.py' z*/*NTz)/resumable/upload/storage/v1/b/{bucket}/oz/upload/storage/v1/b/{bucket}/o) rrrracceptmax_sizeZresumable_multipartZresumable_pathZsimple_multipartZ simple_pathrrrr rsrc@seZdZdZddZdS)r~z.Faux builder FBO apitools' 'configure_request'cCsd|i|_||_d|_dS)Nrr')r@Z _bucket_nameZ_relative_path)rr,rqrrr rs z_UrlBuilder.__init__N)rrrrrrrrr r~sr~cCsVt|}t|}t|}t|}d|d<t||d<t||d<dS)zBuilds customer encyrption key headers :type key: str or bytes :param key: 32 byte key to build request key and hash. :type headers: dict :param headers: dict of HTTP headers being sent in request. ZAES256zX-Goog-Encryption-AlgorithmzX-Goog-Encryption-KeyzX-Goog-Encryption-Key-Sha256N)rhashlibsha256digestbase64 b64encoderstripr)keyrPZ sha256_keyZkey_hashZ encoded_keyrrr rJs  rJ)*rrrriorrrrrZrVrgrZsix.moves.urllib.parserZgcloud._helpersrrrZgcloud.credentialsr Zgcloud.exceptionsr r Zgcloud.storage._helpersr r Zgcloud.storage.aclrZgcloud.streaming.http_wrapperrrZgcloud.streaming.transferrrrr>robjectrr~rJrrrr sJ                 a