a !fb3@sndZddlZddlZddlZddlmZddlmZeZ ej ddZ ej Z dZGdd d eZd d d ZdS)z-Google Cloud Bigtable HappyBase batch module.N)_datetime_from_microseconds)TimestampRange) microsecondszFThe wal argument (Write-Ahead-Log) is not supported by Cloud Bigtable.c@sleZdZdZdddefddZddZdd Zd d Zefd d Z ddZ defddZ ddZ ddZ dS)BatchaBatch class for accumulating mutations. .. note:: When using a batch with ``transaction=False`` as a context manager (i.e. in a ``with`` statement), mutations will still be sent as row mutations even if the context manager exits with an error. This behavior is in place to match the behavior in the HappyBase HBase / Thrift implementation. :type table: :class:`Table ` :param table: The table where mutations will be applied. :type timestamp: int :param timestamp: (Optional) Timestamp (in milliseconds since the epoch) that all mutations will be applied at. :type batch_size: int :param batch_size: (Optional) The maximum number of mutations to allow to accumulate before committing them. :type transaction: bool :param transaction: Flag indicating if the mutations should be sent transactionally or not. If ``transaction=True`` and an error occurs while a :class:`Batch` is active, then none of the accumulated mutations will be committed. If ``batch_size`` is set, the mutation can't be transactional. :type wal: object :param wal: Unused parameter (Boolean for using the HBase Write Ahead Log). Provided for compatibility with HappyBase, but irrelevant for Cloud Bigtable since it does not have a Write Ahead Log. :raises: :class:`TypeError ` if ``batch_size`` is set and ``transaction=True``. :class:`ValueError ` if ``batch_size`` is not positive. NFcCs|turtt|dur4|r$td|dkr4td||_||_d|_|_|durxt d||_|jt }t |d|_||_ i|_ d|_dS)Nz7When batch_size is set, a Batch cannot be transactionalrzbatch_size must be positiver)end) _WAL_SENTINEL_WARN _WAL_WARNING TypeError ValueError_table _batch_size _timestamp _delete_ranger_ONE_MILLISECONDr _transaction_row_map_mutation_count)selftable timestampZ batch_sizeZ transactionwalZnext_timestampr`/var/www/html/python-backend/venv/lib/python3.9/site-packages/gcloud/bigtable/happybase/batch.py__init__Ls"   zBatch.__init__cCs,|jD] }|q |jd|_dS)z3Send / commit the batch of mutations to the server.rN)rvaluescommitclearr)rrowrrrsendms  z Batch.sendcCs|jr|j|jkr|dS)z>Send / commit the batch if mutations have exceeded batch size.N)rrr rrrr _try_sendvszBatch._try_sendcCs,||jvr"|jj}|||j|<|j|S)aqGets a row that will hold mutations. If the row is not already cached on the current batch, a new row will be created. :type row_key: str :param row_key: The row key for a row stored in the map. :rtype: :class:`Row ` :returns: The newly created or stored row that will hold mutations. )rr Z_low_level_tabler)rZrow_keyrrrr_get_row{s zBatch._get_rowc Cs||turtt||}tt|dd}|D],\}}||d|}|j||||jdq0|j t |7_ | dS)aInsert data into a row in the table owned by this batch. :type row: str :param row: The row key where the mutation will be "put". :type data: dict :param data: Dictionary containing the data to be inserted. The keys are columns names (of the form ``fam:col``) and the values are strings (bytes) to be stored in those columns. :type wal: object :param wal: Unused parameter (to over-ride the default on the instance). Provided for compatibility with HappyBase, but irrelevant for Cloud Bigtable since it does not have a Write Ahead Log. T)require_qualifier:)rN) rr r r#_get_column_pairssixiterkeysZset_cellrrlenr") rrdatar row_object column_pairscolumn_family_idcolumn_qualifiervaluerrrputs   z Batch.putcCsXt|}|D]F\}}|dur@|jdur.td|j||jdq |j|||jdq dS)aAdds delete mutations for a list of columns and column families. :type columns: list :param columns: Iterable containing column names (as strings). Each column name can be either * an entire column family: ``fam`` or ``fam:`` * a single column: ``fam:col`` :type row_object: :class:`Row ` :param row_object: The row which will hold the delete mutations. :raises: :class:`ValueError ` if the delete timestamp range is set on the current batch, but a column family delete is attempted. NzQThe Cloud Bigtable API does not support adding a timestamp to "DeleteFromFamily" )columns)Z time_range)r&rr Z delete_cellsZ ALL_COLUMNSZ delete_cell)rr1r+r,r-r.rrr_delete_columnss  zBatch._delete_columnscCsv|turtt||}|durL|jdur4td||jd7_n||||jt |7_| dS)aDelete data from a row in the table owned by this batch. :type row: str :param row: The row key where the delete will occur. :type columns: list :param columns: (Optional) Iterable containing column names (as strings). Each column name can be either * an entire column family: ``fam`` or ``fam:`` * a single column: ``fam:col`` If not used, will delete the entire row. :type wal: object :param wal: Unused parameter (to over-ride the default on the instance). Provided for compatibility with HappyBase, but irrelevant for Cloud Bigtable since it does not have a Write Ahead Log. :raises: If the delete timestamp range is set on the current batch, but a full row delete is attempted. NzWThe Cloud Bigtable API does not support adding a timestamp to "DeleteFromRow" mutations) rr r r#rr deleterr2r)r")rrr1rr+rrrr4s   z Batch.deletecCs|S)z*Enter context manager, no set-up required.rr!rrr __enter__szBatch.__enter__cCs|jr|durdS|dS)aExit context manager, no set-up required. :type exc_type: type :param exc_type: The type of the exception if one occurred while the context manager was active. Otherwise, :data:`None`. :type exc_value: :class:`Exception ` :param exc_value: An instance of ``exc_type`` if an exception occurred while the context was active. Otherwise, :data:`None`. :type traceback: ``traceback`` type :param traceback: The traceback where the exception occurred (if one did occur). Otherwise, :data:`None`. N)rr )rexc_type exc_value tracebackrrr__exit__szBatch.__exit__)__name__ __module__ __qualname____doc__rrr r"r#r0r2r4r5r9rrrrr#s( !  !+rFcCsg}|D]}t|tjr"|d}|dr8|dd}|d}|dkrj|rZtd|q||dgq|dkr||dqtdq|S) auTurns a list of column or column families into parsed pairs. Turns a column family (``fam`` or ``fam:``) into a pair such as ``['fam', None]`` and turns a column (``fam:col``) into ``['fam', 'col']``. :type columns: list :param columns: Iterable containing column names (as strings). Each column name can be either * an entire column family: ``fam`` or ``fam:`` * a single column: ``fam:col`` :type require_qualifier: bool :param require_qualifier: Boolean indicating if the columns should all have a qualifier or not. :rtype: list :returns: List of pairs, where the first element in each pair is the column family and the second is the column qualifier (or :data:`None`). :raises: :class:`ValueError ` if any of the columns are not of the expected format. :class:`ValueError ` if ``require_qualifier`` is :data:`True` and one of the values is for an entire column family zutf-8r%Nrz#column does not contain a qualifierr3z.Column contains the : separator more than once) isinstancer' binary_typedecodeendswithcountr appendsplit)r1r$r,columnZ num_colonsrrrr&s"      r&)F)r=datetimewarningsr'Zgcloud._helpersrZgcloud.bigtable.row_filtersrobjectr timedeltarwarnr r rr&rrrrs   t