feat: compute chunk wise checksum for bidi_writes by chandra-siri · Pull Request #1675 · googleapis/python-storage · GitHub
Skip to content
This repository was archived by the owner on Mar 31, 2026. It is now read-only.

feat: compute chunk wise checksum for bidi_writes#1675

Merged
chandra-siri merged 12 commits into
mainfrom
bidi_writes_checksum
Dec 19, 2025
Merged

feat: compute chunk wise checksum for bidi_writes#1675
chandra-siri merged 12 commits into
mainfrom
bidi_writes_checksum

Conversation

@chandra-siri

@chandra-siri chandra-siri commented Dec 18, 2025

Copy link
Copy Markdown
Collaborator

feat: compute chunk wise checksum for bidi_writes and send it via BidiWriteObjectRequest

As a part of this change, also did a small refactoring

  • Moved the precondition check to _utils.py file

@product-auto-label product-auto-label Bot added size: s Pull request size is small. api: storage Issues related to the googleapis/python-storage API. labels Dec 18, 2025
@gemini-code-assist

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds chunk-wise checksum computation for bidi writes, which is a great enhancement for data integrity. The implementation looks correct. I have one minor point of feedback regarding an error message and the exception type used for checking crc32c support. Additionally, it would be beneficial to add unit tests to cover the new checksum calculation logic and the new exception path for the crc32c implementation check to ensure the feature is robust and prevent future regressions.

Comment thread google/cloud/storage/_experimental/asyncio/async_appendable_object_writer.py Outdated
@product-auto-label product-auto-label Bot added size: m Pull request size is medium. and removed size: s Pull request size is small. labels Dec 18, 2025
@chandra-siri

chandra-siri commented Dec 18, 2025

Copy link
Copy Markdown
Collaborator Author

Samples - Python 3.14 are blocked until b/470024447

@chandra-siri chandra-siri marked this pull request as ready for review December 18, 2025 13:40
@chandra-siri chandra-siri requested review from a team December 18, 2025 13:40
@chandra-siri chandra-siri requested a review from a team as a code owner December 18, 2025 13:40
suni72
suni72 previously approved these changes Dec 18, 2025
@chandra-siri

Copy link
Copy Markdown
Collaborator Author

@chandra-siri chandra-siri requested a review from suni72 December 19, 2025 09:49
@chandra-siri chandra-siri merged commit 139390c into main Dec 19, 2025
16 of 17 checks passed
@chandra-siri chandra-siri deleted the bidi_writes_checksum branch December 19, 2025 10:51
vchudnov-g added a commit that referenced this pull request Jan 13, 2026
PR created by the Librarian CLI to initialize a release. Merging this PR
will auto trigger a release.

Librarian Version: v0.7.0
Language Image:
us-central1-docker.pkg.dev/cloud-sdk-librarian-prod/images-prod/python-librarian-generator@sha256:8e2c32496077054105bd06c54a59d6a6694287bc053588e24debe6da6920ad91
<details><summary>google-cloud-storage: 3.8.0</summary>

##
[3.8.0](v3.7.0...v3.8.0)
(2026-01-13)

### Features

* expose persisted size in mrd (#1671)
([0e2961b](0e2961be))

* implement &#34;append_from_file&#34; (#1686)
([1333c95](1333c956))

* compute chunk wise checksum for bidi_writes (#1675)
([139390c](139390cb))

* flush the last chunk in append method (#1699)
([89bfe7a](89bfe7a5))

* add write resumption strategy (#1663)
([a57ea0e](a57ea0ec))

* add bidi stream retry manager. (#1632)
([d90f0ee](d90f0ee0))

* make flush size configurable (#1677)
([f7095fa](f7095faf))

### Bug Fixes

* no state lookup while opening bidi-write stream
([2d5a7b1](2d5a7b16))

* no state lookup while opening bidi-write stream (#1636)
([2d5a7b1](2d5a7b16))

* close write object stream always (#1661)
([4a609a4](4a609a4b))

* add system test for opening with read_handle (#1672)
([6dc711d](6dc711da))

</details>

---------

Co-authored-by: Victor Chudnovsky <vchudnov@google.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

api: storage Issues related to the googleapis/python-storage API. size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants