feat: make flush size to be configurable by chandra-siri · Pull Request #1677 · googleapis/python-storage · GitHub
Skip to content
This repository was archived by the owner on Mar 31, 2026. It is now read-only.

feat: make flush size to be configurable#1677

Merged
chandra-siri merged 17 commits into
mainfrom
configurable_flush_interval
Dec 19, 2025
Merged

feat: make flush size to be configurable#1677
chandra-siri merged 17 commits into
mainfrom
configurable_flush_interval

Conversation

@chandra-siri

Copy link
Copy Markdown
Collaborator

feat: make flush size to be configurable

@product-auto-label product-auto-label Bot added size: l Pull request size is large. api: storage Issues related to the googleapis/python-storage API. labels Dec 18, 2025
@chandra-siri chandra-siri changed the base branch from main to sys_test_large_obj December 18, 2025 15:14
@gemini-code-assist

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a configurable flush size for the AsyncAppendableObjectWriter, which is a valuable enhancement. The implementation correctly introduces writer_options to pass the configuration and adds necessary validation logic. The system tests for the new functionality are also a great addition. My review includes a few suggestions to improve the code further, primarily by adding unit tests for the new validation logic to ensure its correctness and prevent regressions, along with some minor code cleanup and improvements to the validation code itself.

Comment thread google/cloud/storage/_experimental/asyncio/async_appendable_object_writer.py Outdated
Comment thread google/cloud/storage/_experimental/asyncio/async_appendable_object_writer.py Outdated
@product-auto-label product-auto-label Bot added size: m Pull request size is medium. and removed size: l Pull request size is large. labels Dec 18, 2025
@chandra-siri

Copy link
Copy Markdown
Collaborator Author

/gcbrun(df42160)

@chandra-siri chandra-siri marked this pull request as ready for review December 18, 2025 17:34
@chandra-siri chandra-siri requested review from a team December 18, 2025 17:34
@chandra-siri chandra-siri requested a review from a team as a code owner December 18, 2025 17:34
Comment thread tests/unit/asyncio/test_async_appendable_object_writer.py Outdated
@chandra-siri

Copy link
Copy Markdown
Collaborator Author

/gcbrun(8f3c2be)

suni72
suni72 previously approved these changes Dec 19, 2025
Base automatically changed from sys_test_large_obj to main December 19, 2025 14:52
@chandra-siri chandra-siri dismissed suni72’s stale review December 19, 2025 14:52

The base branch was changed.

@chandra-siri

Copy link
Copy Markdown
Collaborator Author

@chandra-siri chandra-siri merged commit f7095fa into main Dec 19, 2025
16 of 17 checks passed
@chandra-siri chandra-siri deleted the configurable_flush_interval branch December 19, 2025 16:43
vchudnov-g added a commit that referenced this pull request Jan 13, 2026
PR created by the Librarian CLI to initialize a release. Merging this PR
will auto trigger a release.

Librarian Version: v0.7.0
Language Image:
us-central1-docker.pkg.dev/cloud-sdk-librarian-prod/images-prod/python-librarian-generator@sha256:8e2c32496077054105bd06c54a59d6a6694287bc053588e24debe6da6920ad91
<details><summary>google-cloud-storage: 3.8.0</summary>

##
[3.8.0](v3.7.0...v3.8.0)
(2026-01-13)

### Features

* expose persisted size in mrd (#1671)
([0e2961b](0e2961be))

* implement &#34;append_from_file&#34; (#1686)
([1333c95](1333c956))

* compute chunk wise checksum for bidi_writes (#1675)
([139390c](139390cb))

* flush the last chunk in append method (#1699)
([89bfe7a](89bfe7a5))

* add write resumption strategy (#1663)
([a57ea0e](a57ea0ec))

* add bidi stream retry manager. (#1632)
([d90f0ee](d90f0ee0))

* make flush size configurable (#1677)
([f7095fa](f7095faf))

### Bug Fixes

* no state lookup while opening bidi-write stream
([2d5a7b1](2d5a7b16))

* no state lookup while opening bidi-write stream (#1636)
([2d5a7b1](2d5a7b16))

* close write object stream always (#1661)
([4a609a4](4a609a4b))

* add system test for opening with read_handle (#1672)
([6dc711d](6dc711da))

</details>

---------

Co-authored-by: Victor Chudnovsky <vchudnov@google.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

api: storage Issues related to the googleapis/python-storage API. size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants