pipeline-manager: storage status details by snkas · Pull Request #6046 · feldera/feldera · GitHub
Skip to content

pipeline-manager: storage status details#6046

Merged
snkas merged 1 commit intomainfrom
pipeline-storage-status-details
Apr 20, 2026
Merged

pipeline-manager: storage status details#6046
snkas merged 1 commit intomainfrom
pipeline-storage-status-details

Conversation

@snkas
Copy link
Copy Markdown
Contributor

@snkas snkas commented Apr 15, 2026

This makes the following three main changes.

  1. (New) Details about the storage status (notably, the checkpoints) are added as a pipeline field (storage_status_details). It provides useful information specifically about the storage, and continues to be available even after the pipeline has stopped (unlike runtime status details). It is cleared when storage is cleared. The suspend_info field is removed, as it is now obsolete and was never user-facing.

  2. (Fix) Dedicated error BootstrapPolicyImmutableUnlessStopped for when the bootstrap policy is changed by again calling /start with a different bootstrap policy.

  3. (Refactor) Parsing of rows is refactored to improve reusability.

PR information

  • Manual test plan: started it locally, ran the Python tests manually, opened the API endpoints in browser to check
  • Unit tests added/updated
  • Integration tests added/updated
  • Documentation updated
  • Changelog updated
  • Breaking changes: none, though the database migration means that rolling back to an earlier version of Feldera won't be possible

@snkas snkas force-pushed the pipeline-storage-status-details branch from caa67c4 to 87b85e4 Compare April 15, 2026 12:04
Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs blocker, see inline.

Comment thread crates/pipeline-manager/src/api/endpoints/pipeline_management.rs
@snkas snkas requested a review from mythical-fred April 15, 2026 12:06
@snkas snkas force-pushed the pipeline-storage-status-details branch from 1a62c63 to b103d1c Compare April 15, 2026 15:48
@snkas
Copy link
Copy Markdown
Contributor Author

snkas commented Apr 15, 2026

@snkas snkas requested review from gz and mythical-fred and removed request for mythical-fred April 15, 2026 16:39
@snkas snkas force-pushed the pipeline-storage-status-details branch from b103d1c to 2fa1e9a Compare April 17, 2026 08:53
This makes the following three main changes.

1. (New) Details about the storage status (notably, the checkpoints)
   are added as a pipeline field (`storage_status_details`). It provides
   useful information specifically about the storage, and continues to
   be available even after the pipeline has stopped (unlike runtime
   status details). It is cleared when storage is cleared. The
   `suspend_info` field is removed, as it is now obsolete and was never
   user-facing.

2. (Fix) Dedicated error `BootstrapPolicyImmutableUnlessStopped` for
   when the bootstrap policy is changed by again calling `/start` with a
   different bootstrap policy.

3. (Refactor) Parsing of rows is refactored to improve reusability.

Signed-off-by: Simon Kassing <simon.kassing@feldera.com>
@snkas snkas force-pushed the pipeline-storage-status-details branch from 2fa1e9a to 6554480 Compare April 20, 2026 09:08
Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@snkas snkas added this pull request to the merge queue Apr 20, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Apr 20, 2026
@snkas snkas added this pull request to the merge queue Apr 20, 2026
Merged via the queue into main with commit 75e4e73 Apr 20, 2026
40 checks passed
@snkas snkas deleted the pipeline-storage-status-details branch April 20, 2026 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants