Streaming from/into key-value store records · Issue #1931 · apify/crawlee-python · GitHub
Skip to content

Streaming from/into key-value store records #1931

Description

@janbuchar

When handling large values inside the key-value store, it would be convenient to expose some way to stream them into/out of the store without having to buffer it in memory.

On the javascript side, this is currently mostly supported — KeyValueStore.setValue accepts a stream as value, but to retrieve a value as a stream, you need to call the getRecord method directly on the underlying resource client.

For the eventual Python version, we should probably match the signature of apify-client-python's streamRecord.

Related

Activity

  1. added theissue type on Jun 1, 2026
  2. added
    solutioningThe issue is not being implemented but only analyzed and planned.
    on Jun 1, 2026
  3. added
    t-toolingIssues with this label are in the ownership of the tooling team.
    on Jun 1, 2026
  4. added this to the 2.0 milestone on Oct 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    solutioningThe issue is not being implemented but only analyzed and planned.t-toolingIssues with this label are in the ownership of the tooling team.

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions