Enable `SessionPool` persistence by default · Issue #2310 · apify/crawlee-python · GitHub
Skip to content

Enable SessionPool persistence by default #2310

Open

Description

@vdusek

The crawler's default session pool is SessionPool() with persistence_enabled=False (_basic_crawler.py, sessions/_session_pool.py), so sessions and their cookies are lost on migration. In JS v4, session pool persistence is on by default.

Turn persistence on by default, with a persistence key derived from the crawler ID, so that several crawlers in one process do not overwrite each other's state.

This will be a breaking change.

JS implementation: apify/crawlee#4068. Related: #2301 (ownership of injected pools), #2298 (proxy persisted with the session).

✍️ Drafted by Claude Code

Activity

  1. added this to the 2.0 milestone on Oct 13, 2026
  2. added
    enhancementNew feature or request.
    t-toolingIssues with this label are in the ownership of the tooling team.
    on Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions