feat: support configurable Serper-compatible search endpoints by litescraper · Pull Request #4079 · deepset-ai/haystack-core-integrations · GitHub
Skip to content

feat: support configurable Serper-compatible search endpoints - #4079

Open
litescraper wants to merge 1 commit into
deepset-ai:mainfrom
litescraper:feat/serper-base-url
Open

litescraper wants to merge 1 commit into
deepset-ai:mainfrom
litescraper:feat/serper-base-url

Conversation

@litescraper

Copy link
Copy Markdown

Related Issues

None.

Proposed Changes

Allow Haystack users to choose a Serper-compatible search provider without modifying component source code. This lets users select a provider that fits their budget or deployment requirements.

Set SERPERDEV_BASE_URL to the provider’s base URL and configure SERPERDEV_API_KEY. The component removes trailing slashes and appends /search. Both synchronous and asynchronous searches use the configured endpoint.

Support any Serper.dev-compatible endpoint (like litescrape.com, serpbase.dev, serpensapi.org, and others).

When the setting is omitted, the component continues using its existing Serper endpoint. Authentication, request payloads, timeouts, and result processing remain unchanged.

How did you test it?

  • 21 existing tests passed; 2 tests were deselected.
  • Type, lint, and formatting checks passed.
  • Actual synchronous and asynchronous component calls passed against a local HTTP fixture.
  • Both execution paths were tested end to end with a real Serper-compatible endpoint, including returned links and Haystack documents.

Notes for the reviewer

The change is limited to endpoint selection and its documentation. No tests were added.

@litescraper
litescraper requested a review from a team as a code owner October 8, 2026 18:01
@litescraper
litescraper requested review from bogdankostic and removed request for a team October 8, 2026 18:01
@CLAassistant

CLAassistant commented Oct 8, 2026 •

Copy link
Copy Markdown

@github-actions github-actions Bot added the type:documentation Improvements or additions to documentation label Oct 8, 2026
@github-actions

github-actions Bot commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

Heads-up for maintainers

This PR is from a fork and touches integrations whose integration tests require API keys.
Those tests are skipped in CI because fork PRs don't have access to repo secrets for security reasons.

Affected integrations:

  • serperdev

Please run the integration tests locally (hatch run test:integration inside each folder) before approving.

@github-actions

github-actions Bot commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

Coverage report (serperdev)

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  integrations/serperdev/src/haystack_integrations/components/websearch/serperdev
  websearch.py
Project Total  

This report was generated by python-coverage-comment-action

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration:serperdev type:documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants