Restore broken_determinism to ignore_problems in functions stress test by alexey-milovidov · Pull Request #105144 · ClickHouse/ClickHouse · GitHub
Skip to content

Restore broken_determinism to ignore_problems in functions stress test#105144

Closed
alexey-milovidov wants to merge 1 commit into
masterfrom
disable-broken-determinism-stress-check
Closed

Restore broken_determinism to ignore_problems in functions stress test#105144
alexey-milovidov wants to merge 1 commit into
masterfrom
disable-broken-determinism-stress-check

Conversation

@alexey-milovidov

Copy link
Copy Markdown
Member

The check was removed from the default ignore list on 2026-05-12 in 519276200b5 ("Enforce broken_determinism in the functions stress test"). Since then the function_prop_fuzzer job on master surfaces dozens of determinism mismatches per day across many functions (caseWithExpression, if, substringUTF8, roundDown, arrayUnion, coalesce, ifNull, rightUTF8, nullIf, equals, ...).

These are pre-existing issues that pre-date the enforcement; they cannot all be fixed at once and the noise drowns out other regressions caught by the same job (stuck workers, timeout_not_honored, etc.). Re-add broken_determinism to the default ignore list, keeping it controllable via --ignore-problems for targeted work as the underlying issues are addressed one at a time.

Changelog category (leave one):

  • CI Fix or Improvement (changelog entry is not required)

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

...

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

The check was removed from the ignore list on 2026-05-12 in 5192762
("Enforce broken_determinism in the functions stress test"). Since then
the `function_prop_fuzzer` job on master surfaces dozens of determinism
mismatches per day across many functions (`caseWithExpression`, `if`,
`substringUTF8`, `roundDown`, `arrayUnion`, `coalesce`, `ifNull`,
`rightUTF8`, `nullIf`, `equals`, ...). These are pre-existing issues
that pre-date the enforcement and cannot be fixed in one go; until they
are individually addressed the noise drowns out other regressions caught
by the same job. Re-add `broken_determinism` to the default ignore list,
keeping it controllable via `--ignore-problems` for targeted work.
@clickhouse-gh

clickhouse-gh Bot commented May 17, 2026

Copy link
Copy Markdown
Contributor

@clickhouse-gh

clickhouse-gh Bot commented May 17, 2026

Copy link
Copy Markdown
Contributor

LLVM Coverage Report

Metric Baseline Current Δ
Lines 84.10% 84.10% +0.00%
Functions 91.40% 91.40% +0.00%
Branches 76.50% 76.60% +0.10%

Changed lines: N/A (no coverable changed lines) · Uncovered code

Full report · Diff report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant