Skip to content

Fixing flaky pages assertions in the AbstractAdvancedBrokerTest#loginWithExistingUserWithBruteForceEnabled - #52141

Merged
mposolda merged 1 commit into
keycloak:mainfrom
lhanusov:51600/kcoidcbrokertest-flaky
Aug 28, 2026
Merged

mposolda merged 1 commit into
keycloak:mainfrom
lhanusov:51600/kcoidcbrokertest-flaky

Conversation

@lhanusov

@lhanusov lhanusov commented Aug 27, 2026 •

Copy link
Copy Markdown
Contributor

Closes #51600

Copilot AI balanced review requested due to automatic review settings August 27, 2026 13:22
@lhanusov
lhanusov requested review from a team as code owners August 27, 2026 13:22
@lhanusov
lhanusov force-pushed the 51600/kcoidcbrokertest-flaky branch from 6e698c2 to 18beb5f Compare August 27, 2026 13:23

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Replaces flaky title-based waits with stable page-object assertions in the broker brute-force test.

Changes:

  • Uses page IDs to verify login and error pages.
  • Removes redundant element-enabled waits.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Copilot AI review requested due to automatic review settings August 27, 2026 13:25
@lhanusov lhanusov self-assigned this Aug 27, 2026
@lhanusov lhanusov added area/testsuite Test suites — flaky/failing tests, CI test config, test migration team/core-protocols labels Aug 27, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

log.debug(driver.getPageSource());
Assertions.fail("Timeout while waiting for login page");
}
loginPage.assertCurrent();
…WithExistingUserWithBruteForceEnabled

Signed-off-by: Lukas Hanusovsky <lhanusov@redhat.com>
Copilot AI review requested due to automatic review settings August 27, 2026 14:10
@lhanusov
lhanusov force-pushed the 51600/kcoidcbrokertest-flaky branch from 18beb5f to dbe2e29 Compare August 27, 2026 14:10

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.

@mposolda mposolda left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lhanusov Thanks

@keycloak-github-bot keycloak-github-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unreported flaky test detected, please review

@keycloak-github-bot

Copy link
Copy Markdown

Unreported flaky test detected

If the flaky tests below are affected by the changes, please review and update the changes accordingly. Otherwise, a maintainer should report the flaky tests prior to merging the PR.

org.keycloak.testsuite.adapter.servlet.SAMLClockSkewAdapterTest#testTokenTimeIsValid

Keycloak CI - Adapter IT Strict Cookies

org.jboss.arquillian.graphene.enricher.exception.PageObjectInitializationException: 
Can not instantiate Page Object 
class org.keycloak.testsuite.adapter.page.SalesPostClockSkewServlet
 declared in: 
org.keycloak.testsuite.adapter.servlet.SAMLClockSkewAdapterTest
...

Report flaky test

@keycloak-github-bot keycloak-github-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unreported flaky test detected, please review

@keycloak-github-bot

Copy link
Copy Markdown

Unreported flaky test detected

If the flaky tests below are affected by the changes, please review and update the changes accordingly. Otherwise, a maintainer should report the flaky tests prior to merging the PR.

org.keycloak.testsuite.adapter.servlet.SAMLClockSkewAdapterTest#testTokenTimeIsValid

Keycloak CI - Adapter IT Strict Cookies

org.jboss.arquillian.graphene.enricher.exception.PageObjectInitializationException: 
Can not instantiate Page Object 
class org.keycloak.testsuite.adapter.page.SalesPostClockSkewServlet
 declared in: 
org.keycloak.testsuite.adapter.servlet.SAMLClockSkewAdapterTest
...

Report flaky test

@mposolda
mposolda merged commit 2d98e19 into keycloak:main Aug 28, 2026
148 of 153 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/testsuite Test suites — flaky/failing tests, CI test config, test migration flaky-test team/core-protocols

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Flaky test: org.keycloak.testsuite.broker.KcOidcBrokerTest#loginWithExistingUserWithBruteForceEnabled

3 participants