Skip to content

test(scenario-5): persistent flake max attempts [mock:flake_fail] - #873

Open
oxve wants to merge 8 commits into
mainfrom
test/scenario-5-persistent-flake
Open

test(scenario-5): persistent flake max attempts [mock:flake_fail]#873
oxve wants to merge 8 commits into
mainfrom
test/scenario-5-persistent-flake

Conversation

@oxve

@oxve oxve commented Aug 19, 2026

Copy link
Copy Markdown
Member

Scenario 5 Persistent Flake Max Attempts PR
oxve added 8 commits August 19, 2026 04:34
@oxve
ci: Deploy CI Shepherd workflow and mock test runner on sandbox
cfd7e24 
- Implement CI Shepherd workflow (ci_shepherd.yml) triggered by workflow_run on android, aosp, evergreen, linux, and tvos.
- Add automatic test deflaking with configurable MAX_ATTEMPTS.
- Implement combined status report collation across triggering workflows.
- Post and update sticky PR comments with workflow status table.
- Replace deflake_tests.yml with CI Shepherd.
- Implement lightweight mock test execution layer in main.yaml supporting directives [mock:pass], [mock:build_fail], [mock:test_fail], [mock:flake], and [mock:flake_fail].

Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
test(scenario-1): single platform clean pass [mock:pass]
7fad4ed 
Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
ci: Fix expression syntax in ci_shepherd.yml
2a32a8c 
- Replace length() expression with toJSON(pull_requests) != '[]'
- Quote workflow names in workflow_run trigger

Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
ci: Use robust gh api PR commenting in ci_shepherd.yml
12d2729 
- Extract PR number via jq safely inside bash step
- Update or create sticky comment with header <!-- sticky-pull-request-comment: combined-ci-report -->
- Avoid expression syntax evaluation errors on push events

Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
ci: Actionlint fixes for main.yaml and ci_shepherd.yml
147bb1a 
Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
test(scenario-1): single platform clean pass [mock:pass]
06a602a 
Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
ci: Update tvos.yaml to reuse main.yaml for mock testing
864a2fb 
Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@oxve
test(scenario-5): persistent flake max attempts [mock:flake_fail]
0e21f57 
Tag: agy
Conv: 1eb97109-4aab-4416-8d63-33cae29cd5d6
@github-actions

github-actions Bot commented Aug 19, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Combined CI Status Report

❌ All checks have completed. Nothing is running.

Workflow Status Details
CI / android ❌ FAIL Failed
CI / aosp ❌ FAIL Failed
CI / evergreen ❌ FAIL Failed
CI / linux ❌ FAIL Failed
CI / tvos ❌ FAIL Failed
@github-actions

github-actions Bot commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

Combined CI Status Report

⏳ Checks are running...

Workflow Status Details
CI / aosp ⏳ PENDING Checks are running
CI / evergreen ⏳ PENDING Checks are running
@github-actions

github-actions Bot commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

🤖 Gemini Suggested Commit Message

cobalt: Add scenario 5 persistent flake test

Add a new scenario file to evaluate the handling of persistent flake
failures. This enables verification of system behavior when tests
consistently fail and reach the maximum number of retry attempts.

Bug: None

💡 Pro Tips for a Better Commit Message:

  1. Influence the Result: Want to change the output? You can write custom prompts or instructions directly in the Pull Request description. The model uses that text to generate the message.
  2. Re-run the Generator: Post a comment with: /generate-commit-message
gemini-code-assist[bot]
gemini-code-assist Bot reviewed Aug 19, 2026
View reviewed changes

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the cobalt/scenario_5.txt file by adding a single line representing a persistent flake test with a timestamp. There are no review comments, and we have no feedback to provide.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kokoro:run

1 participant

@oxve