Skip to content

Fix flakiness in runIndexCleanerTest by filtering Jaeger indices #7004

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 10, 2025

Conversation

0xShubhamSolanki
Copy link
Contributor

RESOLVE #7002
issue: - The test runIndexCleanerTest was flaky because it included unrelated system indices (e.g., top_queries-2025.04.08-51429).

Description of the changes

  • Added strings import to use strings.HasPrefix.
  • Filtered indices to only include those starting with prefixWithSeparator + "jaeger-".
  • Updated the assertion to use filteredIndices instead of raw indices.

Impact: Ensures the test only checks relevant Jaeger indices, improving reliability.

Checklist

Signed-off-by: Yuri Shkuro <[email protected]>
Copy link
Member

@yurishkuro yurishkuro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I simplified a bit

@yurishkuro yurishkuro added the changelog:ci Change related to continuous integration / testing label Apr 10, 2025
@yurishkuro yurishkuro enabled auto-merge April 10, 2025 02:47
Copy link

codecov bot commented Apr 10, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.96%. Comparing base (d12f1f9) to head (b792c18).
Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #7004      +/-   ##
==========================================
- Coverage   95.99%   95.96%   -0.04%     
==========================================
  Files         346      346              
  Lines       20507    20552      +45     
==========================================
+ Hits        19686    19722      +36     
- Misses        618      626       +8     
- Partials      203      204       +1     
Flag Coverage Δ
badger_v1 10.48% <ø> (-0.05%) ⬇️
badger_v2 2.17% <ø> (-0.02%) ⬇️
cassandra-4.x-v1-manual 15.77% <ø> (-0.08%) ⬇️
cassandra-4.x-v2-auto 2.16% <ø> (-0.02%) ⬇️
cassandra-4.x-v2-manual 2.16% <ø> (-0.02%) ⬇️
cassandra-5.x-v1-manual 15.77% <ø> (-0.08%) ⬇️
cassandra-5.x-v2-auto 2.16% <ø> (-0.02%) ⬇️
cassandra-5.x-v2-manual 2.16% <ø> (-0.02%) ⬇️
elasticsearch-6.x-v1 20.87% <ø> (+0.11%) ⬆️
elasticsearch-7.x-v1 20.95% <ø> (+0.11%) ⬆️
elasticsearch-8.x-v1 21.13% <ø> (+0.11%) ⬆️
elasticsearch-8.x-v2 2.17% <ø> (-0.02%) ⬇️
grpc_v1 11.56% <ø> (-0.06%) ⬇️
grpc_v2 8.43% <ø> (-0.05%) ⬇️
kafka-3.x-v1 10.77% <ø> (-0.06%) ⬇️
kafka-3.x-v2 2.17% <ø> (-0.02%) ⬇️
memory_v2 2.17% <ø> (-0.02%) ⬇️
opensearch-1.x-v1 21.00% <ø> (+0.11%) ⬆️
opensearch-2.x-v1 21.00% <ø> (+0.11%) ⬆️
opensearch-2.x-v2 2.17% <ø> (-0.02%) ⬇️
tailsampling-processor 0.59% <ø> (-0.01%) ⬇️
unittests 94.76% <ø> (-0.04%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@yurishkuro yurishkuro added this pull request to the merge queue Apr 10, 2025
Merged via the queue into jaegertracing:main with commit ef87405 Apr 10, 2025
56 of 57 checks passed
@yurishkuro
Copy link
Member

Thanks!

@0xShubhamSolanki 0xShubhamSolanki deleted the fix-flaky-test branch April 10, 2025 06:28
@0xShubhamSolanki
Copy link
Contributor Author

Thanks!

"You're welcome! Let me know if there are any other issues I can pick up."

@yurishkuro
Copy link
Member

Anything with help wanted label

amilbcahat pushed a commit to amilbcahat/jaeger that referenced this pull request May 4, 2025
…gertracing#7004)

RESOLVE jaegertracing#7002
**issue:** - The test `runIndexCleanerTest` was flaky because it
included unrelated system indices (e.g.,
`top_queries-2025.04.08-51429`).

## Description of the changes
- Added `strings` import to use `strings.HasPrefix`.
- Filtered indices to only include those starting with
`prefixWithSeparator + "jaeger-"`.
- Updated the assertion to use `filteredIndices` instead of raw
`indices`.

**Impact:** Ensures the test only checks relevant Jaeger indices,
improving reliability.

## Checklist
- [✓]I have read
https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
- [✓] I have signed all commits
- [  ] I have added unit tests for the new functionality
- [✓]I have run lint and test steps successfully
  - for `jaeger`: `make lint test`
  - for `jaeger-ui`: `npm run lint` and `npm run test`

---------

Signed-off-by: Shubham Solanki <[email protected]>
Signed-off-by: Yuri Shkuro <[email protected]>
Co-authored-by: Yuri Shkuro <[email protected]>
amilbcahat pushed a commit to amilbcahat/jaeger that referenced this pull request May 4, 2025
…gertracing#7004)

RESOLVE jaegertracing#7002
**issue:** - The test `runIndexCleanerTest` was flaky because it
included unrelated system indices (e.g.,
`top_queries-2025.04.08-51429`).

## Description of the changes
- Added `strings` import to use `strings.HasPrefix`.
- Filtered indices to only include those starting with
`prefixWithSeparator + "jaeger-"`.
- Updated the assertion to use `filteredIndices` instead of raw
`indices`.

**Impact:** Ensures the test only checks relevant Jaeger indices,
improving reliability.

## Checklist
- [✓]I have read
https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
- [✓] I have signed all commits
- [  ] I have added unit tests for the new functionality
- [✓]I have run lint and test steps successfully
  - for `jaeger`: `make lint test`
  - for `jaeger-ui`: `npm run lint` and `npm run test`

---------

Signed-off-by: Shubham Solanki <[email protected]>
Signed-off-by: Yuri Shkuro <[email protected]>
Co-authored-by: Yuri Shkuro <[email protected]>
Signed-off-by: amol-verma-allen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog:ci Change related to continuous integration / testing storage/elasticsearch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug]: Flaky e2e tests for OpenSearch
2 participants