Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Update the VLLM FIM test to be more predictable #1269

Merged
merged 2 commits into from
Mar 12, 2025
Merged

Update the VLLM FIM test to be more predictable #1269

merged 2 commits into from
Mar 12, 2025

Conversation

rdimitrov
Copy link
Member

The VLLM/Ollama tests have always been too flaky, mainly due to the size of the models we are using there (0.5B). This should hopefully improve this.

Another thing I noticed was sometimes part of the tests are executed twice for no apparent reason, but I'd address this in a separate PR if I can figure out why it happens.

Copy link
Contributor

@jhrozek jhrozek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you!

@jhrozek jhrozek merged commit f8fc579 into main Mar 12, 2025
58 of 59 checks passed
@jhrozek jhrozek deleted the fix-tests branch March 12, 2025 21:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants