Skip to content

Conversation

@emmettbutler
Copy link
Collaborator

@emmettbutler emmettbutler commented Dec 22, 2025

This change moves the lib injection sitecustomize tests from github actions to gitlab in the interest of reducing this repo's dependence on github actions.

@emmettbutler emmettbutler requested review from a team as code owners December 22, 2025 19:24
@emmettbutler emmettbutler marked this pull request as draft December 22, 2025 19:24
@github-actions
Copy link
Contributor

github-actions bot commented Dec 22, 2025

CODEOWNERS have been resolved as:

.gitlab-ci.yml                                                          @DataDog/python-guild @DataDog/apm-core-python
.github/workflows/test_lib_injection.yml                                @DataDog/python-guild @DataDog/apm-core-python

Copy link
Member

@brettlangdon brettlangdon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

questions and nits, nothing really blocking

@emmettbutler emmettbutler changed the title Emmett.butler/lib injection tests ci: migration lib injection tests to gitlab Dec 22, 2025
@emmettbutler emmettbutler added the changelog/no-changelog A changelog entry is not required for this PR. label Dec 22, 2025
@emmettbutler emmettbutler changed the title ci: migration lib injection tests to gitlab ci: migrate lib injection tests to gitlab Dec 22, 2025
@emmettbutler emmettbutler marked this pull request as ready for review December 22, 2025 19:45
@emmettbutler emmettbutler marked this pull request as draft December 22, 2025 20:22
@emmettbutler emmettbutler marked this pull request as ready for review December 22, 2025 20:50
@pr-commenter
Copy link

pr-commenter bot commented Dec 22, 2025

Performance SLOs

Comparing candidate emmett.butler/lib-injection-tests (dc6ab0f) with baseline main (7c7d690)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 18.041µs (SLO: <20.000µs -9.8%) vs baseline: 📈 +21.0%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +5.0%


✅ add_inplace_aspect

Time: ✅ 15.031µs (SLO: <20.000µs 📉 -24.8%) vs baseline: +0.4%

Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +5.1%


✅ add_inplace_noaspect

Time: ✅ 0.345µs (SLO: <10.000µs 📉 -96.6%) vs baseline: +0.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ add_noaspect

Time: ✅ 0.544µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -1.2%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ bytearray_aspect

Time: ✅ 18.051µs (SLO: <30.000µs 📉 -39.8%) vs baseline: ~same

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ bytearray_extend_aspect

Time: ✅ 23.844µs (SLO: <30.000µs 📉 -20.5%) vs baseline: -0.2%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ bytearray_extend_noaspect

Time: ✅ 2.748µs (SLO: <10.000µs 📉 -72.5%) vs baseline: +0.2%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.0%


✅ bytearray_noaspect

Time: ✅ 1.468µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -0.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ bytes_aspect

Time: ✅ 16.697µs (SLO: <20.000µs 📉 -16.5%) vs baseline: -0.1%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ bytes_noaspect

Time: ✅ 1.426µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +0.1%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ bytesio_aspect

Time: ✅ 55.853µs (SLO: <70.000µs 📉 -20.2%) vs baseline: -0.2%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ bytesio_noaspect

Time: ✅ 3.267µs (SLO: <10.000µs 📉 -67.3%) vs baseline: -0.8%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ capitalize_aspect

Time: ✅ 14.698µs (SLO: <20.000µs 📉 -26.5%) vs baseline: +0.2%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ capitalize_noaspect

Time: ✅ 2.572µs (SLO: <10.000µs 📉 -74.3%) vs baseline: -1.3%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.9%


✅ casefold_aspect

Time: ✅ 14.701µs (SLO: <20.000µs 📉 -26.5%) vs baseline: -0.5%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.9%


✅ casefold_noaspect

Time: ✅ 3.149µs (SLO: <10.000µs 📉 -68.5%) vs baseline: -0.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ decode_aspect

Time: ✅ 15.641µs (SLO: <30.000µs 📉 -47.9%) vs baseline: +0.3%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ decode_noaspect

Time: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -1.6%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ encode_aspect

Time: ✅ 18.190µs (SLO: <30.000µs 📉 -39.4%) vs baseline: 📈 +22.0%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.1%


✅ encode_noaspect

Time: ✅ 1.512µs (SLO: <10.000µs 📉 -84.9%) vs baseline: +1.5%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8%


✅ format_aspect

Time: ✅ 171.385µs (SLO: <200.000µs 📉 -14.3%) vs baseline: +0.4%

Memory: ✅ 42.644MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%


✅ format_map_aspect

Time: ✅ 190.938µs (SLO: <200.000µs -4.5%) vs baseline: ~same

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.6%


✅ format_map_noaspect

Time: ✅ 3.807µs (SLO: <10.000µs 📉 -61.9%) vs baseline: +1.4%

Memory: ✅ 42.684MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +5.1%


✅ format_noaspect

Time: ✅ 3.153µs (SLO: <10.000µs 📉 -68.5%) vs baseline: +0.4%

Memory: ✅ 42.526MB (SLO: <43.250MB 🟡 -1.7%) vs baseline: +4.6%


✅ index_aspect

Time: ✅ 15.424µs (SLO: <20.000µs 📉 -22.9%) vs baseline: -0.2%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.9%


✅ index_noaspect

Time: ✅ 0.468µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +1.0%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8%


✅ join_aspect

Time: ✅ 17.088µs (SLO: <20.000µs 📉 -14.6%) vs baseline: -1.3%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ join_noaspect

Time: ✅ 1.538µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -1.7%

Memory: ✅ 42.566MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.8%


✅ ljust_aspect

Time: ✅ 20.880µs (SLO: <30.000µs 📉 -30.4%) vs baseline: ~same

Memory: ✅ 42.546MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.5%


✅ ljust_noaspect

Time: ✅ 2.733µs (SLO: <10.000µs 📉 -72.7%) vs baseline: +1.9%

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%


✅ lower_aspect

Time: ✅ 17.975µs (SLO: <30.000µs 📉 -40.1%) vs baseline: +0.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ lower_noaspect

Time: ✅ 2.416µs (SLO: <10.000µs 📉 -75.8%) vs baseline: -0.8%

Memory: ✅ 42.546MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.8%


✅ lstrip_aspect

Time: ✅ 17.730µs (SLO: <30.000µs 📉 -40.9%) vs baseline: +0.2%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.8%


✅ lstrip_noaspect

Time: ✅ 1.863µs (SLO: <10.000µs 📉 -81.4%) vs baseline: +0.3%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ modulo_aspect

Time: ✅ 166.502µs (SLO: <200.000µs 📉 -16.7%) vs baseline: +0.5%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 180.409µs (SLO: <200.000µs -9.8%) vs baseline: +3.4%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ modulo_aspect_for_bytes

Time: ✅ 168.761µs (SLO: <200.000µs 📉 -15.6%) vs baseline: +0.1%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 171.938µs (SLO: <200.000µs 📉 -14.0%) vs baseline: -0.4%

Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1%


✅ modulo_noaspect

Time: ✅ 3.690µs (SLO: <10.000µs 📉 -63.1%) vs baseline: ~same

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ replace_aspect

Time: ✅ 212.325µs (SLO: <300.000µs 📉 -29.2%) vs baseline: ~same

Memory: ✅ 42.644MB (SLO: <44.000MB -3.1%) vs baseline: +4.8%


✅ replace_noaspect

Time: ✅ 2.908µs (SLO: <10.000µs 📉 -70.9%) vs baseline: +0.2%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ repr_aspect

Time: ✅ 1.419µs (SLO: <10.000µs 📉 -85.8%) vs baseline: -0.4%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ repr_noaspect

Time: ✅ 0.525µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.2%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1%


✅ rstrip_aspect

Time: ✅ 19.057µs (SLO: <30.000µs 📉 -36.5%) vs baseline: -0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ rstrip_noaspect

Time: ✅ 2.027µs (SLO: <10.000µs 📉 -79.7%) vs baseline: +4.4%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ slice_aspect

Time: ✅ 15.937µs (SLO: <20.000µs 📉 -20.3%) vs baseline: -0.2%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%


✅ slice_noaspect

Time: ✅ 0.597µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -1.2%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +5.1%


✅ stringio_aspect

Time: ✅ 54.390µs (SLO: <80.000µs 📉 -32.0%) vs baseline: -0.6%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


✅ stringio_noaspect

Time: ✅ 3.677µs (SLO: <10.000µs 📉 -63.2%) vs baseline: +0.7%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.9%


✅ strip_aspect

Time: ✅ 17.681µs (SLO: <20.000µs 📉 -11.6%) vs baseline: -0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ strip_noaspect

Time: ✅ 1.854µs (SLO: <10.000µs 📉 -81.5%) vs baseline: -1.5%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ swapcase_aspect

Time: ✅ 18.582µs (SLO: <30.000µs 📉 -38.1%) vs baseline: -0.4%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ swapcase_noaspect

Time: ✅ 2.776µs (SLO: <10.000µs 📉 -72.2%) vs baseline: -1.3%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%


✅ title_aspect

Time: ✅ 18.322µs (SLO: <30.000µs 📉 -38.9%) vs baseline: ~same

Memory: ✅ 42.644MB (SLO: <43.000MB 🟡 -0.8%) vs baseline: +5.1%


✅ title_noaspect

Time: ✅ 2.666µs (SLO: <10.000µs 📉 -73.3%) vs baseline: -0.9%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.4%


✅ translate_aspect

Time: ✅ 24.552µs (SLO: <30.000µs 📉 -18.2%) vs baseline: 📈 +19.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ translate_noaspect

Time: ✅ 4.352µs (SLO: <10.000µs 📉 -56.5%) vs baseline: -0.1%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ upper_aspect

Time: ✅ 18.039µs (SLO: <30.000µs 📉 -39.9%) vs baseline: -0.3%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ upper_noaspect

Time: ✅ 2.442µs (SLO: <10.000µs 📉 -75.6%) vs baseline: -0.4%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.159µs (SLO: <10.000µs 📉 -48.4%) vs baseline: 📈 +21.4%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7%


✅ ospathbasename_noaspect

Time: ✅ 4.330µs (SLO: <10.000µs 📉 -56.7%) vs baseline: +0.8%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ ospathjoin_aspect

Time: ✅ 6.250µs (SLO: <10.000µs 📉 -37.5%) vs baseline: -0.2%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ ospathjoin_noaspect

Time: ✅ 6.327µs (SLO: <10.000µs 📉 -36.7%) vs baseline: -0.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ ospathnormcase_aspect

Time: ✅ 3.565µs (SLO: <10.000µs 📉 -64.3%) vs baseline: +0.3%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.0%


✅ ospathnormcase_noaspect

Time: ✅ 3.630µs (SLO: <10.000µs 📉 -63.7%) vs baseline: +0.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ ospathsplit_aspect

Time: ✅ 4.886µs (SLO: <10.000µs 📉 -51.1%) vs baseline: -0.5%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ ospathsplit_noaspect

Time: ✅ 5.017µs (SLO: <10.000µs 📉 -49.8%) vs baseline: +0.7%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ ospathsplitdrive_aspect

Time: ✅ 3.763µs (SLO: <10.000µs 📉 -62.4%) vs baseline: ~same

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.746µs (SLO: <10.000µs 📉 -92.5%) vs baseline: -1.0%

Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.5%


✅ ospathsplitext_aspect

Time: ✅ 4.593µs (SLO: <10.000µs 📉 -54.1%) vs baseline: -0.6%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ ospathsplitext_noaspect

Time: ✅ 4.653µs (SLO: <10.000µs 📉 -53.5%) vs baseline: -0.1%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.363µs (SLO: <20.000µs 📉 -83.2%) vs baseline: 📈 +10.9%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.4%


✅ 1-count-metrics-100-times

Time: ✅ 198.962µs (SLO: <220.000µs -9.6%) vs baseline: -2.3%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%


✅ 1-distribution-metric-1-times

Time: ✅ 3.300µs (SLO: <20.000µs 📉 -83.5%) vs baseline: -2.6%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%


✅ 1-distribution-metrics-100-times

Time: ✅ 213.431µs (SLO: <230.000µs -7.2%) vs baseline: -1.9%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.3%


✅ 1-gauge-metric-1-times

Time: ✅ 2.204µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -1.0%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%


✅ 1-gauge-metrics-100-times

Time: ✅ 135.729µs (SLO: <150.000µs -9.5%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%


✅ 1-rate-metric-1-times

Time: ✅ 3.138µs (SLO: <20.000µs 📉 -84.3%) vs baseline: -1.9%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 211.660µs (SLO: <250.000µs 📉 -15.3%) vs baseline: -1.8%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ 100-count-metrics-100-times

Time: ✅ 19.869ms (SLO: <22.000ms -9.7%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.4%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.206ms (SLO: <2.550ms 📉 -13.5%) vs baseline: -1.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.8%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.405ms (SLO: <1.550ms -9.3%) vs baseline: +0.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%


✅ 100-rate-metrics-100-times

Time: ✅ 2.193ms (SLO: <2.550ms 📉 -14.0%) vs baseline: +1.0%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ flush-1-metric

Time: ✅ 4.583µs (SLO: <20.000µs 📉 -77.1%) vs baseline: +0.2%

Memory: ✅ 35.193MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.9%


✅ flush-100-metrics

Time: ✅ 173.891µs (SLO: <250.000µs 📉 -30.4%) vs baseline: +0.5%

Memory: ✅ 35.389MB (SLO: <35.500MB 🟡 -0.3%) vs baseline: +5.1%


✅ flush-1000-metrics

Time: ✅ 2.163ms (SLO: <2.500ms 📉 -13.5%) vs baseline: -0.3%

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9%

🟡 Near SLO Breach (17 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.236µs (SLO: <20.000µs 📉 -33.8%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ context_with_data_no_listeners

Time: ✅ 3.296µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +0.1%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ get_item_exists

Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ get_item_missing

Time: ✅ 0.637µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.4%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.4%


✅ set_item

Time: ✅ 24.074µs (SLO: <30.000µs 📉 -19.8%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.615ms (SLO: <22.300ms 📉 -12.0%) vs baseline: +0.2%

Memory: ✅ 68.341MB (SLO: <70.500MB -3.1%) vs baseline: +4.9%


✅ exception-replay-enabled

Time: ✅ 1.364ms (SLO: <1.450ms -6.0%) vs baseline: ~same

Memory: ✅ 66.434MB (SLO: <67.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ iast

Time: ✅ 19.602ms (SLO: <22.250ms 📉 -11.9%) vs baseline: ~same

Memory: ✅ 68.262MB (SLO: <70.000MB -2.5%) vs baseline: +4.7%


✅ profiler

Time: ✅ 14.752ms (SLO: <16.550ms 📉 -10.9%) vs baseline: -0.2%

Memory: ✅ 56.349MB (SLO: <57.500MB -2.0%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 19.388ms (SLO: <21.750ms 📉 -10.9%) vs baseline: -0.8%

Memory: ✅ 68.321MB (SLO: <70.500MB -3.1%) vs baseline: +4.9%


✅ span-code-origin

Time: ✅ 19.945ms (SLO: <28.200ms 📉 -29.3%) vs baseline: +0.3%

Memory: ✅ 68.251MB (SLO: <71.000MB -3.9%) vs baseline: +4.8%


✅ tracer

Time: ✅ 19.562ms (SLO: <21.750ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 68.380MB (SLO: <70.000MB -2.3%) vs baseline: +4.7%


✅ tracer-and-profiler

Time: ✅ 20.861ms (SLO: <23.500ms 📉 -11.2%) vs baseline: +0.2%

Memory: ✅ 69.383MB (SLO: <71.000MB -2.3%) vs baseline: +4.9%


✅ tracer-dont-create-db-spans

Time: ✅ 19.728ms (SLO: <21.500ms -8.2%) vs baseline: +0.4%

Memory: ✅ 68.380MB (SLO: <70.000MB -2.3%) vs baseline: +4.8%


✅ tracer-minimal

Time: ✅ 16.787ms (SLO: <17.500ms -4.1%) vs baseline: +0.5%

Memory: ✅ 68.321MB (SLO: <70.000MB -2.4%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 19.470ms (SLO: <21.750ms 📉 -10.5%) vs baseline: +0.4%

Memory: ✅ 68.380MB (SLO: <72.500MB -5.7%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 17.700ms (SLO: <19.650ms -9.9%) vs baseline: +0.2%

Memory: ✅ 68.341MB (SLO: <70.000MB -2.4%) vs baseline: +4.9%


✅ tracer-no-databases

Time: ✅ 19.197ms (SLO: <20.100ms -4.5%) vs baseline: -0.4%

Memory: ✅ 68.341MB (SLO: <70.000MB -2.4%) vs baseline: +4.9%


✅ tracer-no-middleware

Time: ✅ 19.318ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.2%

Memory: ✅ 68.361MB (SLO: <70.000MB -2.3%) vs baseline: +4.9%


✅ tracer-no-templates

Time: ✅ 19.500ms (SLO: <22.000ms 📉 -11.4%) vs baseline: +1.2%

Memory: ✅ 68.279MB (SLO: <70.500MB -3.2%) vs baseline: +4.7%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.284ms (SLO: <19.850ms 📉 -18.0%) vs baseline: ~same

Memory: ✅ 69.886MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 16.311ms (SLO: <19.400ms 📉 -15.9%) vs baseline: +0.2%

Memory: ✅ 69.907MB (SLO: <70.000MB 🟡 -0.1%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 16.279ms (SLO: <19.450ms 📉 -16.3%) vs baseline: ~same

Memory: ✅ 69.989MB (SLO: <70.000MB 🟡 ~same) vs baseline: +5.0%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.065ms (SLO: <2.300ms 📉 -10.2%) vs baseline: -0.4%

Memory: ✅ 55.876MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ errortracking-enabled-user

Time: ✅ 2.072ms (SLO: <2.250ms -7.9%) vs baseline: ~same

Memory: ✅ 55.935MB (SLO: <56.500MB 🟡 -1.0%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.065ms (SLO: <2.300ms 📉 -10.2%) vs baseline: ~same

Memory: ✅ 55.955MB (SLO: <56.500MB 🟡 -1.0%) vs baseline: +4.9%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.394ms (SLO: <4.750ms 📉 -28.5%) vs baseline: +0.7%

Memory: ✅ 55.803MB (SLO: <66.500MB 📉 -16.1%) vs baseline: +4.8%


✅ appsec-post

Time: ✅ 2.857ms (SLO: <6.750ms 📉 -57.7%) vs baseline: ~same

Memory: ✅ 55.930MB (SLO: <66.500MB 📉 -15.9%) vs baseline: +5.1%


✅ appsec-telemetry

Time: ✅ 3.401ms (SLO: <4.750ms 📉 -28.4%) vs baseline: +0.8%

Memory: ✅ 55.831MB (SLO: <66.500MB 📉 -16.0%) vs baseline: +4.7%


✅ debugger

Time: ✅ 1.872ms (SLO: <2.000ms -6.4%) vs baseline: ~same

Memory: ✅ 47.755MB (SLO: <49.500MB -3.5%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.857ms (SLO: <2.000ms -7.2%) vs baseline: ~same

Memory: ✅ 44.784MB (SLO: <49.000MB -8.6%) vs baseline: +4.7%


✅ profiler

Time: ✅ 1.859ms (SLO: <2.100ms 📉 -11.5%) vs baseline: -0.2%

Memory: ✅ 48.742MB (SLO: <50.000MB -2.5%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 3.353ms (SLO: <3.650ms -8.1%) vs baseline: +0.2%

Memory: ✅ 55.932MB (SLO: <56.000MB 🟡 -0.1%) vs baseline: +5.0%


✅ tracer

Time: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.2%

Memory: ✅ 55.966MB (SLO: <56.500MB 🟡 -0.9%) vs baseline: +5.0%


✅ tracer-native

Time: ✅ 3.367ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.888MB (SLO: <60.000MB -6.9%) vs baseline: +4.9%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.064ms (SLO: <4.200ms 📉 -50.9%) vs baseline: -0.2%

Memory: ✅ 55.915MB (SLO: <66.000MB 📉 -15.3%) vs baseline: +4.9%


✅ iast-enabled

Time: ✅ 2.071ms (SLO: <2.800ms 📉 -26.1%) vs baseline: +0.2%

Memory: ✅ 55.955MB (SLO: <62.500MB 📉 -10.5%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.058ms (SLO: <2.250ms -8.5%) vs baseline: ~same

Memory: ✅ 55.896MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.7%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.364µs (SLO: <100.000µs 📉 -18.6%) vs baseline: -0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ b3_headers

Time: ✅ 14.300µs (SLO: <20.000µs 📉 -28.5%) vs baseline: -1.0%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.5%


✅ b3_single_headers

Time: ✅ 13.426µs (SLO: <20.000µs 📉 -32.9%) vs baseline: -0.2%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.293µs (SLO: <80.000µs 📉 -19.6%) vs baseline: +0.1%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.529µs (SLO: <80.000µs 📉 -16.8%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ empty_headers

Time: ✅ 1.621µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.9%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.4%


✅ full_t_id_datadog_headers

Time: ✅ 22.703µs (SLO: <30.000µs 📉 -24.3%) vs baseline: -0.4%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ invalid_priority_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.4%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ invalid_span_id_header

Time: ✅ 6.561µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.5%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ invalid_tags_header

Time: ✅ 6.564µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.2%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ invalid_trace_id_header

Time: ✅ 6.541µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.3%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.3%


✅ large_header_no_matches

Time: ✅ 27.558µs (SLO: <30.000µs -8.1%) vs baseline: -0.1%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.2%


✅ large_valid_headers_all

Time: ✅ 28.740µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.1%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.909µs (SLO: <20.000µs 📉 -50.5%) vs baseline: +0.8%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.5%


✅ medium_valid_headers_all

Time: ✅ 11.305µs (SLO: <20.000µs 📉 -43.5%) vs baseline: +0.3%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ none_propagation_style

Time: ✅ 1.710µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -0.7%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ tracecontext_headers

Time: ✅ 35.065µs (SLO: <40.000µs 📉 -12.3%) vs baseline: +0.8%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ valid_headers_all

Time: ✅ 6.524µs (SLO: <10.000µs 📉 -34.8%) vs baseline: ~same

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ valid_headers_basic

Time: ✅ 6.116µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.6%


✅ wsgi_empty_headers

Time: ✅ 1.592µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ wsgi_invalid_priority_header

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: ~same

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ wsgi_invalid_tags_header

Time: ✅ 6.587µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.688µs (SLO: <10.000µs 📉 -33.1%) vs baseline: +1.6%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.2%


✅ wsgi_large_header_no_matches

Time: ✅ 28.660µs (SLO: <40.000µs 📉 -28.4%) vs baseline: -0.5%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.916µs (SLO: <40.000µs 📉 -25.2%) vs baseline: ~same

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.4%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.164µs (SLO: <20.000µs 📉 -49.2%) vs baseline: +0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.596µs (SLO: <20.000µs 📉 -42.0%) vs baseline: -0.3%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.2%


✅ wsgi_valid_headers_all

Time: ✅ 6.581µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.7%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ wsgi_valid_headers_basic

Time: ✅ 6.127µs (SLO: <10.000µs 📉 -38.7%) vs baseline: +0.8%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%


🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.173µs (SLO: <30.000µs 📉 -26.1%) vs baseline: +6.1%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ with_all

Time: ✅ 27.729µs (SLO: <40.000µs 📉 -30.7%) vs baseline: -0.4%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ with_dd_origin

Time: ✅ 24.681µs (SLO: <30.000µs 📉 -17.7%) vs baseline: +0.3%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 23.932µs (SLO: <40.000µs 📉 -40.2%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%


✅ with_sampling_priority

Time: ✅ 21.030µs (SLO: <30.000µs 📉 -29.9%) vs baseline: +0.5%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%


✅ with_tags

Time: ✅ 25.981µs (SLO: <40.000µs 📉 -35.0%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ with_tags_invalid

Time: ✅ 27.591µs (SLO: <40.000µs 📉 -31.0%) vs baseline: +0.8%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ with_tags_max_size

Time: ✅ 26.366µs (SLO: <40.000µs 📉 -34.1%) vs baseline: -0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%


🟡 iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 37.243µs (SLO: <40.000µs -6.9%) vs baseline: +6.2%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


✅ re_expand_noaspect

Time: ✅ 34.977µs (SLO: <40.000µs 📉 -12.6%) vs baseline: -0.2%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ re_findall_aspect

Time: ✅ 3.428µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +0.3%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_findall_noaspect

Time: ✅ 3.301µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +1.7%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1%


✅ re_finditer_aspect

Time: ✅ 4.490µs (SLO: <10.000µs 📉 -55.1%) vs baseline: -1.1%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.9%


✅ re_finditer_noaspect

Time: ✅ 3.299µs (SLO: <10.000µs 📉 -67.0%) vs baseline: ~same

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%


✅ re_fullmatch_aspect

Time: ✅ 2.807µs (SLO: <10.000µs 📉 -71.9%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


✅ re_fullmatch_noaspect

Time: ✅ 3.122µs (SLO: <10.000µs 📉 -68.8%) vs baseline: +1.3%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ re_group_aspect

Time: ✅ 4.804µs (SLO: <10.000µs 📉 -52.0%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ re_group_noaspect

Time: ✅ 4.912µs (SLO: <10.000µs 📉 -50.9%) vs baseline: +1.0%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +5.0%


✅ re_groups_aspect

Time: ✅ 4.947µs (SLO: <10.000µs 📉 -50.5%) vs baseline: -0.8%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%


✅ re_groups_noaspect

Time: ✅ 4.996µs (SLO: <10.000µs 📉 -50.0%) vs baseline: -0.3%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1%


✅ re_match_aspect

Time: ✅ 2.824µs (SLO: <10.000µs 📉 -71.8%) vs baseline: +0.5%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.9%


✅ re_match_noaspect

Time: ✅ 3.110µs (SLO: <10.000µs 📉 -68.9%) vs baseline: +0.6%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ re_search_aspect

Time: ✅ 2.682µs (SLO: <10.000µs 📉 -73.2%) vs baseline: +1.1%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ re_search_noaspect

Time: ✅ 2.913µs (SLO: <10.000µs 📉 -70.9%) vs baseline: +0.4%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.6%


✅ re_sub_aspect

Time: ✅ 3.547µs (SLO: <10.000µs 📉 -64.5%) vs baseline: -0.6%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ re_sub_noaspect

Time: ✅ 3.968µs (SLO: <10.000µs 📉 -60.3%) vs baseline: ~same

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ re_subn_aspect

Time: ✅ 3.963µs (SLO: <10.000µs 📉 -60.4%) vs baseline: +4.7%

Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.7%


✅ re_subn_noaspect

Time: ✅ 4.100µs (SLO: <10.000µs 📉 -59.0%) vs baseline: +0.4%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%


🟡 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +2.8%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%


✅ rsplit_noaspect

Time: ✅ 1.636µs (SLO: <10.000µs 📉 -83.6%) vs baseline: -0.3%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1%


✅ split_aspect

Time: ✅ 1.560µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +1.1%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ split_noaspect

Time: ✅ 1.611µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.7%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ splitlines_aspect

Time: ✅ 1.512µs (SLO: <10.000µs 📉 -84.9%) vs baseline: +0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%


✅ splitlines_noaspect

Time: ✅ 1.566µs (SLO: <10.000µs 📉 -84.3%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.228ms (SLO: <47.150ms 📉 -14.7%) vs baseline: -0.1%

Memory: ✅ 39.490MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 260.520ms (SLO: <344.800ms 📉 -24.4%) vs baseline: ~same

Memory: ✅ 43.850MB (SLO: <47.500MB -7.7%) vs baseline: +4.7%


✅ add-tags

Time: ✅ 315.482ms (SLO: <321.000ms 🟡 -1.7%) vs baseline: +0.3%

Memory: ✅ 43.709MB (SLO: <47.500MB -8.0%) vs baseline: +4.7%


✅ get-context

Time: ✅ 80.234ms (SLO: <92.350ms 📉 -13.1%) vs baseline: ~same

Memory: ✅ 39.914MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 37.796ms (SLO: <44.500ms 📉 -15.1%) vs baseline: -0.6%

Memory: ✅ 39.529MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 58.886ms (SLO: <67.650ms 📉 -13.0%) vs baseline: -0.2%

Memory: ✅ 40.033MB (SLO: <47.000MB 📉 -14.8%) vs baseline: +4.7%


✅ set-status

Time: ✅ 44.340ms (SLO: <50.400ms 📉 -12.0%) vs baseline: +0.2%

Memory: ✅ 39.469MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.6%


✅ start

Time: ✅ 37.872ms (SLO: <43.450ms 📉 -12.8%) vs baseline: +2.0%

Memory: ✅ 39.548MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +5.2%


✅ start-finish

Time: ✅ 82.726ms (SLO: <88.000ms -6.0%) vs baseline: ~same

Memory: ✅ 37.395MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 85.132ms (SLO: <89.000ms -4.3%) vs baseline: +0.8%

Memory: ✅ 37.395MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +4.7%


✅ update-name

Time: ✅ 38.626ms (SLO: <45.150ms 📉 -14.5%) vs baseline: -0.2%

Memory: ✅ 39.634MB (SLO: <47.000MB 📉 -15.7%) vs baseline: +4.7%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.372µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.5%

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.0%


✅ high_rate_limit

Time: ✅ 2.427µs (SLO: <10.000µs 📉 -75.7%) vs baseline: -0.5%

Memory: ✅ 35.173MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.9%


✅ long_window

Time: ✅ 2.359µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.4%

Memory: ✅ 35.173MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.8%


✅ low_rate_limit

Time: ✅ 2.366µs (SLO: <10.000µs 📉 -76.3%) vs baseline: -0.1%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ no_rate_limit

Time: ✅ 0.825µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -0.8%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.6%


✅ short_window

Time: ✅ 2.492µs (SLO: <10.000µs 📉 -75.1%) vs baseline: -0.2%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.5%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 309.372ms (SLO: <320.950ms -3.6%) vs baseline: -0.1%

Memory: ✅ 36.097MB (SLO: <36.500MB 🟡 -1.1%) vs baseline: +5.3%


✅ deep-profiled

Time: ✅ 315.460ms (SLO: <359.150ms 📉 -12.2%) vs baseline: +0.2%

Memory: ✅ 39.872MB (SLO: <40.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ medium

Time: ✅ 6.979ms (SLO: <7.400ms -5.7%) vs baseline: -0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%


✅ shallow

Time: ✅ 0.945ms (SLO: <1.050ms 📉 -10.0%) vs baseline: +0.8%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 137.147µs (SLO: <290.000µs 📉 -52.7%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%


✅ high_match

Time: ✅ 172.575µs (SLO: <480.000µs 📉 -64.0%) vs baseline: -1.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ low_match

Time: ✅ 99.001µs (SLO: <120.000µs 📉 -17.5%) vs baseline: +0.5%

Memory: ✅ 603.608MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.8%


✅ very_low_match

Time: ✅ 2.669ms (SLO: <8.500ms 📉 -68.6%) vs baseline: -0.5%

Memory: ✅ 71.090MB (SLO: <75.000MB -5.2%) vs baseline: +4.7%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.546µs (SLO: <20.000µs 📉 -47.3%) vs baseline: ~same

Memory: ✅ 35.763MB (SLO: <36.000MB 🟡 -0.7%) vs baseline: +5.1%


✅ all-enabled

Time: ✅ 40.680µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +1.7%

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%


✅ collectipvariant_exists

Time: ✅ 40.864µs (SLO: <50.000µs 📉 -18.3%) vs baseline: +0.2%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%


✅ no-collectipvariant

Time: ✅ 40.075µs (SLO: <50.000µs 📉 -19.8%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.6%


✅ no-useragentvariant

Time: ✅ 38.750µs (SLO: <50.000µs 📉 -22.5%) vs baseline: -0.2%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.7%


✅ obfuscation-no-query

Time: ✅ 40.511µs (SLO: <50.000µs 📉 -19.0%) vs baseline: +0.2%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.7%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.694µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.2%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.8%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.421µs (SLO: <90.000µs 📉 -15.1%) vs baseline: +0.1%

Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.6%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.407µs (SLO: <170.000µs -9.2%) vs baseline: +0.4%

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +4.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 149.279µs (SLO: <160.000µs -6.7%) vs baseline: +0.2%

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.842µs (SLO: <170.000µs -8.9%) vs baseline: ~same

Memory: ✅ 35.783MB (SLO: <36.500MB 🟡 -2.0%) vs baseline: +5.3%


✅ useragentvariant_exists_1

Time: ✅ 39.549µs (SLO: <50.000µs 📉 -20.9%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.7%


✅ useragentvariant_exists_2

Time: ✅ 40.519µs (SLO: <50.000µs 📉 -19.0%) vs baseline: ~same

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%


✅ useragentvariant_exists_3

Time: ✅ 40.023µs (SLO: <50.000µs 📉 -20.0%) vs baseline: -0.2%

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.7%


✅ useragentvariant_not_exists_1

Time: ✅ 39.463µs (SLO: <50.000µs 📉 -21.1%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.6%


✅ useragentvariant_not_exists_2

Time: ✅ 39.569µs (SLO: <50.000µs 📉 -20.9%) vs baseline: -0.2%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.8%


🟡 span - 26/26

✅ add-event

Time: ✅ 18.154ms (SLO: <22.500ms 📉 -19.3%) vs baseline: +0.3%

Memory: ✅ 36.884MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.7%


✅ add-metrics

Time: ✅ 89.032ms (SLO: <93.500ms -4.8%) vs baseline: -1.7%

Memory: ✅ 41.141MB (SLO: <53.000MB 📉 -22.4%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 143.017ms (SLO: <155.000ms -7.7%) vs baseline: +0.9%

Memory: ✅ 41.226MB (SLO: <53.000MB 📉 -22.2%) vs baseline: +5.2%


✅ get-context

Time: ✅ 16.968ms (SLO: <20.500ms 📉 -17.2%) vs baseline: +1.0%

Memory: ✅ 36.764MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 17.257ms (SLO: <20.500ms 📉 -15.8%) vs baseline: +0.8%

Memory: ✅ 36.921MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +5.2%


✅ record-exception

Time: ✅ 36.716ms (SLO: <40.000ms -8.2%) vs baseline: +0.8%

Memory: ✅ 37.376MB (SLO: <53.000MB 📉 -29.5%) vs baseline: +5.0%


✅ set-status

Time: ✅ 18.625ms (SLO: <22.000ms 📉 -15.3%) vs baseline: +0.3%

Memory: ✅ 36.843MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.1%


✅ start

Time: ✅ 17.337ms (SLO: <20.500ms 📉 -15.4%) vs baseline: +2.7%

Memory: ✅ 36.707MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.5%


✅ start-finish

Time: ✅ 51.116ms (SLO: <52.500ms -2.6%) vs baseline: +0.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 51.880ms (SLO: <54.500ms -4.8%) vs baseline: -0.8%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.3%


✅ start-finish-traceid128

Time: ✅ 54.033ms (SLO: <57.000ms -5.2%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ start-traceid128

Time: ✅ 17.334ms (SLO: <22.500ms 📉 -23.0%) vs baseline: -0.4%

Memory: ✅ 36.766MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%


✅ update-name

Time: ✅ 17.352ms (SLO: <22.000ms 📉 -21.1%) vs baseline: +0.3%

Memory: ✅ 36.961MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +5.0%


🟡 tracer - 6/6

✅ large

Time: ✅ 29.050ms (SLO: <32.950ms 📉 -11.8%) vs baseline: -0.8%

Memory: ✅ 35.940MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.8%


✅ medium

Time: ✅ 2.881ms (SLO: <3.200ms -10.0%) vs baseline: -0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ small

Time: ✅ 331.345µs (SLO: <370.000µs 📉 -10.4%) vs baseline: +1.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.185µs (SLO: <170.000µs -8.7%) vs baseline: -0.2%

Memory: ✅ 39.827MB (SLO: <43.000MB -7.4%) vs baseline: +5.1%


✅ import_many_cached

Time: ✅ 120.538µs (SLO: <130.000µs -7.3%) vs baseline: -0.3%

Memory: ✅ 39.814MB (SLO: <43.000MB -7.4%) vs baseline: +4.4%


✅ import_many_stdlib

Time: ✅ 0.759ms (SLO: <1.750ms 📉 -56.7%) vs baseline: +0.2%

Memory: ✅ 39.677MB (SLO: <43.000MB -7.7%) vs baseline: +4.7%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.173ms (SLO: <1.100ms 📉 -84.3%) vs baseline: -0.6%

Memory: ✅ 39.454MB (SLO: <43.000MB -8.2%) vs baseline: +3.7%


✅ import_many_unknown

Time: ✅ 839.035µs (SLO: <890.000µs -5.7%) vs baseline: +0.3%

Memory: ✅ 39.721MB (SLO: <43.000MB -7.6%) vs baseline: +3.7%


✅ import_many_unknown_cached

Time: ✅ 792.156µs (SLO: <870.000µs -8.9%) vs baseline: -0.3%

Memory: ✅ 39.715MB (SLO: <43.000MB -7.6%) vs baseline: +4.0%


✅ import_one

Time: ✅ 19.888µs (SLO: <30.000µs 📉 -33.7%) vs baseline: +0.6%

Memory: ✅ 39.568MB (SLO: <43.000MB -8.0%) vs baseline: +4.0%


✅ import_one_cache

Time: ✅ 6.295µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.5%

Memory: ✅ 39.647MB (SLO: <43.000MB -7.8%) vs baseline: +4.5%


✅ import_one_stdlib

Time: ✅ 18.872µs (SLO: <20.000µs -5.6%) vs baseline: +1.1%

Memory: ✅ 39.617MB (SLO: <43.000MB -7.9%) vs baseline: +4.8%


✅ import_one_stdlib_cache

Time: ✅ 6.328µs (SLO: <10.000µs 📉 -36.7%) vs baseline: -0.3%

Memory: ✅ 39.626MB (SLO: <43.000MB -7.8%) vs baseline: +3.9%


✅ import_one_unknown

Time: ✅ 45.671µs (SLO: <50.000µs -8.7%) vs baseline: +0.9%

Memory: ✅ 39.505MB (SLO: <43.000MB -8.1%) vs baseline: +3.7%


✅ import_one_unknown_cache

Time: ✅ 6.288µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.4%

Memory: ✅ 39.622MB (SLO: <43.000MB -7.9%) vs baseline: +4.1%

✅ All Tests Passing (3 suites)
iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.951µs (SLO: <60.000µs 📉 -16.7%) vs baseline: +0.4%

Memory: ✅ 38.280MB (SLO: <42.000MB -8.9%) vs baseline: +5.0%


✅ propagation_enabled

Time: ✅ 137.543µs (SLO: <190.000µs 📉 -27.6%) vs baseline: -0.3%

Memory: ✅ 38.319MB (SLO: <42.000MB -8.8%) vs baseline: +4.7%


✅ propagation_enabled_100

Time: ✅ 1.571ms (SLO: <2.300ms 📉 -31.7%) vs baseline: -1.8%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +5.0%


✅ propagation_enabled_1000

Time: ✅ 29.573ms (SLO: <34.550ms 📉 -14.4%) vs baseline: -0.3%

Memory: ✅ 38.712MB (SLO: <42.000MB -7.8%) vs baseline: +5.1%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.555ms (SLO: <42.000ms -3.4%) vs baseline: +0.6%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.0%


✅ add-link

Time: ✅ 36.625ms (SLO: <38.550ms -5.0%) vs baseline: +0.7%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.0%


✅ add-metrics

Time: ✅ 220.315ms (SLO: <232.000ms -5.0%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 212.109ms (SLO: <221.600ms -4.3%) vs baseline: +0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ get-context

Time: ✅ 29.139ms (SLO: <31.300ms -6.9%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ is-recording

Time: ✅ 29.132ms (SLO: <31.000ms -6.0%) vs baseline: +0.4%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 63.354ms (SLO: <65.850ms -3.8%) vs baseline: +0.1%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%


✅ set-status

Time: ✅ 31.979ms (SLO: <34.150ms -6.4%) vs baseline: +0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ start

Time: ✅ 29.117ms (SLO: <30.150ms -3.4%) vs baseline: +1.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%


✅ start-finish

Time: ✅ 33.833ms (SLO: <35.350ms -4.3%) vs baseline: +0.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.5%


✅ start-finish-telemetry

Time: ✅ 33.955ms (SLO: <35.450ms -4.2%) vs baseline: -0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ update-name

Time: ✅ 30.820ms (SLO: <33.400ms -7.7%) vs baseline: -0.7%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.0%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.016ms (SLO: <354.300ms -3.2%) vs baseline: -1.1%

Memory: ✅ 40.800MB (SLO: <43.500MB -6.2%) vs baseline: +4.7%


✅ cache_on

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.6%

Memory: ✅ 39.944MB (SLO: <43.000MB -7.1%) vs baseline: +5.4%

ℹ️ Scenarios Missing SLO Configuration (26 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@emmettbutler emmettbutler enabled auto-merge (squash) December 23, 2025 14:25
@emmettbutler emmettbutler enabled auto-merge (squash) December 23, 2025 16:38
@emmettbutler emmettbutler merged commit 589b04d into main Dec 23, 2025
998 of 1000 checks passed
@emmettbutler emmettbutler deleted the emmett.butler/lib-injection-tests branch December 23, 2025 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants