Use elastic apm connector to replace other apm components

[lahsivjar]

What does this PR do?

The PR replaces lsminterval processor and signaltometrics connector with the newly introduced elasticapm connector which wraps both the processor and the connector with the required APM configurations.

In addition, the PR also removes aggregation for metrics pipeline as required by elastic/opentelemetry-collector-components#390

Why is it important?

To centralize all APM components and configurations a new connector component called elasticapmconnector was recently introduced. The component encapsulates the signaltometrics connector and the lsminterval connector along with the required configurations for APM.

The PR will be blocked by #6912 and elastic/beats#42748

Checklist

• I have read and understood the pull request guidelines of this project.
• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool
• I have added an integration test or an E2E test

Disruptive User Impact

How to test this PR locally

Related issues

• Closes https://github.com/elastic/opentelemetry-dev/issues/750
• Closes [elasticapm] Remove service_summary metric for metrics-only services opentelemetry-collector-components#390

Questions to ask yourself

• How are we going to support this in production?
• How are we going to measure its adoption?
• How are we going to debug this?
• What are the metrics I should take care of?
• ...

[mergify]

This pull request does not have a backport label. Could you fix it @lahsivjar? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-./d./d is the label that automatically backports to the 8./d branch. /d is the digit
• backport-active-all is the label that automatically backports to all active branches.
• backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
• backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

[elasticmachine]

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b elasticapm-connector upstream/elasticapm-connector
git merge upstream/main
git push upstream elasticapm-connector

[lahsivjar]

PR #7050 should fix the blocker

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarQube

[simitt]

@lahsivjar can you update the conflicts in the PR and then re-request a review?

[lahsivjar]

@simitt The blocking PR (updating the main branch to use v0.120.0++ for OTel collector) is still not merged so unfortunately, we are still blocked - 8.18 and 9.0 branches already have the changes merged, only main is remaining. #6912 is the blocking PR. So, we won't be able to merge this for now.

Also, we have this slack thread with some discussion around this.

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b elasticapm-connector upstream/elasticapm-connector
git merge upstream/main
git push upstream elasticapm-connector

[andrzej-stencel]

This was already applied on:

• 9.0 [9.0] Use elastic apm connector to replace other apm components #7172
• 8.x [8.18](backport #7172) Use elastic apm connector to replace other apm components #7452

[rogercoll]

lgtm

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube

[elasticmachine]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: 9ef0430

Failed CI Steps

• arm:sudo: standalone-upgrade

History

• 💚 Build #19673 succeeded 9b8fb8f
• 💔 Build #19663 failed 5e09c47
• 💔 Build #19657 failed 1624e06
• 💔 Build #17981 failed 191334e
• 💔 Build #17974 failed 450868a
• 💔 Build #17811 failed 84275c0

cc @lahsivjar