Skip to content

Conversation

pickypg
Copy link
Member

@pickypg pickypg commented Sep 24, 2025

This configures the standard sending_queue to batch-process and limit the maximum size of payloads being sent over the wire to avoid proxy and other rejections.

Note: max_size is uncompressed bytes and enabled defaults to true, but it's unused if no settings are set. I want to ensure a future release doesn't flip the default to false.

What does this PR do?

It limits the size of requests being sent over the wire to a more reasonable size.

Why is it important?

Sending large payloads can trigger security issues as well as rejections at many levels.

This configures the standard `sending_queue` to batch-process and
limit the maximum size of payloads being sent over the wire to
avoid proxy and other rejections.

Note: `max_size` is uncompressed bytes.
@pickypg pickypg self-assigned this Sep 24, 2025
@pickypg pickypg added the bug Something isn't working label Sep 24, 2025
@pickypg pickypg requested a review from a team as a code owner September 24, 2025 04:05
@pickypg pickypg added skip-changelog backport-9.1 Automated backport to the 9.1 branch labels Sep 24, 2025
@pickypg pickypg enabled auto-merge (squash) September 24, 2025 15:51
pickypg added a commit to elastic/autoops-install that referenced this pull request Sep 24, 2025
Added configuration options for OTLP HTTP exporter so that batches are not rejected.

This can be removed after 9.1.5 (after elastic/elastic-agent#10126 is exposed by default).
pickypg added a commit to elastic/autoops-install that referenced this pull request Sep 24, 2025
Added configuration options for OTLP HTTP exporter so that batches are
not rejected.

This can be removed after 9.1.5 (after
elastic/elastic-agent#10126 is exposed by
default).
Copy link

Quality Gate passed Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

@pickypg pickypg merged commit 476d721 into main Sep 24, 2025
23 checks passed
@pickypg pickypg deleted the autoops/otel-send-smaller-batches branch September 24, 2025 17:57
mergify bot pushed a commit that referenced this pull request Sep 24, 2025
This configures the standard `sending_queue` to batch-process and
limit the maximum size of payloads being sent over the wire to
avoid proxy and other rejections.

Note: `max_size` is uncompressed bytes.
(cherry picked from commit 476d721)
@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

History

cc @pickypg

pickypg added a commit that referenced this pull request Sep 24, 2025
…) (#10133)

This configures the standard `sending_queue` to batch-process and
limit the maximum size of payloads being sent over the wire to
avoid proxy and other rejections.

Note: `max_size` is uncompressed bytes.
(cherry picked from commit 476d721)

Co-authored-by: Chris Earle <[email protected]>
v1v added a commit that referenced this pull request Sep 26, 2025
* upstream: (505 commits)
  Update journald tests now that Filebeat supports watching folders (#10131)
  [deploy/kubernetes]: add info about hostPID for Universal Profiling (#10173)
  Fall back to process runtime if otel runtime is unsupported (#10087)
  Conditionall check for ms_tls13kdf build tag (#10160)
  [docs][edot] add entry for profiles (#10163)
  edot/docs: add support for profiles (#10146)
  Add Logstash exporter (#10137)
  Add back publish to serverless. (#10159)
  Improve Integration test documentation (#10155)
  Fix multiarch service image push from main to serverless (#10129)
  Forward migrate action to endpoint (#9801)
  Comment out check for ms_tls13kdf tag for FIPS-capable binaries (#10148)
  [otel] add receivers: apache, iis, mysql, postgresql, sqlserver v0.135.0 (#9344)
  Add k8sevents receiver in kube-stack (#10086)
  feat: emit system resource metrics for EDOT subprocess (#10003)
  [AutoOps] Configure OTel Exporter to Send Maximum-sized Batches (#10126)
  keep enrollment token when replacing data with signed (#10115)
  Revert "Publish `elastic-agent-service` container directly to serverless from main (#9583)" (#10127)
  Add agent_policy_id and policy_revision_idx to checkin requests (#9931)
  remove resource/k8s processor and use k8sattributes processor for service attributes (#10108)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-9.1 Automated backport to the 9.1 branch bug Something isn't working skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants