Skip to content

Rate limiter (delay) in OTLP JSON File Receiver #39730

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Invenisso opened this issue Apr 29, 2025 · 2 comments
Open

Rate limiter (delay) in OTLP JSON File Receiver #39730

Invenisso opened this issue Apr 29, 2025 · 2 comments
Labels

Comments

@Invenisso
Copy link

Component(s)

receiver/otlpjsonfile

Is your feature request related to a problem? Please describe.

I use otlpjsonfile receiver to load signals from large files. The disk is fast, so hundreds of thousands of signals are loaded in a short time. After receiving I send these signals using otlphttp exporter. But it does not keep up and I get errors "sending queue is full". Of course I can increase sending_queue.queue_size, but it would be better to have an option to delay between reading subsequent signals from the file.

Describe the solution you'd like

Add optional parameter "delay" in configuration of the otlpjsonfile receiver. Default value 0 ms. The receiver should sleep for this period of time before reading next signal from the file.

Describe alternatives you've considered

No response

Additional context

No response

@Invenisso Invenisso added enhancement New feature or request needs triage New item requiring triage labels Apr 29, 2025
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@axw
Copy link
Contributor

axw commented May 2, 2025

There is work underway to introduce rate limiting features to the collector: open-telemetry/opentelemetry-collector#12603

@iblancasa iblancasa removed the needs triage New item requiring triage label May 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants