Description
Apache Airflow version
Other Airflow 2 version (please specify below)
If "Other Airflow 2 version" selected, which one?
No response
What happened?
Use apache-airflow-providers-elasticsearch 5.4.1
Airflow 2.9.2
Writing logs to Elasticsearch not worked, no data in Elasticsearch
Config:
elasticsearch:
host: "https://user:pass@elasticsearch_host:9200"
target_index: 'airflow-logs'
log_id_template: '{dag_id}{task_id}{execution_date}_{try_number}'
index_patterns: 'airflow-*'
end_of_log_mark: "end_of_log"
write_stdout: "False"
write_to_es: 'True'
json_format: 'True'
elasticsearch_configs:
use_ssl: 'True'
verify_certs: 'True'
ca_certs: /es_certs/ca.pem
What you think should happen instead?
No response
How to reproduce
Use apache-airflow-providers-elasticsearch 5.4.1
Airflow 2.9.2
Writing logs to Elasticsearch not worked, no data in Elasticsearch
Config:
elasticsearch:
host: "https://user:pass@elasticsearch_host:9200"
target_index: 'airflow-logs'
log_id_template: '{dag_id}{task_id}{execution_date}_{try_number}'
index_patterns: 'airflow-*'
end_of_log_mark: "end_of_log"
write_stdout: "False"
write_to_es: 'True'
json_format: 'True'
elasticsearch_configs:
use_ssl: 'True'
verify_certs: 'True'
ca_certs: /es_certs/ca.pem
Operating System
debian
Versions of Apache Airflow Providers
No response
Deployment
Official Apache Airflow Helm Chart
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct