You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: about/fluentd-and-fluent-bit.md
+7-21Lines changed: 7 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,42 +4,28 @@ description: The production grade telemetry ecosystem
4
4
5
5
# Fluentd and Fluent Bit
6
6
7
-
Telemetry data processing can be complex, especially at scale. That's why
8
-
[Fluentd](https://www.fluentd.org) was created. Fluentd is more than a simple tool,
9
-
it's grown into a fullscale ecosystem that contains SDKs for different languages
10
-
and subprojects like [Fluent Bit](https://fluentbit.io).
7
+
Telemetry data processing can be complex, especially at scale. That's why [Fluentd](https://www.fluentd.org) was created. Fluentd is more than a simple tool, it's grown into a fullscale ecosystem that contains SDKs for different languages and subprojects like [Fluent Bit](https://fluentbit.io).
11
8
12
-
Here, we describe the relationship between the [Fluentd](http://fluentd.org)
13
-
and [Fluent Bit](http://fluentbit.io) open source projects.
9
+
Here, we describe the relationship between the [Fluentd](http://fluentd.org) and [Fluent Bit](http://fluentbit.io) open source projects.
14
10
15
11
Both projects are:
16
12
17
-
- Licensed under the terms of Apache License v2.0.
18
-
- Graduated hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io).
19
-
- Production grade solutions: Deployed millions of times every single day.
20
-
- Vendor neutral and community driven.
21
-
- Widely adopted by the industry: Trusted by major companies like AWS, Microsoft,
22
-
Google Cloud, and hundreds of others.
13
+
- Licensed under the terms of Apache License v2.0. - Graduated hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io). - Production grade solutions: Deployed millions of times every single day. - Vendor neutral and community driven. - Widely adopted by the industry: Trusted by major companies like AWS, Microsoft, Google Cloud, and hundreds of others.
23
14
24
-
The projects have many similarities: [Fluent Bit](https://fluentbit.io) is
25
-
designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org)
26
-
architecture and general design. Which one you choose depends on your end-users' needs.
15
+
The projects have many similarities: [Fluent Bit](https://fluentbit.io) is designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org) architecture and general design. Which one you choose depends on your end-users' needs.
27
16
28
17
The following table describes a comparison of different areas of the projects:
Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io)
41
-
can work as Aggregators or Forwarders, and can complement each other or be used
42
-
as standalone solutions.
29
+
Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io) can work as Aggregators or Forwarders, and can complement each other or be used as standalone solutions.
43
30
44
-
In the recent years, cloud providers have switched from Fluentd to Fluent Bit for
45
-
performance and compatibility. Fluent Bit is now considered the next-generation solution.
31
+
In the recent years, cloud providers have switched from Fluentd to Fluent Bit for performance and compatibility. Fluent Bit is now considered the next-generation solution.
In 2014, the [Fluentd](https://www.fluentd.org/) team at [Treasure Data](https://www.treasuredata.com/) was forecasting the need for a lightweight log processor for constraint environments like embedded Linux and gateways. The project aimed to be part of the Fluentd ecosystem. At that moment, Eduardo Silva created [Fluent Bit](https://fluentbit.io/), a new open source solution, written from scratch and available under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0).
15
9
16
-
After the project matured, it gained traction for normal Linux systems. With the
17
-
new containerized world, the Cloud Native community asked to extend the
18
-
project scope to support more sources, filters, and destinations. Not long after,
19
-
Fluent Bit became one of the preferred solutions to solve the logging challenges
20
-
in Cloud environments.
10
+
After the project matured, it gained traction for normal Linux systems. With the new containerized world, the Cloud Native community asked to extend the project scope to support more sources, filters, and destinations. Not long after, Fluent Bit became one of the preferred solutions to solve the logging challenges in Cloud environments.
[Fluent Bit](http://fluentbit.io), including its core, plugins, and tools are distributed under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0):
Copy file name to clipboardExpand all lines: about/what-is-fluent-bit.md
+3-16Lines changed: 3 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,24 +4,11 @@ description: Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
4
4
5
5
# What is Fluent Bit?
6
6
7
-
[Fluent Bit](https://fluentbit.io) is an open source telemetry agent specifically
8
-
designed to efficiently handle the challenges of collecting and processing telemetry
9
-
data across a wide range of environments, from constrained systems to complex cloud
10
-
infrastructures. Managing telemetry data from various sources and formats can be a
11
-
constant challenge, particularly when performance is a critical factor.
7
+
[Fluent Bit](https://fluentbit.io) is an open source telemetry agent specifically designed to efficiently handle the challenges of collecting and processing telemetry data across a wide range of environments, from constrained systems to complex cloud infrastructures. Managing telemetry data from various sources and formats can be a constant challenge, particularly when performance is a critical factor.
12
8
13
-
Rather than serving as a drop-in replacement, Fluent Bit enhances the observability
14
-
strategy for your infrastructure by adapting and optimizing your existing logging
15
-
layer, and adding metrics and traces processing. Fluent Bit supports a
16
-
vendor-neutral approach, seamlessly integrating with other ecosystems such as
17
-
Prometheus and OpenTelemetry. Trusted by major cloud providers, banks, and companies
18
-
in need of a ready-to-use telemetry agent solution, Fluent Bit effectively manages
19
-
diverse data sources and formats while maintaining optimal performance and keeping
20
-
resource consumption low.
9
+
Rather than serving as a drop-in replacement, Fluent Bit enhances the observability strategy for your infrastructure by adapting and optimizing your existing logging layer, and adding metrics and traces processing. Fluent Bit supports a vendor-neutral approach, seamlessly integrating with other ecosystems such as Prometheus and OpenTelemetry. Trusted by major cloud providers, banks, and companies in need of a ready-to-use telemetry agent solution, Fluent Bit effectively manages diverse data sources and formats while maintaining optimal performance and keeping resource consumption low.
21
10
22
-
Fluent Bit can be deployed as an edge agent for localized telemetry data handling or
23
-
utilized as a central aggregator/collector for managing telemetry data across
24
-
multiple sources and environments.
11
+
Fluent Bit can be deployed as an edge agent for localized telemetry data handling or utilized as a central aggregator/collector for managing telemetry data across multiple sources and environments.
Plugins that interact with AWS services fetch credentials from the following providers
4
-
in order. Only the first provider that provides credentials is used.
3
+
Plugins that interact with AWS services fetch credentials from the following providers in order. Only the first provider that provides credentials is used.
5
4
6
5
-[Environment variables](#environment-variables)
7
6
-[Shared configuration and credentials files](#shared-configuration-and-credentials-files)
8
7
-[EKS Web Identity Token (OIDC)](#eks-web-identity-token-oidc)
All AWS plugins additionally support a `role_arn` (or `AWS_ROLE_ARN`, for
13
-
[Elasticsearch](../pipeline/outputs/elasticsearch.md)) configuration parameter. If
14
-
specified, the fetched credentials are used to assume the given role.
11
+
All AWS plugins additionally support a `role_arn` (or `AWS_ROLE_ARN`, for [Elasticsearch](../pipeline/outputs/elasticsearch.md)) configuration parameter. If specified, the fetched credentials are used to assume the given role.
15
12
16
13
## Environment variables
17
14
18
-
Plugins use the `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` (and optionally
19
-
`AWS_SESSION_TOKEN`) environment variables if set.
15
+
Plugins use the `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` (and optionally `AWS_SESSION_TOKEN`) environment variables if set.
20
16
21
17
## Shared configuration and credentials files
22
18
23
-
Plugins read the shared `config` file at `$AWS_CONFIG_FILE` (or `$HOME/.aws/config`),
24
-
and the shared credentials file at `$AWS_SHARED_CREDENTIALS_FILE` (or
25
-
`$HOME/.aws/credentials`) to fetch the credentials for the profile named
26
-
`$AWS_PROFILE` or `$AWS_DEFAULT_PROFILE` (or "default"). See
27
-
[Configuration and credential file settings in the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html).
19
+
Plugins read the shared `config` file at `$AWS_CONFIG_FILE` (or `$HOME/.aws/config`), and the shared credentials file at `$AWS_SHARED_CREDENTIALS_FILE` (or `$HOME/.aws/credentials`) to fetch the credentials for the profile named `$AWS_PROFILE` or `$AWS_DEFAULT_PROFILE` (or "default"). See [Configuration and credential file settings in the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html).
28
20
29
21
The shared settings evaluate in the following order:
30
22
@@ -37,22 +29,16 @@ No other settings are supported.
37
29
38
30
## EKS Web Identity Token (OIDC)
39
31
40
-
Credentials are fetched using a signed web identity token for a Kubernetes service account.
41
-
See [IAM roles for service accounts](https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html).
32
+
Credentials are fetched using a signed web identity token for a Kubernetes service account. See [IAM roles for service accounts](https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html).
42
33
43
34
## ECS HTTP credentials endpoint
44
35
45
-
Credentials are fetched for the ECS task's role. See
46
-
[Amazon ECS task IAM role](https://docs.aws.amazon.com/AmazonECS/latest/userguide/task-iam-roles.html).
36
+
Credentials are fetched for the ECS task's role. See [Amazon ECS task IAM role](https://docs.aws.amazon.com/AmazonECS/latest/userguide/task-iam-roles.html).
47
37
48
38
## EKS Pod Identity credentials
49
39
50
-
Credentials are fetched using a pod identity endpoint. See
51
-
[Learn how EKS Pod Identity grants pods access to AWS services](https://docs.aws.amazon.com/eks/latest/userguide/pod-identities.html).
40
+
Credentials are fetched using a pod identity endpoint. See [Learn how EKS Pod Identity grants pods access to AWS services](https://docs.aws.amazon.com/eks/latest/userguide/pod-identities.html).
52
41
53
42
## EC2 instance profile credentials (IMDS)
54
43
55
-
Fetches credentials for the EC2 instance profile's role. See
56
-
[IAM roles for Amazon EC2](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html).
57
-
As of Fluent Bit version 1.8.8, IMDSv2 is used by default and IMDSv1 might be disabled.
58
-
Prior versions of Fluent Bit require enabling IMDSv1 on EC2.
44
+
Fetches credentials for the EC2 instance profile's role. See [IAM roles for Amazon EC2](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html). As of Fluent Bit version 1.8.8, IMDSv2 is used by default and IMDSv1 might be disabled. Prior versions of Fluent Bit require enabling IMDSv1 on EC2.
0 commit comments