Skip to content

Commit d17d8a7

Browse files
Merge branch 'master' into create-pull-request/patch
Signed-off-by: Pat <[email protected]>
2 parents e6ab1ba + dff3f09 commit d17d8a7

File tree

132 files changed

+1390
-2184
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

132 files changed

+1390
-2184
lines changed

SUMMARY.md

Lines changed: 100 additions & 101 deletions
Large diffs are not rendered by default.

about/fluentd-and-fluent-bit.md

Lines changed: 7 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -4,42 +4,28 @@ description: The production grade telemetry ecosystem
44

55
# Fluentd and Fluent Bit
66

7-
Telemetry data processing can be complex, especially at scale. That's why
8-
[Fluentd](https://www.fluentd.org) was created. Fluentd is more than a simple tool,
9-
it's grown into a fullscale ecosystem that contains SDKs for different languages
10-
and subprojects like [Fluent Bit](https://fluentbit.io).
7+
Telemetry data processing can be complex, especially at scale. That's why [Fluentd](https://www.fluentd.org) was created. Fluentd is more than a simple tool, it's grown into a fullscale ecosystem that contains SDKs for different languages and subprojects like [Fluent Bit](https://fluentbit.io).
118

12-
Here, we describe the relationship between the [Fluentd](http://fluentd.org)
13-
and [Fluent Bit](http://fluentbit.io) open source projects.
9+
Here, we describe the relationship between the [Fluentd](http://fluentd.org) and [Fluent Bit](http://fluentbit.io) open source projects.
1410

1511
Both projects are:
1612

17-
- Licensed under the terms of Apache License v2.0.
18-
- Graduated hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io).
19-
- Production grade solutions: Deployed millions of times every single day.
20-
- Vendor neutral and community driven.
21-
- Widely adopted by the industry: Trusted by major companies like AWS, Microsoft,
22-
Google Cloud, and hundreds of others.
13+
- Licensed under the terms of Apache License v2.0. - Graduated hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io). - Production grade solutions: Deployed millions of times every single day. - Vendor neutral and community driven. - Widely adopted by the industry: Trusted by major companies like AWS, Microsoft, Google Cloud, and hundreds of others.
2314

24-
The projects have many similarities: [Fluent Bit](https://fluentbit.io) is
25-
designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org)
26-
architecture and general design. Which one you choose depends on your end-users' needs.
15+
The projects have many similarities: [Fluent Bit](https://fluentbit.io) is designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org) architecture and general design. Which one you choose depends on your end-users' needs.
2716

2817
The following table describes a comparison of different areas of the projects:
2918

3019
| Attribute | Fluentd | Fluent Bit |
3120
| ------------ | --------------------- | --------------------- |
3221
| Scope | Containers / Servers | Embedded Linux / Containers / Servers |
33-
| Language | C & Ruby | C |
22+
| Language | C and Ruby | C |
3423
| Memory | Greater than 60&nbsp;MB | Approximately 1&nbsp;MB |
3524
| Performance | Medium Performance | High Performance |
3625
| Dependencies | Built as a Ruby Gem, depends on other gems. | Zero dependencies, unless required by a plugin. |
3726
| Plugins | Over 1,000 external plugins available. | Over 100 built-in plugins available. |
3827
| License | [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0) | [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0) |
3928

40-
Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io)
41-
can work as Aggregators or Forwarders, and can complement each other or be used
42-
as standalone solutions.
29+
Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io) can work as Aggregators or Forwarders, and can complement each other or be used as standalone solutions.
4330

44-
In the recent years, cloud providers have switched from Fluentd to Fluent Bit for
45-
performance and compatibility. Fluent Bit is now considered the next-generation solution.
31+
In the recent years, cloud providers have switched from Fluentd to Fluent Bit for performance and compatibility. Fluent Bit is now considered the next-generation solution.

about/history.md

Lines changed: 2 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -5,16 +5,6 @@ description: Every project has a story
55

66
# A brief history of Fluent Bit
77

8-
In 2014, the [Fluentd](https://www.fluentd.org/) team at
9-
[Treasure Data](https://www.treasuredata.com/) was forecasting the need for a
10-
lightweight log processor for constraint environments like embedded Linux and
11-
gateways. The project aimed to be part of the Fluentd ecosystem. At that moment,
12-
Eduardo Silva created [Fluent Bit](https://fluentbit.io/), a new open source solution,
13-
written from scratch and available under the terms of the
14-
[Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0).
8+
In 2014, the [Fluentd](https://www.fluentd.org/) team at [Treasure Data](https://www.treasuredata.com/) was forecasting the need for a lightweight log processor for constraint environments like embedded Linux and gateways. The project aimed to be part of the Fluentd ecosystem. At that moment, Eduardo Silva created [Fluent Bit](https://fluentbit.io/), a new open source solution, written from scratch and available under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0).
159

16-
After the project matured, it gained traction for normal Linux systems. With the
17-
new containerized world, the Cloud Native community asked to extend the
18-
project scope to support more sources, filters, and destinations. Not long after,
19-
Fluent Bit became one of the preferred solutions to solve the logging challenges
20-
in Cloud environments.
10+
After the project matured, it gained traction for normal Linux systems. With the new containerized world, the Cloud Native community asked to extend the project scope to support more sources, filters, and destinations. Not long after, Fluent Bit became one of the preferred solutions to solve the logging challenges in Cloud environments.

about/license.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,7 @@ description: Fluent Bit license description
55

66
# License
77

8-
[Fluent Bit](http://fluentbit.io), including its core, plugins, and tools are
9-
distributed under the terms of the
10-
[Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0):
8+
[Fluent Bit](http://fluentbit.io), including its core, plugins, and tools are distributed under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0):
119

1210
```text
1311
Apache License

about/sandbox-and-lab-resources.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ description: >-
44
Labs for learning how to best operate, use, and have success with Fluent Bit.
55
---
66

7-
# Sandbox and Lab Resources
7+
# Sandbox and lab resources
88

99
## Fluent Bit Sandbox - sign-up required
1010

about/what-is-fluent-bit.md

Lines changed: 3 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -4,24 +4,11 @@ description: Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
44

55
# What is Fluent Bit?
66

7-
[Fluent Bit](https://fluentbit.io) is an open source telemetry agent specifically
8-
designed to efficiently handle the challenges of collecting and processing telemetry
9-
data across a wide range of environments, from constrained systems to complex cloud
10-
infrastructures. Managing telemetry data from various sources and formats can be a
11-
constant challenge, particularly when performance is a critical factor.
7+
[Fluent Bit](https://fluentbit.io) is an open source telemetry agent specifically designed to efficiently handle the challenges of collecting and processing telemetry data across a wide range of environments, from constrained systems to complex cloud infrastructures. Managing telemetry data from various sources and formats can be a constant challenge, particularly when performance is a critical factor.
128

13-
Rather than serving as a drop-in replacement, Fluent Bit enhances the observability
14-
strategy for your infrastructure by adapting and optimizing your existing logging
15-
layer, and adding metrics and traces processing. Fluent Bit supports a
16-
vendor-neutral approach, seamlessly integrating with other ecosystems such as
17-
Prometheus and OpenTelemetry. Trusted by major cloud providers, banks, and companies
18-
in need of a ready-to-use telemetry agent solution, Fluent Bit effectively manages
19-
diverse data sources and formats while maintaining optimal performance and keeping
20-
resource consumption low.
9+
Rather than serving as a drop-in replacement, Fluent Bit enhances the observability strategy for your infrastructure by adapting and optimizing your existing logging layer, and adding metrics and traces processing. Fluent Bit supports a vendor-neutral approach, seamlessly integrating with other ecosystems such as Prometheus and OpenTelemetry. Trusted by major cloud providers, banks, and companies in need of a ready-to-use telemetry agent solution, Fluent Bit effectively manages diverse data sources and formats while maintaining optimal performance and keeping resource consumption low.
2110

22-
Fluent Bit can be deployed as an edge agent for localized telemetry data handling or
23-
utilized as a central aggregator/collector for managing telemetry data across
24-
multiple sources and environments.
11+
Fluent Bit can be deployed as an edge agent for localized telemetry data handling or utilized as a central aggregator/collector for managing telemetry data across multiple sources and environments.
2512

2613

2714
{% embed url="https://www.youtube.com/watch?v=3ELc1helke4" %}

administration/aws-credentials.md

Lines changed: 9 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,30 +1,22 @@
1-
# AWS Credentials
1+
# AWS credentials
22

3-
Plugins that interact with AWS services fetch credentials from the following providers
4-
in order. Only the first provider that provides credentials is used.
3+
Plugins that interact with AWS services fetch credentials from the following providers in order. Only the first provider that provides credentials is used.
54

65
- [Environment variables](#environment-variables)
76
- [Shared configuration and credentials files](#shared-configuration-and-credentials-files)
87
- [EKS Web Identity Token (OIDC)](#eks-web-identity-token-oidc)
98
- [ECS HTTP credentials endpoint](#ecs-http-credentials-endpoint)
109
- [EC2 Instance Profile Credentials (IMDS)](#ec2-instance-profile-credentials-imds)
1110

12-
All AWS plugins additionally support a `role_arn` (or `AWS_ROLE_ARN`, for
13-
[Elasticsearch](../pipeline/outputs/elasticsearch.md)) configuration parameter. If
14-
specified, the fetched credentials are used to assume the given role.
11+
All AWS plugins additionally support a `role_arn` (or `AWS_ROLE_ARN`, for [Elasticsearch](../pipeline/outputs/elasticsearch.md)) configuration parameter. If specified, the fetched credentials are used to assume the given role.
1512

1613
## Environment variables
1714

18-
Plugins use the `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` (and optionally
19-
`AWS_SESSION_TOKEN`) environment variables if set.
15+
Plugins use the `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` (and optionally `AWS_SESSION_TOKEN`) environment variables if set.
2016

2117
## Shared configuration and credentials files
2218

23-
Plugins read the shared `config` file at `$AWS_CONFIG_FILE` (or `$HOME/.aws/config`),
24-
and the shared credentials file at `$AWS_SHARED_CREDENTIALS_FILE` (or
25-
`$HOME/.aws/credentials`) to fetch the credentials for the profile named
26-
`$AWS_PROFILE` or `$AWS_DEFAULT_PROFILE` (or "default"). See
27-
[Configuration and credential file settings in the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html).
19+
Plugins read the shared `config` file at `$AWS_CONFIG_FILE` (or `$HOME/.aws/config`), and the shared credentials file at `$AWS_SHARED_CREDENTIALS_FILE` (or `$HOME/.aws/credentials`) to fetch the credentials for the profile named `$AWS_PROFILE` or `$AWS_DEFAULT_PROFILE` (or "default"). See [Configuration and credential file settings in the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html).
2820

2921
The shared settings evaluate in the following order:
3022

@@ -37,22 +29,16 @@ No other settings are supported.
3729

3830
## EKS Web Identity Token (OIDC)
3931

40-
Credentials are fetched using a signed web identity token for a Kubernetes service account.
41-
See [IAM roles for service accounts](https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html).
32+
Credentials are fetched using a signed web identity token for a Kubernetes service account. See [IAM roles for service accounts](https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html).
4233

4334
## ECS HTTP credentials endpoint
4435

45-
Credentials are fetched for the ECS task's role. See
46-
[Amazon ECS task IAM role](https://docs.aws.amazon.com/AmazonECS/latest/userguide/task-iam-roles.html).
36+
Credentials are fetched for the ECS task's role. See [Amazon ECS task IAM role](https://docs.aws.amazon.com/AmazonECS/latest/userguide/task-iam-roles.html).
4737

4838
## EKS Pod Identity credentials
4939

50-
Credentials are fetched using a pod identity endpoint. See
51-
[Learn how EKS Pod Identity grants pods access to AWS services](https://docs.aws.amazon.com/eks/latest/userguide/pod-identities.html).
40+
Credentials are fetched using a pod identity endpoint. See [Learn how EKS Pod Identity grants pods access to AWS services](https://docs.aws.amazon.com/eks/latest/userguide/pod-identities.html).
5241

5342
## EC2 instance profile credentials (IMDS)
5443

55-
Fetches credentials for the EC2 instance profile's role. See
56-
[IAM roles for Amazon EC2](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html).
57-
As of Fluent Bit version 1.8.8, IMDSv2 is used by default and IMDSv1 might be disabled.
58-
Prior versions of Fluent Bit require enabling IMDSv1 on EC2.
44+
Fetches credentials for the EC2 instance profile's role. See [IAM roles for Amazon EC2](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html). As of Fluent Bit version 1.8.8, IMDSv2 is used by default and IMDSv1 might be disabled. Prior versions of Fluent Bit require enabling IMDSv1 on EC2.

0 commit comments

Comments
 (0)