You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docs/ingestion/kinesis_firehose.md
+1-1
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ Amazon Cloudwatch and [many other AWS services](https://docs.aws.amazon.com/Amaz
4
4
5
5
Some of the AWS logs that can be sent to Kinesis firehose are: Amazon Cloudwatch, Amazon Virtual Private Cloud flow logs, AWS Network Firewall logs, AWS WAF logs.
6
6
7
-
You can configure Kinesis firehose to send logs to Zinc Cloud / Zinc Observe using below details.
7
+
You can configure Kinesis firehose to send logs to Zinc Cloud / ZincObserve using below details.
Copy file name to clipboardExpand all lines: docs/howto/ingest_ecs_logs_using_firelens.md
+7-20
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
## Introduction
4
4
5
-
In order to send logs from [**`tasks`**](##"An `ECS task` is a collection of on or more containers running as a single unit in ECS. If you are from a kubernetes background then an ECS task is equivalent to a pod") running in ECS (on fargate and ec2 for linux) to ZincObserve, AWS firelens is the recommended mechanism. AWS firelens is a log router for Amazon ECS that sends log data from containers running in ECS tasks to fluentbit (or fluentd) sidecar container which can then send data to wherever fluentbit supports sending data. A sidecar container is simply an additional container running along side the main container in a task that performs some ancillary services - e.g. collecting logs, keep configuration up to date, etc. We recommend that you use fluentbit instead of fluentd due to its much lower resource requirements.
5
+
In order to send logs from [**`tasks`**](##"An `ECS task` is a collection of on or more containers running as a single unit in ECS. If you are from a kubernetes background then an ECS task is equivalent to a pod") running in ECS (on fargate and ec2 for linux) to ZincObserve, AWS firelens is the recommended mechanism. AWS firelens is a log router for Amazon ECS that sends log data from containers running in ECS tasks to fluentbit (or fluentd) sidecar container which can then send data to wherever fluentbit supports sending data. A sidecar container is simply an additional container running along side the main container in a task that performs some ancillary services - e.g. collecting logs, keep configuration up to date, etc. We recommend that you use fluentbit instead of fluentd due to its much lower resource requirements.
6
6
7
7
If you have existing ECS tasks from which you need to send logs to ZincObserve, then you will need to modify their task definition to add fluentbit sidecar. Let's take a look at how to accomplish this.
8
8
@@ -15,7 +15,7 @@ We will run our tasks using fargate for this demonstration.
15
15
16
16
## Get Zinc Cloud / ZincObserve Configuration
17
17
18
-
Before you can start with setting up the configuration of your ECS task you will need the details of your ZincObserve where you will send the logs.
18
+
Before you can start with setting up the configuration of your ECS task you will need the details of your ZincObserve where you will send the logs.
19
19
20
20
> You can either use a self hosted ZincObserve or [Zinc Cloud](https://observe.zinc.dev) for following this guide. You can get started with [Zinc Cloud](https://observe.zinc.dev) for free at [https://observe.zinc.dev](https://observe.zinc.dev) that has a generous free tier.
21
21
@@ -36,9 +36,7 @@ Create the following file and save it as "nginx_firelens_zo_task_def.json"
@@ -97,37 +95,29 @@ Create the following file and save it as "nginx_firelens_zo_task_def.json"
97
95
98
96
`options` section has [http output plugin](https://docs.fluentbit.io/manual/pipeline/outputs/http) configuration for fluentbit. Configure this section with the values you got from ZincObserve.
99
97
100
-
101
98
Register the task definition using the below command:
**Note**: `Do not` set `assignPublicIp` on line `10` as ENABLED for real world scenarios. You do not want to access tasks directly. We are doing this now only for demonstration. You should always either front the services with a load balancer or AWS `Cloud Map`.
126
117
127
-
128
118
## Create ECS service
129
119
130
-
Now let's create an ECS `service` that will use this task definition.
120
+
Now let's create an ECS `service` that will use this task definition.
131
121
132
122
Assuming the name of your cluster - `ecs1_fargate_cluster1` run below command:
Click `open address`. You should see the following page:
161
150
162
151

163
152
164
-
165
153
Now head on the ZincObserve / Zinc Cloud and see the logs flowing in there.
166
154
167
-

155
+

168
156
169
157
## Conclusion
170
158
171
159
AWS firelens provides an easy way to send ECS container logs to ZincObserve. We configured AWS firelens in few steps to send logs to ZincObserve / Zinc cloud. to easily view and analyze logs.
0 commit comments