Sending windows application logs to loki

[aamir-mansoori]

`[SERVICE]
flush 5
daemon Off
log_level error
parsers_file parsers.conf
plugins_file plugins.conf
http_server on
http_listen 0.0.0.0
http_port 2020
storage.metrics on
Hot_Reload On
storage.path C:\fluent-bit\buffer
storage.sync normal
storage.max_chunks_up 500MB
storage.backlog.mem_limit 1G
Log_File C:\fluent-bit\logs\fluent-bit.log

[INPUT]
Name                tail
Path                C:\Sites\raja-tpbet-main\nlogs\*.log,C:\Sites\raja-tpbet-worker\nlogs\*.log,C:\Sites\raja-tpbet-refetch-main\nlogs\*.log,C:\Sites\raja-tpbet-refetch-worker\nlogs\*.log
Tag                 tpbet
Read_from_Head      True
Multiline           On
Parser_Firstline    multiline
Refresh_Interval    10
Buffer_Chunk_Size   100k
Buffer_Max_Size     100MB
Ignore_Older        48h
DB                  C:\fluent-bit\positions-new.db
storage.type        filesystem
Path_Key            filename

[FILTER]
Name parser
Match tpbet
Key_Name log
Parser multiline

[FILTER]
Name nest
Match tpbet
Operation lift
Nested_under log

[FILTER]
Name record_modifier
Match tpbet
Record module tpbet
Record pool raja
Record env stg
Record source fluentbit
Record service_name 26.58

[FILTER]
Name modify
Match tpbet
Condition Key_value_matches $filename (?i).tpbet-main\.
Set thejob 26.58_tpbet_main_nlog
Set role tpbet_main

[FILTER]
Name modify
Match tpbet
Condition Key_value_matches $filename (?i).tpbet-refetch-main\.
Set thejob 26.58_tpbet_refetch_main_nlog
Set role tpbet_refetch_main

[FILTER]
Name modify
Match tpbet
Condition Key_value_matches $filename (?i).tpbet-worker\.
Set thejob 26.58_tpbet_worker_nlog
Set role tpbet_worker

[FILTER]
Name modify
Match tpbet
Condition Key_value_matches $filename (?i).tpbet-refetch-worker\.
Set thejob 26.58_tpbet_refetch_worker_nlog
Set role tpbet_refetch_worker

[OUTPUT]
Name loki
Match tpbet
Host loki.service
Port 3100
URI /loki/api/v1/push
Tenant_ID tppay
Labels job=$thejob,module=$module,pool=$pool,env=$env,role=$role,service_name=$service_name,filename=$filename,source=$source
Compress gzip

`

With this Config when I am staring the fluent-bit first time, I can see logs ok Loki. After some time no logs are transmitting and it is just pilling inside buffer\tail.3\ directory.

Please help me to understand why this is happening ?

[patrick-stephens]

What do the fluent bit logs say?

[aamir-mansoori]

Thanks for the reply Patrick,

Nothing much, No error's in log.
btw if you notice below 2 setting in service configuration:
Buffer_Chunk_Size 100k Buffer_Max_Size 100MB

If we increase size from 100k --> 1MB it is started working fine.