What is the use of OTEL Property otel_task_log_event ?

[zoomingrocket]

Hi Everyone,

For context, we configured Airflow 3.1.x to successfully emit Metrics & Traces to our OTEL Collector. The next obvious item we wanted to achieve is ingest the task logs and correlate them. We found varying documentation regarding log emit added/removed to the Scheduler code, so not sure what's the latest progress on that.
#40802
https://lists.apache.org/thread/5cgpsfhofq32o7ndjvy2pqpwfqnsgxk7

Regardless, we were taking the approach to directly ingest the task log file and establish correlation by having print trace id and span id for current context. While investigating those options one of the documentation suggested that otel_task_log_event needs to be set to True to emit logs. We are a little lost as to whats the use of this? At present, we are trying to print the traceparent in the log lines so that during ingestion of raw log files, we can easily establish the correlation of all the traces emitted.

Let me know if there is a better way to do log ingestion, or if we are missing something obvious?

Thanks!