Nidesh-Arumugam opened a new issue #21485:
URL: https://github.com/apache/airflow/issues/21485


   ### Apache Airflow version
   
   2.2.3 (latest released)
   
   ### What happened
   
   We are running airflow(2.2.3) in our Redhat server, We changed the 
airflow.cfg for logs to retrieve only message section.
   
   ```
   # Flag to enable/disable Colored logs in Console
   # Colour the logs when the controlling terminal is a TTY.
   colored_console_log = False
   
   # Log format for when Colored logs is enabled
   colored_log_format = %%(message)s
   colored_formatter_class = 
airflow.utils.log.colored_log.CustomTTYColoredFormatter
   
   # Format of Log line
   log_format =   %%(message)s
   simple_log_format =  %%(message)s
   ```
   
   Even after changing the airflow.cfg the logs still includes the asctime, 
filename and other stuffs.
   
   ```
   Sample Log:
   
   [2022-02-10, 11:58:10 ] {subprocess.py:74} INFO - Running command: ['bash', 
'-c', 'top -n 1 -b']
   [2022-02-10, 11:58:10 ] {subprocess.py:85} INFO - Output:
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - top - 06:28:10 up 34 days, 
32 min,  2 users,  load average: 0.35, 0.16, 0.11
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - Tasks: 135 total,   1 
running, 133 sleeping,   0 stopped,   1 zombie
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - %Cpu(s):  3.2 us,  0.0 sy, 
 0.0 ni, 96.8 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - MiB Mem :   7766.0 total,  
  298.4 free,   2871.7 used,   4595.9 buff/cache
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - MiB Swap:      0.0 total,  
    0.0 free,      0.0 used.   4205.2 avail Mem
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - 
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -     PID USER      PR  NI   
 VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -   17910 root      20   0  
229400  40620  38584 S   6.2   0.5   2:29.42 sssd_nss
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO - 3037947 ec2-user  20   0   
65432   4432   3840 R   6.2   0.1   0:00.01 top
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       1 root      20   0  
242304  15288   9008 S   0.0   0.2   2:36.27 systemd
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       2 root      20   0   
    0      0      0 S   0.0   0.0   0:00.83 kthreadd
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       3 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 rcu_gp
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       4 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 rcu_par+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       6 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 kworker+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -       9 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 mm_perc+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      10 root      20   0   
    0      0      0 S   0.0   0.0   0:22.47 ksoftir+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      11 root      20   0   
    0      0      0 I   0.0   0.0  12:50.75 rcu_sch+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      12 root      rt   0   
    0      0      0 S   0.0   0.0   0:00.13 migrati+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      13 root      rt   0   
    0      0      0 S   0.0   0.0   0:00.80 watchdo+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      14 root      20   0   
    0      0      0 S   0.0   0.0   0:00.00 cpuhp/0
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      15 root      20   0   
    0      0      0 S   0.0   0.0   0:00.00 cpuhp/1
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      16 root      rt   0   
    0      0      0 S   0.0   0.0   0:03.27 watchdo+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      17 root      rt   0   
    0      0      0 S   0.0   0.0   0:00.13 migrati+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      18 root      20   0   
    0      0      0 S   0.0   0.0   0:17.02 ksoftir+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      20 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 kworker+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      23 root      20   0   
    0      0      0 S   0.0   0.0   0:00.00 kdevtmp+
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      24 root       0 -20   
    0      0      0 I   0.0   0.0   0:00.00 netns
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      25 root      20   0   
    0      0      0 S   0.0   0.0   0:38.59 kauditd
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      26 root      20   0   
    0      0      0 S   0.0   0.0   0:00.00 xenbus
   [2022-02-10, 11:58:10 ] {subprocess.py:89} INFO -      27 root      20   0   
    0      0      0 S   0.0   0.0   0:00.00 xenwatch
   
   ```
   
   ### What you expected to happen
   
   Need only message section in logs
   
   ### How to reproduce
   
   _No response_
   
   ### Operating System
   
   Redhat(Linux)
   
   ### Versions of Apache Airflow Providers
   
   2.2.3
   
   ### Deployment
   
   Other
   
   ### Deployment details
   
   Redhat(8)
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to