dlamblin commented on issue #7935:
URL: https://github.com/apache/airflow/issues/7935#issuecomment-688064113
Is disk space everyone's issue? I recall either v 1.10.5 or v 1.10.6 had
some not-fit-for-production use issue that was fixed in the next version.
1.10.9 has been working okay for us and importantly `-n > -1` is not
recommended anymore.
I'm curious if you could work around it with
`AIRFLOW__CORE__BASE_LOG_FOLDER=/dev/null` (probably not because it tries to
make sub-dirs right?
In the meantime we have a systemd timer service (or you use cron) that runs
basically (gnu) find:
```sh
find <base_log_dir> -type f -mtime +6 -delete -or -type d -empty -delete
```
E.G.
```sh
$ tree -D blah/
blah/
└── [Sep 6 23:10] blah
├── [Sep 6 23:10] blah
│ └── [Jan 1 2020] file.txt
├── [Sep 6 23:09] blahy
└── [Sep 6 23:10] blahz
└── [Sep 6 23:10] file.txt
4 directories, 2 files
$ find blah -type f -mtime +6 -delete -or -type d -empty -delete
$ tree -D blah/
blah/
└── [Sep 6 23:13] blah
└── [Sep 6 23:10] blahz
└── [Sep 6 23:10] file.txt
2 directories, 1 file
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
