kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-530789821
Few things to do:
- [ ] Add
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528982114
> That last point is interesting - cos at the SQL level we still need to
write it as a string. I
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528982114
> That last point is interesting - cos at the SQL level we still need to
write it as a string. I
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528982114
> That last point is interesting - cos at the SQL level we still need to
write it as a string. I
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528697431
Some more testing:
For another trial, I am completely removing the need to load JSON from a
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528654768
Updated the PR to convert datetime object to timestamp and parsing timestamp
using
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-528654768
Some more benchmarking:
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-52749
> How about instead of a background thread (I'm wary of using threads in
python) could we instead
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-52749
> How about instead of a background thread (I'm wary of using threads in
python) could we instead
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-52749
> How about instead of a background thread (I'm wary of using threads in
python) could we instead
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-52749
> How about instead of a background thread (I'm wary of using threads in
python) could we instead
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-52749
> How about instead of a background thread (I'm wary of using threads in
python) could we instead
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-523416060
I seem to get that when the DAG Serialization is turned off too. So this
might be a bug in
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-520101071
Pending Issues:
- ~Add Timezone support to `serialized_dag` table~
- ~We still have the
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954
@zhongjiajie
> > Pending Issues:
> >
> > * We still have the issue of
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954
@zhongjiajie
> > Pending Issues:
> >
> > * We still have the issue of
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954
@zhongjiajie
> > Pending Issues:
> >
> > * We still have the issue of
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954
@zhongjiajie
> > Pending Issues:
> >
> > * We still have the issue of
23 matches
Mail list logo