[
https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Potiuk updated AIRFLOW-4401:
--
Description:
After discussing with [~ash] and [~BasPH] potential reasons for flakiness of
benbenbang commented on issue #5137: [AIRFLOW-4363] Add try-catch for
retrieving `status` from cli in docker operator
URL: https://github.com/apache/airflow/pull/5137#issuecomment-487452686
All done, thanks.
This is an
potiuk commented on issue #5201: [Airlfow-] Add docs for Google Cloud
Storage Sensors
URL: https://github.com/apache/airflow/pull/5201#issuecomment-487449971
Just the last commit is needed since the sensor is already merged. Can you
please rebase just the last on on top of master
jmcarp commented on issue #5196: [AIRFLOW-4423] Improve date handling in mysql
to gcs operator.
URL: https://github.com/apache/airflow/pull/5196#issuecomment-487444578
@feluelle: I updated the tests and docs like you suggested.
zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context
to response_check
URL: https://github.com/apache/airflow/pull/4890#issuecomment-487434271
@raphaelauv BTW, we are already remove `py2` in our CI, and you failed test
is in `py2.7` part. Maybe we should check
zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context
to response_check
URL: https://github.com/apache/airflow/pull/4890#issuecomment-487434079
@raphaelauv You could use `git push -f` re-submit commit and the failed CI
will restart.
TV4Fun commented on issue #5169: [AIRFLOW-3143] Support Auto-Zone in
DataprocClusterCreateOperator
URL: https://github.com/apache/airflow/pull/5169#issuecomment-487424425
@fenglu-g @potiuk
This is an automated message from
codecov-io edited a comment on issue #5201: [Airlfow-] Add docs for Google
Cloud Storage Sensors
URL: https://github.com/apache/airflow/pull/5201#issuecomment-487417345
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5201?src=pr=h1)
Report
> Merging
codecov-io commented on issue #5201: [Airlfow-] Add docs for Google Cloud
Storage Sensors
URL: https://github.com/apache/airflow/pull/5201#issuecomment-487417345
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5201?src=pr=h1)
Report
> Merging
jaketf commented on issue #5201: [Airlfow-] Add docs for Google Cloud
Storage Sensors
URL: https://github.com/apache/airflow/pull/5201#issuecomment-487414475
@potiuk @OmerJog hopefully this addresses the documentation gap in
`integrations.rst`
jaketf opened a new pull request #5201: [Airlfow-] Add docs for Google
Cloud Storage Sensors
URL: https://github.com/apache/airflow/pull/5201
This PR adds documentation for the Google Cloud Storage sensors to
`integrations.rst`
andriisoldatenko commented on a change in pull request #5048: [AIRFLOW-3370]
Add stdout output options to Elasticsearch task log handler
URL: https://github.com/apache/airflow/pull/5048#discussion_r279211175
##
File path: airflow/utils/log/es_task_handler.py
##
@@ -119,7
jaketf commented on issue #5166: [AIRFLOW-4397] Add
GCSUploadSessionCompleteSensor
URL: https://github.com/apache/airflow/pull/5166#issuecomment-487412971
@potiuk @OmerJog Sure I'll add a PR for adding the docs for the GCS sensors.
It looks like I inherited the lack of docs from the the
codecov-io edited a comment on issue #5196: [AIRFLOW-4423] Improve date
handling in mysql to gcs operator.
URL: https://github.com/apache/airflow/pull/5196#issuecomment-487343692
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5196?src=pr=h1)
Report
> Merging
[
https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828780#comment-16828780
]
Jarek Potiuk commented on AIRFLOW-4401:
---
I had to also add some shutdowns to clean-up the extra
potiuk commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where
empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487394715
Seems that https://github.com/apache/airflow/pull/5200/ solves it in a
simpler way. Let's wait for the build to finish, but
potiuk edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used
where empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487394715
Seems that https://github.com/apache/airflow/pull/5200/ solves it in a
simpler way. Let's wait for the build to
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue
used where empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1)
Report
> Merging
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue
used where empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1)
Report
> Merging
codecov-io commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used
where empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1)
Report
> Merging
potiuk opened a new pull request #5200: [aIRFLOW-4401] Use managers for Queue
synchronization
URL: https://github.com/apache/airflow/pull/5200
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828045#comment-16828045
]
Jarek Potiuk commented on AIRFLOW-4401:
---
And we have now a competing (simpler) implementation
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue
used where empty() is used.
URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1)
Report
> Merging
[
https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Potiuk updated AIRFLOW-4382:
--
Description:
-The SFTPOperator tests seems to fail many times.-
Limited parallelism test is
[
https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Potiuk updated AIRFLOW-4382:
--
Summary: Limited Parallelism test is flaky (was: SFTPOperator tests are
flaky)
> Limited
[
https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828027#comment-16828027
]
Jarek Potiuk commented on AIRFLOW-4401:
---
[~BasPH] [~ash] -> I think the new PR
[
https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Potiuk updated AIRFLOW-4382:
--
Description:
-The SFTPOperator tests seems to fail many times.-
Limited parallelism test is
[
https://issues.apache.org/jira/browse/AIRFLOW-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828018#comment-16828018
]
jack commented on AIRFLOW-2337:
---
Can not reproduce with 1.10.3 - Export and Import works fine for me.
>
[
https://issues.apache.org/jira/browse/AIRFLOW-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828022#comment-16828022
]
jack commented on AIRFLOW-1832:
---
There has been significant work for the xcom_push including unification
[
https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828017#comment-16828017
]
ASF GitHub Bot commented on AIRFLOW-4401:
-
potiuk commented on pull request #5199:
potiuk opened a new pull request #5199: [AIRFLOW-4401] SynchronizedQueue used
where empty() is used.
URL: https://github.com/apache/airflow/pull/5199
Make sure you have checked _all_ steps below.
### Jira
- [x] My PR addresses the following [Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827986#comment-16827986
]
jack commented on AIRFLOW-2911:
---
[~pabloem] any progress?
> Add job cancellation capability to Dataflow
[
https://issues.apache.org/jira/browse/AIRFLOW-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jack updated AIRFLOW-3061:
--
Comment: was deleted
(was: Wasn't this updated in 1.10.2? )
> Update Outdated (4 years old) Screenshots
>
[
https://issues.apache.org/jira/browse/AIRFLOW-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827977#comment-16827977
]
jack commented on AIRFLOW-3061:
---
Though these files were marked to be updated in:
[
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bas Harenslak reassigned AIRFLOW-4364:
--
Assignee: Bas Harenslak
> Integrate Pylint
>
>
>
[
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bas Harenslak reassigned AIRFLOW-4364:
--
Assignee: (was: Bas Harenslak)
> Integrate Pylint
>
>
>
[
https://issues.apache.org/jira/browse/AIRFLOW-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827942#comment-16827942
]
jack commented on AIRFLOW-4094:
---
Actually Airflow enforce max size of 49344 bytes.
[
https://issues.apache.org/jira/browse/AIRFLOW-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jack updated AIRFLOW-3157:
--
Fix Version/s: 1.10.4
> Variable.set shouldn't accept types other than string when JSON mode is False
>
[
https://issues.apache.org/jira/browse/AIRFLOW-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827941#comment-16827941
]
jack commented on AIRFLOW-4098:
---
[~kaxilnaik] have you encountered this?
> gcp_api dependency conflicts
[
https://issues.apache.org/jira/browse/AIRFLOW-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827931#comment-16827931
]
ASF subversion and git services commented on AIRFLOW-4403:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827917#comment-16827917
]
ASF subversion and git services commented on AIRFLOW-3720:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827922#comment-16827922
]
ASF subversion and git services commented on AIRFLOW-3720:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827921#comment-16827921
]
ASF subversion and git services commented on AIRFLOW-4397:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827923#comment-16827923
]
ASF subversion and git services commented on AIRFLOW-4168:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827920#comment-16827920
]
ASF subversion and git services commented on AIRFLOW-4397:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827916#comment-16827916
]
ASF subversion and git services commented on AIRFLOW-4397:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827915#comment-16827915
]
ASF subversion and git services commented on AIRFLOW-4397:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827918#comment-16827918
]
ASF subversion and git services commented on AIRFLOW-4168:
--
Commit
OmerJog commented on issue #4830: [AIRFLOW-3929] Use anchor tag for dag filter
link.
URL: https://github.com/apache/airflow/pull/4830#issuecomment-487368134
@ashb There is a pending pr to fix the zoom in issue:
https://github.com/apache/airflow/pull/4473
potiuk commented on issue #5166: [AIRFLOW-4397] Add
GCSUploadSessionCompleteSensor
URL: https://github.com/apache/airflow/pull/5166#issuecomment-487364370
@jaketf - indeed @OmerJog is right. Most of the docs are now auto-generated
in Reference but integration still needs to be updated.
OmerJog commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task
failure instance duration
URL: https://github.com/apache/airflow/pull/5176#issuecomment-487362582
There is a pending previous PR https://github.com/apache/airflow/pull/4032
and @ashb requested unit tests before
OmerJog commented on issue #5166: [AIRFLOW-4397] Add
GCSUploadSessionCompleteSensor
URL: https://github.com/apache/airflow/pull/5166#issuecomment-487362261
@jaketf The PR is missing an edit to docs/integration.rst would you mind
adding the it in a new PR?
[
https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jack updated AIRFLOW-1860:
--
Attachment: aIRFLOW11.PNG
> When adding variables in Web GUI they are case-insensitive, but everywhere
>
feluelle commented on a change in pull request #5162: [AIRFLOW-4358] Speed up
test_jobs by not running tasks
URL: https://github.com/apache/airflow/pull/5162#discussion_r279185479
##
File path: tests/executors/test_executor.py
##
@@ -16,47 +16,73 @@
# KIND, either
RosterIn commented on issue #5196: [AIRFLOW-4423] Improve date handling in
mysql to gcs operator.
URL: https://github.com/apache/airflow/pull/5196#issuecomment-487360020
My previous PR is somehow related as this one also address TIME field. I
suggest going through the comments of the
[
https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827864#comment-16827864
]
jack commented on AIRFLOW-1860:
---
Can not reproduce on Airflow 1.10.3: !aIRFLOW11.PNG!
> When adding
[
https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827863#comment-16827863
]
Chaim commented on AIRFLOW-3791:
how can i get my pull request to go in?
> Multiple jobs in run &
tssujt commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task
failure instance duration
URL: https://github.com/apache/airflow/pull/5176#issuecomment-487359241
Rebased @feng-tao
This is an automated message
feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve
date handling in mysql to gcs operator.
URL: https://github.com/apache/airflow/pull/5196#discussion_r279184388
##
File path: tests/contrib/operators/test_mysql_to_gcs_operator.py
##
@@ -106,7
feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve
date handling in mysql to gcs operator.
URL: https://github.com/apache/airflow/pull/5196#discussion_r279183742
##
File path: airflow/contrib/operators/mysql_to_gcs.py
##
@@ -265,27 +288,31 @@ def
jack created AIRFLOW-4425:
-
Summary: Add FacebookAdsHook
Key: AIRFLOW-4425
URL: https://issues.apache.org/jira/browse/AIRFLOW-4425
Project: Apache Airflow
Issue Type: Wish
Components:
OmerJog commented on issue #4546: AIRFLOW-3720
URL: https://github.com/apache/airflow/pull/4546#issuecomment-487355614
This can be closed due to the merge of
https://github.com/apache/airflow/pull/4766
This is an automated
codecov-io commented on issue #5195: [AIRFLOW-4348] Add GCP console link in
BigQueryOperator
URL: https://github.com/apache/airflow/pull/5195#issuecomment-487352417
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5195?src=pr=h1)
Report
> Merging
feng-tao commented on issue #5194: [AIRFLOW-4419] Refine concurrency check in
scheduler
URL: https://github.com/apache/airflow/pull/5194#issuecomment-487352281
will take a look at the pr tomorrow
This is an automated message
KevinYang21 edited a comment on issue #5177: [AIRFLOW-4084] Fix bug downloading
incomplete logs from ElasticSearch
URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350990
@cong-zhu Do we have unit test for this feature before? If so we'll still
need to update it so we
KevinYang21 commented on issue #5177: [AIRFLOW-4084] Fix bug downloading
incomplete logs from ElasticSearch
URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350990
@cong-zhu Do we have unit test for this feature before? If so we'll still
need to update it so we capture the
[
https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Feng resolved AIRFLOW-4228.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> DatabricksRunNowOperator does not show up under
feng-tao commented on issue #5177: [AIRFLOW-4084] Fix bug downloading
incomplete logs from ElasticSearch
URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350721
cc @KevinYang21
This is an automated message
feng-tao commented on issue #5195: [AIRFLOW-4348] Add GCP console link in
BigQueryOperator
URL: https://github.com/apache/airflow/pull/5195#issuecomment-487350649
cc GCP folks @fenglu-g @potiuk
This is an automated message
feng-tao merged pull request #5182: [AIRFLOW-4361] Fix flaky
test_integration_run_dag_with_scheduler_failure
URL: https://github.com/apache/airflow/pull/5182
This is an automated message from the Apache Git Service.
To
feng-tao commented on issue #5182: [AIRFLOW-4361] Fix flaky
test_integration_run_dag_with_scheduler_failure
URL: https://github.com/apache/airflow/pull/5182#issuecomment-487350412
lgtm
This is an automated message from the
feng-tao merged pull request #5171: [AIRFLOW-4228] DatabricksRunNowOperator
missing from documentation
URL: https://github.com/apache/airflow/pull/5171
This is an automated message from the Apache Git Service.
To respond to
[
https://issues.apache.org/jira/browse/AIRFLOW-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827844#comment-16827844
]
ASF GitHub Bot commented on AIRFLOW-4361:
-
feng-tao commented on pull request #5182:
[
https://issues.apache.org/jira/browse/AIRFLOW-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827845#comment-16827845
]
ASF subversion and git services commented on AIRFLOW-4361:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827842#comment-16827842
]
ASF subversion and git services commented on AIRFLOW-4228:
--
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827841#comment-16827841
]
ASF GitHub Bot commented on AIRFLOW-4228:
-
feng-tao commented on pull request #5171:
feng-tao merged pull request #5198: [AIRFLOW-XXX] Update readme for Lyft
URL: https://github.com/apache/airflow/pull/5198
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
feng-tao commented on issue #5198: [AIRFLOW-XXX] Update readme for Lyft
URL: https://github.com/apache/airflow/pull/5198#issuecomment-487348695
PTAL @milton0825
This is an automated message from the Apache Git Service.
To
feng-tao opened a new pull request #5198: [AIRFLOW-XXX] Update readme for Lyft
URL: https://github.com/apache/airflow/pull/5198
Add a few more folks from Lyft.
This is an automated message from the Apache Git Service.
To
feng-tao commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358
URL: https://github.com/apache/airflow/pull/5197#issuecomment-487348001
thanks @XD-DENG :)
This is an automated message from the Apache Git Service.
To
codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358
URL: https://github.com/apache/airflow/pull/5197#issuecomment-487347426
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5197?src=pr=h1)
Report
> Merging
XD-DENG merged pull request #5197: [AIRFLOW-XXX] Fix CVE-2019-11358
URL: https://github.com/apache/airflow/pull/5197
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358
URL: https://github.com/apache/airflow/pull/5197#issuecomment-487347427
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5197?src=pr=h1)
Report
> Merging
83 matches
Mail list logo