[jira] [Updated] (AIRFLOW-4401) multiprocessing.Queue.empty() is unreliable

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-4401: -- Description: After discussing with [~ash] and [~BasPH] potential reasons for flakiness of

[GitHub] [airflow] benbenbang commented on issue #5137: [AIRFLOW-4363] Add try-catch for retrieving `status` from cli in docker operator

2019-04-28 Thread GitBox
benbenbang commented on issue #5137: [AIRFLOW-4363] Add try-catch for retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5137#issuecomment-487452686 All done, thanks. This is an

[GitHub] [airflow] potiuk commented on issue #5201: [Airlfow-XXXX] Add docs for Google Cloud Storage Sensors

2019-04-28 Thread GitBox
potiuk commented on issue #5201: [Airlfow-] Add docs for Google Cloud Storage Sensors URL: https://github.com/apache/airflow/pull/5201#issuecomment-487449971 Just the last commit is needed since the sensor is already merged. Can you please rebase just the last on on top of master

[GitHub] [airflow] jmcarp commented on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator.

2019-04-28 Thread GitBox
jmcarp commented on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator. URL: https://github.com/apache/airflow/pull/5196#issuecomment-487444578 @feluelle: I updated the tests and docs like you suggested.

[GitHub] [airflow] zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check

2019-04-28 Thread GitBox
zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check URL: https://github.com/apache/airflow/pull/4890#issuecomment-487434271 @raphaelauv BTW, we are already remove `py2` in our CI, and you failed test is in `py2.7` part. Maybe we should check

[GitHub] [airflow] zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check

2019-04-28 Thread GitBox
zhongjiajie commented on issue #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check URL: https://github.com/apache/airflow/pull/4890#issuecomment-487434079 @raphaelauv You could use `git push -f` re-submit commit and the failed CI will restart.

[GitHub] [airflow] TV4Fun commented on issue #5169: [AIRFLOW-3143] Support Auto-Zone in DataprocClusterCreateOperator

2019-04-28 Thread GitBox
TV4Fun commented on issue #5169: [AIRFLOW-3143] Support Auto-Zone in DataprocClusterCreateOperator URL: https://github.com/apache/airflow/pull/5169#issuecomment-487424425 @fenglu-g @potiuk This is an automated message from

[GitHub] [airflow] codecov-io edited a comment on issue #5201: [Airlfow-XXXX] Add docs for Google Cloud Storage Sensors

2019-04-28 Thread GitBox
codecov-io edited a comment on issue #5201: [Airlfow-] Add docs for Google Cloud Storage Sensors URL: https://github.com/apache/airflow/pull/5201#issuecomment-487417345 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5201?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #5201: [Airlfow-XXXX] Add docs for Google Cloud Storage Sensors

2019-04-28 Thread GitBox
codecov-io commented on issue #5201: [Airlfow-] Add docs for Google Cloud Storage Sensors URL: https://github.com/apache/airflow/pull/5201#issuecomment-487417345 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5201?src=pr=h1) Report > Merging

[GitHub] [airflow] jaketf commented on issue #5201: [Airlfow-XXXX] Add docs for Google Cloud Storage Sensors

2019-04-28 Thread GitBox
jaketf commented on issue #5201: [Airlfow-] Add docs for Google Cloud Storage Sensors URL: https://github.com/apache/airflow/pull/5201#issuecomment-487414475 @potiuk @OmerJog hopefully this addresses the documentation gap in `integrations.rst`

[GitHub] [airflow] jaketf opened a new pull request #5201: [Airlfow-XXXX] Add docs for Google Cloud Storage Sensors

2019-04-28 Thread GitBox
jaketf opened a new pull request #5201: [Airlfow-] Add docs for Google Cloud Storage Sensors URL: https://github.com/apache/airflow/pull/5201 This PR adds documentation for the Google Cloud Storage sensors to `integrations.rst`

[GitHub] [airflow] andriisoldatenko commented on a change in pull request #5048: [AIRFLOW-3370] Add stdout output options to Elasticsearch task log handler

2019-04-28 Thread GitBox
andriisoldatenko commented on a change in pull request #5048: [AIRFLOW-3370] Add stdout output options to Elasticsearch task log handler URL: https://github.com/apache/airflow/pull/5048#discussion_r279211175 ## File path: airflow/utils/log/es_task_handler.py ## @@ -119,7

[GitHub] [airflow] jaketf commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor

2019-04-28 Thread GitBox
jaketf commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor URL: https://github.com/apache/airflow/pull/5166#issuecomment-487412971 @potiuk @OmerJog Sure I'll add a PR for adding the docs for the GCS sensors. It looks like I inherited the lack of docs from the the

[GitHub] [airflow] codecov-io edited a comment on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator.

2019-04-28 Thread GitBox
codecov-io edited a comment on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator. URL: https://github.com/apache/airflow/pull/5196#issuecomment-487343692 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5196?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4401) multiprocessing.Queue.empty() is unreliable

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828780#comment-16828780 ] Jarek Potiuk commented on AIRFLOW-4401: --- I had to also add some shutdowns to clean-up the extra

[GitHub] [airflow] potiuk commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
potiuk commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487394715 Seems that https://github.com/apache/airflow/pull/5200/ solves it in a simpler way. Let's wait for the build to finish, but

[GitHub] [airflow] potiuk edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
potiuk edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487394715 Seems that https://github.com/apache/airflow/pull/5200/ solves it in a simpler way. Let's wait for the build to

[GitHub] [airflow] codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
codecov-io commented on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk opened a new pull request #5200: [aIRFLOW-4401] Use managers for Queue synchronization

2019-04-28 Thread GitBox
potiuk opened a new pull request #5200: [aIRFLOW-4401] Use managers for Queue synchronization URL: https://github.com/apache/airflow/pull/5200 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-4401) multiprocessing.Queue.empty() is unreliable

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828045#comment-16828045 ] Jarek Potiuk commented on AIRFLOW-4401: --- And we have now a competing (simpler) implementation 

[GitHub] [airflow] codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
codecov-io edited a comment on issue #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199#issuecomment-487392721 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5199?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-4382) Limited Parallelism test is flaky

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-4382: -- Description: -The SFTPOperator tests seems to fail many times.- Limited parallelism test is

[jira] [Updated] (AIRFLOW-4382) Limited Parallelism test is flaky

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-4382: -- Summary: Limited Parallelism test is flaky (was: SFTPOperator tests are flaky) > Limited

[jira] [Commented] (AIRFLOW-4401) multiprocessing.Queue.empty() is unreliable

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828027#comment-16828027 ] Jarek Potiuk commented on AIRFLOW-4401: --- [~BasPH] [~ash] -> I think the new PR 

[jira] [Updated] (AIRFLOW-4382) Limited Parallelism test is flaky

2019-04-28 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-4382: -- Description: -The SFTPOperator tests seems to fail many times.- Limited parallelism test is

[jira] [Commented] (AIRFLOW-2337) Broken Import Variables

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828018#comment-16828018 ] jack commented on AIRFLOW-2337: --- Can not reproduce with 1.10.3 - Export and Import works fine for me. >

[jira] [Commented] (AIRFLOW-1832) xcom_push is not reliable

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828022#comment-16828022 ] jack commented on AIRFLOW-1832: --- There has been significant work for the xcom_push including  unification

[jira] [Commented] (AIRFLOW-4401) multiprocessing.Queue.empty() is unreliable

2019-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828017#comment-16828017 ] ASF GitHub Bot commented on AIRFLOW-4401: - potiuk commented on pull request #5199:

[GitHub] [airflow] potiuk opened a new pull request #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used.

2019-04-28 Thread GitBox
potiuk opened a new pull request #5199: [AIRFLOW-4401] SynchronizedQueue used where empty() is used. URL: https://github.com/apache/airflow/pull/5199 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-2911) Add job cancellation capability to Dataflow hook

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827986#comment-16827986 ] jack commented on AIRFLOW-2911: --- [~pabloem] any progress? > Add job cancellation capability to Dataflow

[jira] [Issue Comment Deleted] (AIRFLOW-3061) Update Outdated (4 years old) Screenshots

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3061: -- Comment: was deleted (was: Wasn't this updated in 1.10.2? ) > Update Outdated (4 years old) Screenshots >

[jira] [Commented] (AIRFLOW-3061) Update Outdated (4 years old) Screenshots

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827977#comment-16827977 ] jack commented on AIRFLOW-3061: --- Though these files were marked to be updated in: 

[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-04-28 Thread Bas Harenslak (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak reassigned AIRFLOW-4364: -- Assignee: Bas Harenslak > Integrate Pylint > > >

[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-04-28 Thread Bas Harenslak (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak reassigned AIRFLOW-4364: -- Assignee: (was: Bas Harenslak) > Integrate Pylint > > >

[jira] [Commented] (AIRFLOW-4094) XCom not pushed into database when size of content is greater than 65535 bytes

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827942#comment-16827942 ] jack commented on AIRFLOW-4094: --- Actually Airflow enforce max size of 49344 bytes.

[jira] [Updated] (AIRFLOW-3157) Variable.set shouldn't accept types other than string when JSON mode is False

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3157: -- Fix Version/s: 1.10.4 > Variable.set shouldn't accept types other than string when JSON mode is False >

[jira] [Commented] (AIRFLOW-4098) gcp_api dependency conflicts

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827941#comment-16827941 ] jack commented on AIRFLOW-4098: --- [~kaxilnaik] have you encountered this?  > gcp_api dependency conflicts

[jira] [Commented] (AIRFLOW-4403) UI search query in main view should filters by either dag_id or owner

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827931#comment-16827931 ] ASF subversion and git services commented on AIRFLOW-4403: -- Commit

[jira] [Commented] (AIRFLOW-3720) GoogleCloudStorageToS3Operator - incorrect folder compare

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827917#comment-16827917 ] ASF subversion and git services commented on AIRFLOW-3720: -- Commit

[jira] [Commented] (AIRFLOW-3720) GoogleCloudStorageToS3Operator - incorrect folder compare

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827922#comment-16827922 ] ASF subversion and git services commented on AIRFLOW-3720: -- Commit

[jira] [Commented] (AIRFLOW-4397) Add GCSUploadSessionCompleteSensor

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827921#comment-16827921 ] ASF subversion and git services commented on AIRFLOW-4397: -- Commit

[jira] [Commented] (AIRFLOW-4168) Create Google Cloud Video Intelligence Operators

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827923#comment-16827923 ] ASF subversion and git services commented on AIRFLOW-4168: -- Commit

[jira] [Commented] (AIRFLOW-4397) Add GCSUploadSessionCompleteSensor

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827920#comment-16827920 ] ASF subversion and git services commented on AIRFLOW-4397: -- Commit

[jira] [Commented] (AIRFLOW-4397) Add GCSUploadSessionCompleteSensor

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827916#comment-16827916 ] ASF subversion and git services commented on AIRFLOW-4397: -- Commit

[jira] [Commented] (AIRFLOW-4397) Add GCSUploadSessionCompleteSensor

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827915#comment-16827915 ] ASF subversion and git services commented on AIRFLOW-4397: -- Commit

[jira] [Commented] (AIRFLOW-4168) Create Google Cloud Video Intelligence Operators

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827918#comment-16827918 ] ASF subversion and git services commented on AIRFLOW-4168: -- Commit

[GitHub] [airflow] OmerJog commented on issue #4830: [AIRFLOW-3929] Use anchor tag for dag filter link.

2019-04-28 Thread GitBox
OmerJog commented on issue #4830: [AIRFLOW-3929] Use anchor tag for dag filter link. URL: https://github.com/apache/airflow/pull/4830#issuecomment-487368134 @ashb There is a pending pr to fix the zoom in issue: https://github.com/apache/airflow/pull/4473

[GitHub] [airflow] potiuk commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor

2019-04-28 Thread GitBox
potiuk commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor URL: https://github.com/apache/airflow/pull/5166#issuecomment-487364370 @jaketf - indeed @OmerJog is right. Most of the docs are now auto-generated in Reference but integration still needs to be updated.

[GitHub] [airflow] OmerJog commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task failure instance duration

2019-04-28 Thread GitBox
OmerJog commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task failure instance duration URL: https://github.com/apache/airflow/pull/5176#issuecomment-487362582 There is a pending previous PR https://github.com/apache/airflow/pull/4032 and @ashb requested unit tests before

[GitHub] [airflow] OmerJog commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor

2019-04-28 Thread GitBox
OmerJog commented on issue #5166: [AIRFLOW-4397] Add GCSUploadSessionCompleteSensor URL: https://github.com/apache/airflow/pull/5166#issuecomment-487362261 @jaketf The PR is missing an edit to docs/integration.rst would you mind adding the it in a new PR?

[jira] [Updated] (AIRFLOW-1860) When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-1860: -- Attachment: aIRFLOW11.PNG > When adding variables in Web GUI they are case-insensitive, but everywhere >

[GitHub] [airflow] feluelle commented on a change in pull request #5162: [AIRFLOW-4358] Speed up test_jobs by not running tasks

2019-04-28 Thread GitBox
feluelle commented on a change in pull request #5162: [AIRFLOW-4358] Speed up test_jobs by not running tasks URL: https://github.com/apache/airflow/pull/5162#discussion_r279185479 ## File path: tests/executors/test_executor.py ## @@ -16,47 +16,73 @@ # KIND, either

[GitHub] [airflow] RosterIn commented on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator.

2019-04-28 Thread GitBox
RosterIn commented on issue #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator. URL: https://github.com/apache/airflow/pull/5196#issuecomment-487360020 My previous PR is somehow related as this one also address TIME field. I suggest going through the comments of the

[jira] [Commented] (AIRFLOW-1860) When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive

2019-04-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827864#comment-16827864 ] jack commented on AIRFLOW-1860: --- Can not reproduce on Airflow 1.10.3: !aIRFLOW11.PNG!   > When adding

[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running

2019-04-28 Thread Chaim (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827863#comment-16827863 ] Chaim commented on AIRFLOW-3791: how can i get my pull request to go in? > Multiple jobs in run &

[GitHub] [airflow] tssujt commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task failure instance duration

2019-04-28 Thread GitBox
tssujt commented on issue #5176: [AIRFLOW-2636] Fix Nonetype error for task failure instance duration URL: https://github.com/apache/airflow/pull/5176#issuecomment-487359241 Rebased @feng-tao This is an automated message

[GitHub] [airflow] feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator.

2019-04-28 Thread GitBox
feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator. URL: https://github.com/apache/airflow/pull/5196#discussion_r279184388 ## File path: tests/contrib/operators/test_mysql_to_gcs_operator.py ## @@ -106,7

[GitHub] [airflow] feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator.

2019-04-28 Thread GitBox
feluelle commented on a change in pull request #5196: [AIRFLOW-4423] Improve date handling in mysql to gcs operator. URL: https://github.com/apache/airflow/pull/5196#discussion_r279183742 ## File path: airflow/contrib/operators/mysql_to_gcs.py ## @@ -265,27 +288,31 @@ def

[jira] [Created] (AIRFLOW-4425) Add FacebookAdsHook

2019-04-28 Thread jack (JIRA)
jack created AIRFLOW-4425: - Summary: Add FacebookAdsHook Key: AIRFLOW-4425 URL: https://issues.apache.org/jira/browse/AIRFLOW-4425 Project: Apache Airflow Issue Type: Wish Components:

[GitHub] [airflow] OmerJog commented on issue #4546: AIRFLOW-3720

2019-04-28 Thread GitBox
OmerJog commented on issue #4546: AIRFLOW-3720 URL: https://github.com/apache/airflow/pull/4546#issuecomment-487355614 This can be closed due to the merge of https://github.com/apache/airflow/pull/4766 This is an automated

[GitHub] [airflow] codecov-io commented on issue #5195: [AIRFLOW-4348] Add GCP console link in BigQueryOperator

2019-04-28 Thread GitBox
codecov-io commented on issue #5195: [AIRFLOW-4348] Add GCP console link in BigQueryOperator URL: https://github.com/apache/airflow/pull/5195#issuecomment-487352417 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5195?src=pr=h1) Report > Merging

[GitHub] [airflow] feng-tao commented on issue #5194: [AIRFLOW-4419] Refine concurrency check in scheduler

2019-04-28 Thread GitBox
feng-tao commented on issue #5194: [AIRFLOW-4419] Refine concurrency check in scheduler URL: https://github.com/apache/airflow/pull/5194#issuecomment-487352281 will take a look at the pr tomorrow This is an automated message

[GitHub] [airflow] KevinYang21 edited a comment on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch

2019-04-28 Thread GitBox
KevinYang21 edited a comment on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350990 @cong-zhu Do we have unit test for this feature before? If so we'll still need to update it so we

[GitHub] [airflow] KevinYang21 commented on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch

2019-04-28 Thread GitBox
KevinYang21 commented on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350990 @cong-zhu Do we have unit test for this feature before? If so we'll still need to update it so we capture the

[jira] [Resolved] (AIRFLOW-4228) DatabricksRunNowOperator does not show up under airflow docs

2019-04-28 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng resolved AIRFLOW-4228. --- Resolution: Fixed Fix Version/s: 2.0.0 > DatabricksRunNowOperator does not show up under

[GitHub] [airflow] feng-tao commented on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch

2019-04-28 Thread GitBox
feng-tao commented on issue #5177: [AIRFLOW-4084] Fix bug downloading incomplete logs from ElasticSearch URL: https://github.com/apache/airflow/pull/5177#issuecomment-487350721 cc @KevinYang21 This is an automated message

[GitHub] [airflow] feng-tao commented on issue #5195: [AIRFLOW-4348] Add GCP console link in BigQueryOperator

2019-04-28 Thread GitBox
feng-tao commented on issue #5195: [AIRFLOW-4348] Add GCP console link in BigQueryOperator URL: https://github.com/apache/airflow/pull/5195#issuecomment-487350649 cc GCP folks @fenglu-g @potiuk This is an automated message

[GitHub] [airflow] feng-tao merged pull request #5182: [AIRFLOW-4361] Fix flaky test_integration_run_dag_with_scheduler_failure

2019-04-28 Thread GitBox
feng-tao merged pull request #5182: [AIRFLOW-4361] Fix flaky test_integration_run_dag_with_scheduler_failure URL: https://github.com/apache/airflow/pull/5182 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] feng-tao commented on issue #5182: [AIRFLOW-4361] Fix flaky test_integration_run_dag_with_scheduler_failure

2019-04-28 Thread GitBox
feng-tao commented on issue #5182: [AIRFLOW-4361] Fix flaky test_integration_run_dag_with_scheduler_failure URL: https://github.com/apache/airflow/pull/5182#issuecomment-487350412 lgtm This is an automated message from the

[GitHub] [airflow] feng-tao merged pull request #5171: [AIRFLOW-4228] DatabricksRunNowOperator missing from documentation

2019-04-28 Thread GitBox
feng-tao merged pull request #5171: [AIRFLOW-4228] DatabricksRunNowOperator missing from documentation URL: https://github.com/apache/airflow/pull/5171 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-4361) Fix flaky test_integration_run_dag_with_scheduler_failure

2019-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827844#comment-16827844 ] ASF GitHub Bot commented on AIRFLOW-4361: - feng-tao commented on pull request #5182:

[jira] [Commented] (AIRFLOW-4361) Fix flaky test_integration_run_dag_with_scheduler_failure

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827845#comment-16827845 ] ASF subversion and git services commented on AIRFLOW-4361: -- Commit

[jira] [Commented] (AIRFLOW-4228) DatabricksRunNowOperator does not show up under airflow docs

2019-04-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827842#comment-16827842 ] ASF subversion and git services commented on AIRFLOW-4228: -- Commit

[jira] [Commented] (AIRFLOW-4228) DatabricksRunNowOperator does not show up under airflow docs

2019-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827841#comment-16827841 ] ASF GitHub Bot commented on AIRFLOW-4228: - feng-tao commented on pull request #5171:

[GitHub] [airflow] feng-tao merged pull request #5198: [AIRFLOW-XXX] Update readme for Lyft

2019-04-28 Thread GitBox
feng-tao merged pull request #5198: [AIRFLOW-XXX] Update readme for Lyft URL: https://github.com/apache/airflow/pull/5198 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] feng-tao commented on issue #5198: [AIRFLOW-XXX] Update readme for Lyft

2019-04-28 Thread GitBox
feng-tao commented on issue #5198: [AIRFLOW-XXX] Update readme for Lyft URL: https://github.com/apache/airflow/pull/5198#issuecomment-487348695 PTAL @milton0825 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] feng-tao opened a new pull request #5198: [AIRFLOW-XXX] Update readme for Lyft

2019-04-28 Thread GitBox
feng-tao opened a new pull request #5198: [AIRFLOW-XXX] Update readme for Lyft URL: https://github.com/apache/airflow/pull/5198 Add a few more folks from Lyft. This is an automated message from the Apache Git Service. To

[GitHub] [airflow] feng-tao commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358

2019-04-28 Thread GitBox
feng-tao commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358 URL: https://github.com/apache/airflow/pull/5197#issuecomment-487348001 thanks @XD-DENG :) This is an automated message from the Apache Git Service. To

[GitHub] [airflow] codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358

2019-04-28 Thread GitBox
codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358 URL: https://github.com/apache/airflow/pull/5197#issuecomment-487347426 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5197?src=pr=h1) Report > Merging

[GitHub] [airflow] XD-DENG merged pull request #5197: [AIRFLOW-XXX] Fix CVE-2019-11358

2019-04-28 Thread GitBox
XD-DENG merged pull request #5197: [AIRFLOW-XXX] Fix CVE-2019-11358 URL: https://github.com/apache/airflow/pull/5197 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358

2019-04-28 Thread GitBox
codecov-io commented on issue #5197: [AIRFLOW-XXX] Fix CVE-2019-11358 URL: https://github.com/apache/airflow/pull/5197#issuecomment-487347427 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5197?src=pr=h1) Report > Merging