[GitHub] [airflow] tooptoop4 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
tooptoop4 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528716886 @KevinYang21 what is the underlying sql statement being run in old vs new?

[jira] [Commented] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923937#comment-16923937 ] ASF GitHub Bot commented on AIRFLOW-5419: - bharathpalaksha commented on pull request #6024:

[GitHub] [airflow] bharathpalaksha opened a new pull request #6024: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419

2019-09-05 Thread GitBox
bharathpalaksha opened a new pull request #6024: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419 URL: https://github.com/apache/airflow/pull/6024 Marking task failed doesn't kill the task, when task is run through

[GitHub] [airflow] seelmann edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
seelmann edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528710963 Just reverting it would reintroduce the zombie detection problem (see Jira and discussion in the inital

[GitHub] [airflow] seelmann commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
seelmann commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528710963 Just reverting it would reintroduce the zombie detection problem (see Jira and discussion in the inital PR

[jira] [Created] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-05 Thread Bharath Palaksha (Jira)
Bharath Palaksha created AIRFLOW-5419: - Summary: Marking task failed doesn't kill the task when it is run through impersonation(run_as_user) Key: AIRFLOW-5419 URL:

[jira] [Updated] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-05 Thread Bharath Palaksha (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharath Palaksha updated AIRFLOW-5419: -- Description: Airflow dag which is run using "run_as_user" doesn't get killed when

[GitHub] [airflow] TobKed commented on issue #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests

2019-09-05 Thread GitBox
TobKed commented on issue #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests URL: https://github.com/apache/airflow/pull/6018#issuecomment-528706495 cc @mik-laj @ashb This is an automated message from the Apache

[GitHub] [airflow] KevinYang21 edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
KevinYang21 edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528699559 Thank you guys for reviewing! @milton0825 We benchmarked the two approaches during the initial

[GitHub] [airflow] KevinYang21 edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
KevinYang21 edited a comment on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528699559 Thank you guys for reviewing! @milton0825 We benchmarked the two approaches during the initial

[GitHub] [airflow] KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-05 Thread GitBox
KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-528699559 Thank you guys for reviewing! @milton0825 We benchmarked the two approaches during the initial PR 3873

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-05 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-528697431 Some more testing: For another trial, I am completely removing the need to load JSON from a

[GitHub] [airflow] mik-laj commented on a change in pull request #4633: AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs

2019-09-05 Thread GitBox
mik-laj commented on a change in pull request #4633: AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs URL: https://github.com/apache/airflow/pull/4633#discussion_r321568473 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@

[GitHub] [airflow] kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-05 Thread GitBox
kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-528697431 Some more testing: For another trial, I am completely removing the need to load JSON from a str

[GitHub] [airflow] KevinYang21 opened a new pull request #6023: [AIRFLOW-5417] Fix DB disconnects during webserver startup

2019-09-05 Thread GitBox
KevinYang21 opened a new pull request #6023: [AIRFLOW-5417] Fix DB disconnects during webserver startup URL: https://github.com/apache/airflow/pull/6023 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5417) Webserver won't start with long DagBag parsing

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923906#comment-16923906 ] ASF GitHub Bot commented on AIRFLOW-5417: - KevinYang21 commented on pull request #6023:

[GitHub] [airflow] ryanyuan commented on issue #5999: [AIRFLOW-XXX] Fix incorrect GCP integration sections

2019-09-05 Thread GitBox
ryanyuan commented on issue #5999: [AIRFLOW-XXX] Fix incorrect GCP integration sections URL: https://github.com/apache/airflow/pull/5999#issuecomment-528661987 I found this issue when I was browsing this airflow doc using my mobile. See screenshot below:

[jira] [Created] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-05 Thread Leah (Jira)
Leah created AIRFLOW-5418: - Summary: bucket names with a slash in them cause an error with the GCS Download Operator Key: AIRFLOW-5418 URL: https://issues.apache.org/jira/browse/AIRFLOW-5418 Project: Apache

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-05 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-528654768 Updated the PR to convert datetime object to timestamp and parsing timestamp using

[GitHub] [airflow] leahecole opened a new pull request #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-05 Thread GitBox
leahecole opened a new pull request #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022 Small docs change to add clarity to the gcs_download_operator parameters

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-05 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-528654768 Some more benchmarking:

[GitHub] [airflow] kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-05 Thread GitBox
kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-528654768 Have done some more benchmarking:

[GitHub] [airflow] houqp commented on a change in pull request #5731: [AIRFLOW-5117] support refreshing EKS api tokens

2019-09-05 Thread GitBox
houqp commented on a change in pull request #5731: [AIRFLOW-5117] support refreshing EKS api tokens URL: https://github.com/apache/airflow/pull/5731#discussion_r321525921 ## File path: scripts/ci/pylint_todo.txt ## @@ -201,6 +201,7 @@

[jira] [Created] (AIRFLOW-5417) Webserver won't start with long DagBag parsing

2019-09-05 Thread Kevin Yang (Jira)
Kevin Yang created AIRFLOW-5417: --- Summary: Webserver won't start with long DagBag parsing Key: AIRFLOW-5417 URL: https://issues.apache.org/jira/browse/AIRFLOW-5417 Project: Apache Airflow

[GitHub] [airflow] Ark-kun commented on issue #5720: [AIRFLOW-5099] Implement Google Cloud AutoML operators

2019-09-05 Thread GitBox
Ark-kun commented on issue #5720: [AIRFLOW-5099] Implement Google Cloud AutoML operators URL: https://github.com/apache/airflow/pull/5720#issuecomment-528599637 > Knowing that most of it automatically generated, it looks good :). What generator was used here?

[GitHub] [airflow] dimberman commented on issue #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-05 Thread GitBox
dimberman commented on issue #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#issuecomment-528527675 cc: @davlum This is an automated message from the Apache Git Service.

[GitHub] [airflow] steven-freed commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-05 Thread GitBox
steven-freed commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-528486971 Yes I will I apologize I just started up my course work and have been busy but I will this weekend.

[jira] [Commented] (AIRFLOW-5416) Simplify the process of continually developing airflow-on-k8s images

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923617#comment-16923617 ] ASF GitHub Bot commented on AIRFLOW-5416: - dimberman commented on pull request #6021:

[GitHub] [airflow] dimberman opened a new pull request #6021: [AIRFLOW-5416] pre-load requirements for airflow image

2019-09-05 Thread GitBox
dimberman opened a new pull request #6021: [AIRFLOW-5416] pre-load requirements for airflow image URL: https://github.com/apache/airflow/pull/6021 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5416) Simplify the process of continually developing airflow-on-k8s images

2019-09-05 Thread Daniel Imberman (Jira)
Daniel Imberman created AIRFLOW-5416: Summary: Simplify the process of continually developing airflow-on-k8s images Key: AIRFLOW-5416 URL: https://issues.apache.org/jira/browse/AIRFLOW-5416

[GitHub] [airflow] mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-05 Thread GitBox
mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528457264 Yes. Please do rebase on latest apache/master.

[GitHub] [airflow] benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-05 Thread GitBox
benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528456640 > > Hi. > > I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed.

[jira] [Created] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-09-05 Thread Steve Crawford (Jira)
Steve Crawford created AIRFLOW-5415: --- Summary: Druid Broker Hook does not respect authentication parameters Key: AIRFLOW-5415 URL: https://issues.apache.org/jira/browse/AIRFLOW-5415 Project: Apache

[GitHub] [airflow] scrawfor commented on issue #5967: Enable authentication for druid query hook.

2019-09-05 Thread GitBox
scrawfor commented on issue #5967: Enable authentication for druid query hook. URL: https://github.com/apache/airflow/pull/5967#issuecomment-528453663 @Fokko Sure. I just created [AIRFLOW-5415](https://issues.apache.org/jira/browse/AIRFLOW-5415)

[GitHub] [airflow] nuclearpinguin commented on issue #6020: [AIRFLOW-3601][AIRFLOW-4288][AIRFLOW-4287][AIRFLOW-4575][WIP] Update operators to BigQuery to support location

2019-09-05 Thread GitBox
nuclearpinguin commented on issue #6020: [AIRFLOW-3601][AIRFLOW-4288][AIRFLOW-4287][AIRFLOW-4575][WIP] Update operators to BigQuery to support location URL: https://github.com/apache/airflow/pull/6020#issuecomment-528449779 This is WIP, @mik-laj suggest adding system test to check this.

[jira] [Commented] (AIRFLOW-3601) update operators to BigQuery to support location

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923589#comment-16923589 ] ASF GitHub Bot commented on AIRFLOW-3601: - nuclearpinguin commented on pull request #6020:

[GitHub] [airflow] nuclearpinguin opened a new pull request #6020: [AIRFLOW-3601][AIRFLOW-4288][AIRFLOW-4287][AIRFLOW-4575] Update operators to BigQuery to support location

2019-09-05 Thread GitBox
nuclearpinguin opened a new pull request #6020: [AIRFLOW-3601][AIRFLOW-4288][AIRFLOW-4287][AIRFLOW-4575] Update operators to BigQuery to support location URL: https://github.com/apache/airflow/pull/6020 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR

[jira] [Commented] (AIRFLOW-5414) --pid argument does not work when running in foreground

2019-09-05 Thread Vadim Korchagin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923585#comment-16923585 ] Vadim Korchagin commented on AIRFLOW-5414: -- UPD: the issue is actual for scheduler and worker.

[GitHub] [airflow] benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-05 Thread GitBox
benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528445423 > Hi. > > I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be

[GitHub] [airflow] TobKed commented on issue #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests

2019-09-05 Thread GitBox
TobKed commented on issue #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests URL: https://github.com/apache/airflow/pull/6018#issuecomment-528442568 Rebased on master and two pep8 violation mistakes fixed. This is

[GitHub] [airflow] ashb commented on issue #5528: Add connection protocol mapping for https:// connections

2019-09-05 Thread GitBox
ashb commented on issue #5528: Add connection protocol mapping for https:// connections URL: https://github.com/apache/airflow/pull/5528#issuecomment-528441234 Reminder to self: take a look at this one This is an automated

[jira] [Commented] (AIRFLOW-5414) --pid argument does not work when running in foreground

2019-09-05 Thread Vadim Korchagin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923569#comment-16923569 ] Vadim Korchagin commented on AIRFLOW-5414: -- [~ash] Running Airflow scheduler, webserver,

[GitHub] [airflow] ashb commented on issue #5812: [AIRFLOW-4449] updated default permission for custom roles to 'Viewer'

2019-09-05 Thread GitBox
ashb commented on issue #5812: [AIRFLOW-4449] updated default permission for custom roles to 'Viewer' URL: https://github.com/apache/airflow/pull/5812#issuecomment-528440615 Can you explain in a bit more detail what this change does, and what effect it will have?

[GitHub] [airflow] potiuk commented on issue #6011: [AIRFLOW-2842] Add GoogleCloudStorageSynchronizeBuckets operator

2019-09-05 Thread GitBox
potiuk commented on issue #6011: [AIRFLOW-2842] Add GoogleCloudStorageSynchronizeBuckets operator URL: https://github.com/apache/airflow/pull/6011#issuecomment-528436725 @nuclearpinguin -> can you please rebase/fix all issues :) ?

[jira] [Commented] (AIRFLOW-5072) gcs_hook causes out-of-memory error when downloading huge files

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923561#comment-16923561 ] ASF subversion and git services commented on AIRFLOW-5072: -- Commit

[jira] [Resolved] (AIRFLOW-5072) gcs_hook causes out-of-memory error when downloading huge files

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5072. --- Fix Version/s: 2.0.0 Resolution: Fixed > gcs_hook causes out-of-memory error when

[jira] [Commented] (AIRFLOW-5072) gcs_hook causes out-of-memory error when downloading huge files

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923560#comment-16923560 ] ASF GitHub Bot commented on AIRFLOW-5072: - potiuk commented on pull request #5685:

[GitHub] [airflow] ashb merged pull request #6019: [AIRFLOW-XXX] Add information about default pool to docs

2019-09-05 Thread GitBox
ashb merged pull request #6019: [AIRFLOW-XXX] Add information about default pool to docs URL: https://github.com/apache/airflow/pull/6019 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on issue #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once

2019-09-05 Thread GitBox
potiuk commented on issue #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once URL: https://github.com/apache/airflow/pull/5685#issuecomment-528436008 That was the intermittent kubernetes test that failed. I merge it now without waiting as it blocks some of our

[GitHub] [airflow] potiuk merged pull request #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once

2019-09-05 Thread GitBox
potiuk merged pull request #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once URL: https://github.com/apache/airflow/pull/5685 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-5414) --pid argument does not work when running in foreground

2019-09-05 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923558#comment-16923558 ] Ash Berlin-Taylor commented on AIRFLOW-5414: What's your reason for wanting {{--pid}} when

[jira] [Resolved] (AIRFLOW-5361) Add system tests for BigQuery

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5361. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add system tests for BigQuery >

[jira] [Resolved] (AIRFLOW-5414) --pid argument does not work when running in foreground

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5414. --- Fix Version/s: 2.0.0 Resolution: Fixed > --pid argument does not work when running

[GitHub] [airflow] potiuk merged pull request #5993: [AIRFLOW-3804] Extend MySQL to GCS operator tests

2019-09-05 Thread GitBox
potiuk merged pull request #5993: [AIRFLOW-3804] Extend MySQL to GCS operator tests URL: https://github.com/apache/airflow/pull/5993 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Created] (AIRFLOW-5414) --pid argument does not work when running in foreground

2019-09-05 Thread Vadim Korchagin (Jira)
Vadim Korchagin created AIRFLOW-5414: Summary: --pid argument does not work when running in foreground Key: AIRFLOW-5414 URL: https://issues.apache.org/jira/browse/AIRFLOW-5414 Project: Apache

[jira] [Resolved] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-3804. --- Resolution: Fixed > MySqlToGoogleCloudStorageOperator success when it should fail >

[GitHub] [airflow] drexpp edited a comment on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX)

2019-09-05 Thread GitBox
drexpp edited a comment on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX) URL: https://github.com/apache/airflow/pull/6000#issuecomment-528433618 @potiuk Well that feature must have been moved/deleted from master since I cannot find any reference to

[jira] [Commented] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923554#comment-16923554 ] ASF subversion and git services commented on AIRFLOW-3804: -- Commit

[jira] [Commented] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923555#comment-16923555 ] ASF subversion and git services commented on AIRFLOW-3804: -- Commit

[jira] [Commented] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923553#comment-16923553 ] ASF GitHub Bot commented on AIRFLOW-3804: - potiuk commented on pull request #5993:

[GitHub] [airflow] potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-05 Thread GitBox
potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-528433698 Hello @steven-freed -> can you please rebase and fix the one failing test? I would gladly review and merge that one.

[GitHub] [airflow] drexpp commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX)

2019-09-05 Thread GitBox
drexpp commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX) URL: https://github.com/apache/airflow/pull/6000#issuecomment-528433618 @potiuk Well that feature must have been moved/deleted from master since I cannot find any reference to

[jira] [Commented] (AIRFLOW-5319) Add system tests for Dataproc

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923549#comment-16923549 ] ASF GitHub Bot commented on AIRFLOW-5319: - potiuk commented on pull request #5924:

[GitHub] [airflow] potiuk merged pull request #5924: [AIRFLOW-5319] Add system tests for Dataproc

2019-09-05 Thread GitBox
potiuk merged pull request #5924: [AIRFLOW-5319] Add system tests for Dataproc URL: https://github.com/apache/airflow/pull/5924 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-5319) Add system tests for Dataproc

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923550#comment-16923550 ] ASF subversion and git services commented on AIRFLOW-5319: -- Commit

[jira] [Commented] (AIRFLOW-5319) Add system tests for Dataproc

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923551#comment-16923551 ] ASF subversion and git services commented on AIRFLOW-5319: -- Commit

[jira] [Commented] (AIRFLOW-5361) Add system tests for BigQuery

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923547#comment-16923547 ] ASF GitHub Bot commented on AIRFLOW-5361: - potiuk commented on pull request #5968:

[GitHub] [airflow] ashb commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX)

2019-09-05 Thread GitBox
ashb commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX) URL: https://github.com/apache/airflow/pull/6000#issuecomment-528431781 Ad-hoc is only in 1.10. My general workflow for the v1-10-* branches is that -stable is the target of PRs (as

[jira] [Commented] (AIRFLOW-5361) Add system tests for BigQuery

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923548#comment-16923548 ] ASF subversion and git services commented on AIRFLOW-5361: -- Commit

[GitHub] [airflow] potiuk merged pull request #5968: [AIRFLOW-5361] Add system tests for BigQuery

2019-09-05 Thread GitBox
potiuk merged pull request #5968: [AIRFLOW-5361] Add system tests for BigQuery URL: https://github.com/apache/airflow/pull/5968 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] tiopi commented on a change in pull request #5407: [AIRFLOW-4741] Include Sentry into core Airflow

2019-09-05 Thread GitBox
tiopi commented on a change in pull request #5407: [AIRFLOW-4741] Include Sentry into core Airflow URL: https://github.com/apache/airflow/pull/5407#discussion_r320077974 ## File path: docs/errors.rst ## @@ -0,0 +1,62 @@ +.. Licensed to the Apache Software Foundation

[jira] [Commented] (AIRFLOW-5332) Add system tests for Datastore

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923540#comment-16923540 ] ASF subversion and git services commented on AIRFLOW-5332: -- Commit

[jira] [Resolved] (AIRFLOW-5332) Add system tests for Datastore

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5332. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add system tests for Datastore >

[jira] [Commented] (AIRFLOW-5332) Add system tests for Datastore

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923539#comment-16923539 ] ASF GitHub Bot commented on AIRFLOW-5332: - potiuk commented on pull request #5937:

[GitHub] [airflow] potiuk merged pull request #5937: [AIRFLOW-5332] Add system tests for Datastore

2019-09-05 Thread GitBox
potiuk merged pull request #5937: [AIRFLOW-5332] Add system tests for Datastore URL: https://github.com/apache/airflow/pull/5937 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Assigned] (AIRFLOW-5413) Get pod configuration from JSON or Yaml

2019-09-05 Thread David Lum (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lum reassigned AIRFLOW-5413: -- Assignee: David Lum (was: d) > Get pod configuration from JSON or Yaml >

[jira] [Assigned] (AIRFLOW-5413) Get pod configuration from JSON or Yaml

2019-09-05 Thread David Lum (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lum reassigned AIRFLOW-5413: -- Assignee: d (was: Daniel Imberman) > Get pod configuration from JSON or Yaml >

[jira] [Created] (AIRFLOW-5413) Get pod configuration from JSON or Yaml

2019-09-05 Thread David Lum (Jira)
David Lum created AIRFLOW-5413: -- Summary: Get pod configuration from JSON or Yaml Key: AIRFLOW-5413 URL: https://issues.apache.org/jira/browse/AIRFLOW-5413 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mattbowden-ookla opened a new pull request #6019: [AIRFLOW-XXX] Add information about default pool to docs

2019-09-05 Thread GitBox
mattbowden-ookla opened a new pull request #6019: [AIRFLOW-XXX] Add information about default pool to docs URL: https://github.com/apache/airflow/pull/6019 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5403) Fix input check in GKE Operator

2019-09-05 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923496#comment-16923496 ] ASF subversion and git services commented on AIRFLOW-5403: -- Commit

[jira] [Commented] (AIRFLOW-5403) Fix input check in GKE Operator

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923495#comment-16923495 ] ASF GitHub Bot commented on AIRFLOW-5403: - mik-laj commented on pull request #6004:

[GitHub] [airflow] mik-laj merged pull request #6004: [AIRFLOW-5403] Fix input check in GKE Operator

2019-09-05 Thread GitBox
mik-laj merged pull request #6004: [AIRFLOW-5403] Fix input check in GKE Operator URL: https://github.com/apache/airflow/pull/6004 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-5410) AirflowConfigParser no longer find conf entries with capitalized letters

2019-09-05 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923493#comment-16923493 ] Ash Berlin-Taylor commented on AIRFLOW-5410: Sorry yes, I forgot that people could put

[jira] [Updated] (AIRFLOW-5412) Add get_conn/get_client tests to hooks

2019-09-05 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-5412: Summary: Add get_conn/get_client tests to hooks (was: Add get_conn/get_client

[jira] [Commented] (AIRFLOW-5412) Add get_conn/get_client to hooks tests

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923488#comment-16923488 ] ASF GitHub Bot commented on AIRFLOW-5412: - TobKed commented on pull request #6018:

[GitHub] [airflow] TobKed opened a new pull request #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests

2019-09-05 Thread GitBox
TobKed opened a new pull request #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests URL: https://github.com/apache/airflow/pull/6018 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5412) Add get_conn/get_client to hooks tests

2019-09-05 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5412: --- Summary: Add get_conn/get_client to hooks tests Key: AIRFLOW-5412 URL: https://issues.apache.org/jira/browse/AIRFLOW-5412 Project: Apache Airflow

[GitHub] [airflow] mik-laj commented on issue #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset

2019-09-05 Thread GitBox
mik-laj commented on issue #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset URL: https://github.com/apache/airflow/pull/5566#issuecomment-528382757 Hi. I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed. Could

[GitHub] [airflow] mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-05 Thread GitBox
mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528382309 Hi. I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed. Could you do

[GitHub] [airflow] mik-laj commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer

2019-09-05 Thread GitBox
mik-laj commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer URL: https://github.com/apache/airflow/pull/5335#issuecomment-528378431 Hi. I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed. Could you do

[GitHub] [airflow] mik-laj commented on issue #4607: WIP: [AIRFLOW-1894] Google cloud bigquery

2019-09-05 Thread GitBox
mik-laj commented on issue #4607: WIP: [AIRFLOW-1894] Google cloud bigquery URL: https://github.com/apache/airflow/pull/4607#issuecomment-528378228 Hi. I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed. Could you do rebase? Cheers

[jira] [Assigned] (AIRFLOW-5411) Too much noise is printed during pre-commit checks

2019-09-05 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk reassigned AIRFLOW-5411: - Assignee: Jarek Potiuk > Too much noise is printed during pre-commit checks >

[GitHub] [airflow] mik-laj commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR

2019-09-05 Thread GitBox
mik-laj commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR URL: https://github.com/apache/airflow/pull/4064#issuecomment-528378090 Hi. I made a change in the base class - GoogleCloudBaseHook. Your PR may need to be changed. Could you do rebase?

[jira] [Created] (AIRFLOW-5411) Too much noise is printed during pre-commit checks

2019-09-05 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-5411: - Summary: Too much noise is printed during pre-commit checks Key: AIRFLOW-5411 URL: https://issues.apache.org/jira/browse/AIRFLOW-5411 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-5208) Passed **kwargs to push_by_returning

2019-09-05 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-5208. --- Assignee: Gaurav Prachchhak Resolution: Fixed > Passed **kwargs to

[jira] [Updated] (AIRFLOW-5208) Passed **kwargs to push_by_returning

2019-09-05 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-5208: -- Fix Version/s: 2.0.0 > Passed **kwargs to push_by_returning >

[jira] [Commented] (AIRFLOW-5208) Passed **kwargs to push_by_returning

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923455#comment-16923455 ] ASF GitHub Bot commented on AIRFLOW-5208: - Fokko commented on pull request #5810:

[GitHub] [airflow] Fokko commented on issue #5810: [AIRFLOW-5208] Passed **kwargs to push_by_returning

2019-09-05 Thread GitBox
Fokko commented on issue #5810: [AIRFLOW-5208] Passed **kwargs to push_by_returning URL: https://github.com/apache/airflow/pull/5810#issuecomment-528374466 Thanks @gauravprachchhak This is an automated message from the

[GitHub] [airflow] Fokko merged pull request #5810: [AIRFLOW-5208] Passed **kwargs to push_by_returning

2019-09-05 Thread GitBox
Fokko merged pull request #5810: [AIRFLOW-5208] Passed **kwargs to push_by_returning URL: https://github.com/apache/airflow/pull/5810 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX)

2019-09-05 Thread GitBox
potiuk commented on issue #6000: [AIRFLOW-5393] UI crashes in the Ad Hoc Query menu (PULL REQUEST FIX) URL: https://github.com/apache/airflow/pull/6000#issuecomment-528370303 If that error is also present in master - it should go to master and then we can cherry-pick it to v1-10-test for

  1   2   >