[jira] [Created] (AIRFLOW-2304) Quick start documentation is not quick: should mention scheduler part

2018-04-09 Thread Shawn Xu (JIRA)
Shawn Xu created AIRFLOW-2304: - Summary: Quick start documentation is not quick: should mention scheduler part Key: AIRFLOW-2304 URL: https://issues.apache.org/jira/browse/AIRFLOW-2304 Project: Apache

[jira] [Created] (AIRFLOW-2305) Fix CI failure caused by AIRFLOW-2027

2018-04-09 Thread Kengo Seki (JIRA)
Kengo Seki created AIRFLOW-2305: --- Summary: Fix CI failure caused by AIRFLOW-2027 Key: AIRFLOW-2305 URL: https://issues.apache.org/jira/browse/AIRFLOW-2305 Project: Apache Airflow Issue Type:

[jira] [Assigned] (AIRFLOW-2306) Add Bonnier Broadcasting to README

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano reassigned AIRFLOW-2306: - Assignee: Guillermo Rodríguez Cano > Add Bonnier Broadcasting

[jira] [Created] (AIRFLOW-2306) Add Bonnier Broadcasting to README

2018-04-09 Thread JIRA
Guillermo Rodríguez Cano created AIRFLOW-2306: - Summary: Add Bonnier Broadcasting to README Key: AIRFLOW-2306 URL: https://issues.apache.org/jira/browse/AIRFLOW-2306 Project: Apache

[jira] [Assigned] (AIRFLOW-2293) Fix S3FileTransformOperator to work with boto3

2018-04-09 Thread Kengo Seki (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kengo Seki reassigned AIRFLOW-2293: --- Assignee: Kengo Seki > Fix S3FileTransformOperator to work with boto3 >

[jira] [Commented] (AIRFLOW-2306) Add Bonnier Broadcasting to README

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431135#comment-16431135 ] Guillermo Rodríguez Cano commented on AIRFLOW-2306: --- Done: 

[jira] [Commented] (AIRFLOW-2156) Parallelize Celery Executor

2018-04-09 Thread John Arnold (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431308#comment-16431308 ] John Arnold commented on AIRFLOW-2156: -- This seems like a pretty easy candidate for

[jira] [Commented] (AIRFLOW-687) Gracefully halt workers through CLI

2018-04-09 Thread John Arnold (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431330#comment-16431330 ] John Arnold commented on AIRFLOW-687: - commenting on old Jira for posterity – my solution to this was

incubator-airflow git commit: [AIRFLOW-2306] Add Bonnier Broadcasting to list of current users

2018-04-09 Thread sanand
Repository: incubator-airflow Updated Branches: refs/heads/master 44ce9ca71 -> 3beb9bcb5 [AIRFLOW-2306] Add Bonnier Broadcasting to list of current users Closes #3206 from wileeam/add-bbr-to-readme Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Closed] (AIRFLOW-2306) Add Bonnier Broadcasting to README

2018-04-09 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-2306. Resolution: Fixed > Add Bonnier Broadcasting to README >

[jira] [Created] (AIRFLOW-2307) Airflow should track Celery task ID

2018-04-09 Thread John Arnold (JIRA)
John Arnold created AIRFLOW-2307: Summary: Airflow should track Celery task ID Key: AIRFLOW-2307 URL: https://issues.apache.org/jira/browse/AIRFLOW-2307 Project: Apache Airflow Issue Type:

[jira] [Assigned] (AIRFLOW-2305) Fix CI failure caused by AIRFLOW-2027

2018-04-09 Thread Kengo Seki (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kengo Seki reassigned AIRFLOW-2305: --- Assignee: Kengo Seki > Fix CI failure caused by AIRFLOW-2027 >

[jira] [Commented] (AIRFLOW-2305) Fix CI failure caused by AIRFLOW-2027

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431073#comment-16431073 ] ASF subversion and git services commented on AIRFLOW-2305: -- Commit

[jira] [Commented] (AIRFLOW-2305) Fix CI failure caused by AIRFLOW-2027

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431075#comment-16431075 ] ASF subversion and git services commented on AIRFLOW-2305: -- Commit

[jira] [Commented] (AIRFLOW-2027) Only trigger sleep in scheduler after all files have parsed

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431074#comment-16431074 ] ASF subversion and git services commented on AIRFLOW-2027: -- Commit

[jira] [Resolved] (AIRFLOW-2305) Fix CI failure caused by AIRFLOW-2027

2018-04-09 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2305. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3205

incubator-airflow git commit: [AIRFLOW-2305][AIRFLOW-2027] Fix CI failure caused by []

2018-04-09 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master b3dea2f0d -> 44ce9ca71 [AIRFLOW-2305][AIRFLOW-2027] Fix CI failure caused by [] Closes #3205 from sekikn/AIRFLOW-2305 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Assigned] (AIRFLOW-2304) Quick start documentation is not quick: should mention scheduler part

2018-04-09 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng reassigned AIRFLOW-2304: - Assignee: Tao Feng > Quick start documentation is not quick: should mention scheduler part >

[jira] [Updated] (AIRFLOW-2280) Extra argument for comparison with another table in IntervalCheckOperator

2018-04-09 Thread Yuyin Yang (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuyin Yang updated AIRFLOW-2280: Description: Current IntervalCheckOperator can only check the values of metrics given as SQL

[jira] [Updated] (AIRFLOW-2291) Ability to specify runtimeVersion, pythonVersion and jobDir in ML Engine operator

2018-04-09 Thread David Volquartz Lebech (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Volquartz Lebech updated AIRFLOW-2291: Description: For the Google Cloud ML Engine Training Operator (in

[jira] [Assigned] (AIRFLOW-2291) Ability to specify runtimeVersion and pythonVersion in ML Engine operator

2018-04-09 Thread David Volquartz Lebech (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Volquartz Lebech reassigned AIRFLOW-2291: --- Assignee: David Volquartz Lebech > Ability to specify

incubator-airflow git commit: [AIRFLOW-2287] Update license notices

2018-04-09 Thread sanand
Repository: incubator-airflow Updated Branches: refs/heads/master f7f1d38ba -> a30f009ae [AIRFLOW-2287] Update license notices Closes #3195 from bolkedebruin/AIRFLOW-2287 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Commented] (AIRFLOW-2287) Missing and incorrect license headers

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430202#comment-16430202 ] ASF subversion and git services commented on AIRFLOW-2287: -- Commit

[jira] [Assigned] (AIRFLOW-2301) S3 to Google Cloud Storage Operator

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano reassigned AIRFLOW-2301: - Assignee: Guillermo Rodríguez Cano > S3 to Google Cloud

incubator-airflow git commit: [AIRFLOW-2284] GCS to S3 operator

2018-04-09 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master a30f009ae -> 4e80b5f10 [AIRFLOW-2284] GCS to S3 operator Closes #3190 from NielsZeilemaker/gcp_to_s3 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Commented] (AIRFLOW-2281) Add support for Sendgrid categories

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430279#comment-16430279 ] ASF subversion and git services commented on AIRFLOW-2281: -- Commit

incubator-airflow git commit: [AIRFLOW-2027] Only trigger sleep in scheduler after all files have parsed

2018-04-09 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master 3ece6f6dc -> 3c4f1fd9e [AIRFLOW-2027] Only trigger sleep in scheduler after all files have parsed Closes #2986 from aoen/ddavydov--open_source_disab le_unecessary_sleep_in_scheduler_loop Project:

[jira] [Resolved] (AIRFLOW-2256) SparkOperator supports client standalone mode and retry mechanism

2018-04-09 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2256. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3163

[jira] [Resolved] (AIRFLOW-2027) Only trigger sleep in scheduler after all files have parsed

2018-04-09 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2027. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #2986

[jira] [Commented] (AIRFLOW-2027) Only trigger sleep in scheduler after all files have parsed

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430253#comment-16430253 ] ASF subversion and git services commented on AIRFLOW-2027: -- Commit

[jira] [Created] (AIRFLOW-2302) Add missing operators/hooks to the docs

2018-04-09 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-2302: - Summary: Add missing operators/hooks to the docs Key: AIRFLOW-2302 URL: https://issues.apache.org/jira/browse/AIRFLOW-2302 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2287) Missing and incorrect license headers

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430201#comment-16430201 ] ASF subversion and git services commented on AIRFLOW-2287: -- Commit

[jira] [Commented] (AIRFLOW-2284) Google Cloud Storage to S3 Operator

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430228#comment-16430228 ] ASF subversion and git services commented on AIRFLOW-2284: -- Commit

[jira] [Commented] (AIRFLOW-2256) SparkOperator supports client standalone mode and retry mechanism

2018-04-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430250#comment-16430250 ] ASF subversion and git services commented on AIRFLOW-2256: -- Commit

[jira] [Resolved] (AIRFLOW-2284) Google Cloud Storage to S3 Operator

2018-04-09 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2284. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3190

incubator-airflow git commit: [AIRFLOW-2256] SparkOperator: Add Client Standalone mode and retry mechanism

2018-04-09 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 4e80b5f10 -> 3ece6f6dc [AIRFLOW-2256] SparkOperator: Add Client Standalone mode and retry mechanism Closes #3163 from milanvdm/milanvdm/improve-spark- operator Project:

[jira] [Created] (AIRFLOW-2301) S3 to Google Cloud Storage Operator

2018-04-09 Thread JIRA
Guillermo Rodríguez Cano created AIRFLOW-2301: - Summary: S3 to Google Cloud Storage Operator Key: AIRFLOW-2301 URL: https://issues.apache.org/jira/browse/AIRFLOW-2301 Project: Apache

incubator-airflow git commit: [AIRFLOW-2281] Add support for Sendgrid categories

2018-04-09 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 3c4f1fd9e -> b3dea2f0d [AIRFLOW-2281] Add support for Sendgrid categories Closes #3188 from ms32035/sendgrid_categories Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Resolved] (AIRFLOW-2281) Add support for Sendgrid categories

2018-04-09 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2281. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3188

[jira] [Updated] (AIRFLOW-2303) S3 List Operator

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano updated AIRFLOW-2303: -- Fix Version/s: 2.0.0 > S3 List Operator > > >

[jira] [Commented] (AIRFLOW-2128) 'Tall' DAGs scale worse than 'wide' DAGs

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430399#comment-16430399 ] Máté Szabó commented on AIRFLOW-2128: - {code:java} min_file_process_interval = 0 {code} I believe

[jira] [Assigned] (AIRFLOW-2303) S3 List Operator

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano reassigned AIRFLOW-2303: - Assignee: Guillermo Rodríguez Cano > S3 List Operator >

[jira] [Created] (AIRFLOW-2303) S3 List Operator

2018-04-09 Thread JIRA
Guillermo Rodríguez Cano created AIRFLOW-2303: - Summary: S3 List Operator Key: AIRFLOW-2303 URL: https://issues.apache.org/jira/browse/AIRFLOW-2303 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-2301) S3 to Google Cloud Storage Operator

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillermo Rodríguez Cano updated AIRFLOW-2301: -- Fix Version/s: 2.0.0 > S3 to Google Cloud Storage Operator >

[jira] [Commented] (AIRFLOW-2303) S3 List Operator

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430501#comment-16430501 ] Guillermo Rodríguez Cano commented on AIRFLOW-2303: --- Just submitted the PR: