[jira] [Resolved] (AIRFLOW-6267) Add View Creation to BigQueryOperator

2019-12-19 Thread Jarek Potiuk (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jarek Potiuk resolved AIRFLOW-6267.
---
Fix Version/s: 2.0.0
   Resolution: Fixed

> Add View Creation to BigQueryOperator
> -
>
> Key: AIRFLOW-6267
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6267
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp
>Affects Versions: 1.10.6
>Reporter: Ryan Yuan
>Assignee: Ryan Yuan
>Priority: Major
> Fix For: 2.0.0
>
>
> Add View Creation to BigQueryOperator



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6267) Add View Creation to BigQueryOperator

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000693#comment-17000693
 ] 

ASF subversion and git services commented on AIRFLOW-6267:
--

Commit 77eb492b9cf279071d6123e4f0064363ed2b47b3 in airflow's branch 
refs/heads/master from Ryan Yuan
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=77eb492 ]

[AIRFLOW-6267] Add View Creation to BigQueryOperator (#6838)




> Add View Creation to BigQueryOperator
> -
>
> Key: AIRFLOW-6267
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6267
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp
>Affects Versions: 1.10.6
>Reporter: Ryan Yuan
>Assignee: Ryan Yuan
>Priority: Major
>
> Add View Creation to BigQueryOperator



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [airflow] dstandish opened a new pull request #6863: [AIRFLOW-XXX] add docs showing usage of `Connection.get_uri`

2019-12-19 Thread GitBox
dstandish opened a new pull request #6863: [AIRFLOW-XXX] add docs showing usage 
of `Connection.get_uri`
URL: https://github.com/apache/airflow/pull/6863
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [ ] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/browse/AIRFLOW-XXX
 - In case you are fixing a typo in the documentation you can prepend your 
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
 - In case you are proposing a fundamental code change, you need to create 
an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)).
 - In case you are adding a dependency, check if the license complies with 
the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   
   ### Description
   
   - [ ] Here are some details about my PR, including screenshots of any UI 
changes:
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (AIRFLOW-6105) Rename bigtable service

2019-12-19 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000602#comment-17000602
 ] 

ASF GitHub Bot commented on AIRFLOW-6105:
-

michalslowikowski00 commented on pull request #6862: [AIRFLOW-6105] [AIP-21] 
Rename Bigtable operators and sensor
URL: https://github.com/apache/airflow/pull/6862
 
 
   Below operators and sensor have been changed:
   BigtableClusterUpdateOperator, BigtableInstanceCreateOperator, 
BigtableInstanceDeleteOperator, BigtableTableCreateOperator, 
BigtableTableDeleteOperator, BigtableTableWaitForReplicationSensor
   
   ### Jira
   
   - [ ] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/browse/AIRFLOW-6105
 - In case you are fixing a typo in the documentation you can prepend your 
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
 - In case you are proposing a fundamental code change, you need to create 
an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)).
 - In case you are adding a dependency, check if the license complies with 
the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   
   ### Description
   
   - [ ] Here are some details about my PR, including screenshots of any UI 
changes:
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Rename bigtable service
> ---
>
> Key: AIRFLOW-6105
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6105
> Project: Apache Airflow
>  Issue Type: Sub-task
>  Components: gcp
>Affects Versions: 1.10.6
>Reporter: Michał Słowikowski
>Assignee: Michał Słowikowski
>Priority: Minor
>
> Added these classes:
>  * airflow.gcp.operators.bigtable.BigtableUpdateClusterOperator
> airflow.gcp.operators.bigtable.BigtableCreateInstanceOperator
> airflow.gcp.operators.bigtable.BigtableDeleteInstanceOperator
> airflow.gcp.operators.bigtable.BigtableCreateTableOperator
> airflow.gcp.operators.bigtable.BigtableDeleteTableOperator
> airflow.gcp.sensors.bigtable.BigtableTableReplicationCompletedSensor
> airflow.gcp.hooks.bigtable.BigtableHook



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [airflow] michalslowikowski00 opened a new pull request #6862: [AIRFLOW-6105] [AIP-21] Rename Bigtable operators and sensor

2019-12-19 Thread GitBox
michalslowikowski00 opened a new pull request #6862: [AIRFLOW-6105] [AIP-21] 
Rename Bigtable operators and sensor
URL: https://github.com/apache/airflow/pull/6862
 
 
   Below operators and sensor have been changed:
   BigtableClusterUpdateOperator, BigtableInstanceCreateOperator, 
BigtableInstanceDeleteOperator, BigtableTableCreateOperator, 
BigtableTableDeleteOperator, BigtableTableWaitForReplicationSensor
   
   ### Jira
   
   - [ ] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/browse/AIRFLOW-6105
 - In case you are fixing a typo in the documentation you can prepend your 
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
 - In case you are proposing a fundamental code change, you need to create 
an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)).
 - In case you are adding a dependency, check if the license complies with 
the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   
   ### Description
   
   - [ ] Here are some details about my PR, including screenshots of any UI 
changes:
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (AIRFLOW-6228) Ability for a single task to consume more than 1 slot of a pool

2019-12-19 Thread Cooper Gillan (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000588#comment-17000588
 ] 

Cooper Gillan commented on AIRFLOW-6228:


Is https://issues.apache.org/jira/browse/AIRFLOW-1467 the same as this one?

> Ability for a single task to consume more than 1 slot of a pool
> ---
>
> Key: AIRFLOW-6228
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6228
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: scheduler
>Affects Versions: 1.10.6
>Reporter: t oo
>Priority: Major
>
> Right now each task instance can consume 1 slot inside a pool, but some tasks 
> are bigger/smaller than others. For tasks that I know are 'big' i want to be 
> able to say consume say 4 slots from a pool



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-4525) Trigger Dag Operator causes duplicate key exceptions and can cause runaway dag spawning as it is not atomic at the DB level (on Postgres at least.)

2019-12-19 Thread Tony Brookes (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000561#comment-17000561
 ] 

Tony Brookes commented on AIRFLOW-4525:
---

We get orphaned sub dag entries because they have been triggered but then an 
exception occurred so they simply lose their association with their parent.

In prior versions, the exception was swallowed so the operator succeeded.  So 
you would get 1 instance of each orphaned sub dag.

In the later version, the exception is NOT swallowed, so the operator FAILS.  
And when it retries it gets them all again, and so and and so forth.

But as I say, the main issue is that I think it's incorrect to trigger the sub 
dags at all.  When you configure the operator you're telling it to trigger one 
specific dag, not one dag and all it's sub dags (even if their pre-requisites 
are nowhere near met.)

 

Make sense?

> Trigger Dag Operator causes duplicate key exceptions and can cause runaway 
> dag spawning as it is not atomic at the DB level (on Postgres at least.)
> ---
>
> Key: AIRFLOW-4525
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4525
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: DAG, DagRun
>Affects Versions: 1.10.3
>Reporter: Tony Brookes
>Priority: Blocker
>
> When using the TriggerDagRunOperator there is a problem in the code which 
> loops round subdags scheduling them.  You will not see this issue if you only 
> have one level of sub dag, but if your sub dags have sub dags then you will 
> see it.
> The code pops an item off the list (non unique) and schedules it.  It then 
> appends all sub dags of the dag it popped off the list to the current list.  
> It keeps doing this until the list is empty.
> The problem is that <>.subdags returns _*all*_ subdags at 
> _*all*_ levels.  So when you process a <> 
> it calls <>.subdags and once agains this will append all 
> its subdags, _*which are already in the list*_.  Thus you are now certain you 
> will get a duplicate key exception as the same dag ID and run ID are present 
> twice.
> Up to and including 1.10.2 this is not a significant problem most of the 
> time.  You see the duplicate key errors in the logs but it does not cause the 
> operator to raise and hence the task actually succeeds.  That said, you do 
> get a load of "running" sub dags in the console which never really do 
> anything as they aren't invoked from the parent dag when it wants them to run 
> and hence have no "task instance" connection to that dag.
> *+However, in 1.10.3 this causes havoc.+*
> Firstly, it no longer exits cleanly.  It causes the operator to raise an 
> error and so it fails.  Worse, since the statements it has executed to 
> schedule is dag are _*not*_ in the same transaction, all the dags before the 
> first duplicate _*are triggered*_.  But since the task will subsequently be 
> retried (if configured) _*they will be triggered again.*_  Because the logic 
> to generate the run ID use now() as part of the key they generate, subsequent 
> invocations will have a different run ID and hence will cause all the dags 
> before the first duplicate exception to be scheduled repeatedly, up to the 
> maximum retry limit.  You still get all the orphaned sub dag entries I 
> mentioned from 10.2, but you get many many copies of them.
> I'm not sure what the best fix is (or if it's my place to suggest one) but 
> from what I've seen the cleanest approach is either to use a set, to avoid 
> duplicate entries, rather than the current list based approach OR continue to 
> use the list with it's "pop" semantics but keep track of items already 
> processed and avoid re-appending them.
> This would fix the current problem, but to be honest it feels semantically 
> *_incorrect_* to trigger the sub dags in this way.  The top level dag invokes 
> the sub dags as task instances like any other and you're going behind its 
> back invoking them this way.  Moreover, the semantic contract of the 
> TriggerDagRunOperator is that it takes a single dag ID as input, implicitly 
> creating the expectation that this is the _*only dag which will be 
> triggered.*_  Scheduling the sub dags as part of doing this feels wrong and 
> actually creates an error whilst doing nothing to help the operation of the 
> platform (unless there is a different configuration set up I am not thinking 
> of which is entirely possible.)
> But as far as I can discern, if you _*only*_ trigger the top level dag you've 
> been _*asked*_ to trigger then actually, everything will work just fine.  The 
> SubDagOperator which wraps the sub dags will trigger the sub dag anyway at 
> the right time, based on whatever dependencies are in the top 

[jira] [Comment Edited] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2019-12-19 Thread Zhidong (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000558#comment-17000558
 ] 

Zhidong edited comment on AIRFLOW-2516 at 12/20/19 2:26 AM:


I'm using Airflow 1.9.0 now.

There are only two queries that matter for this issue.
 1. UPDATE task_instance, dag_run SET ...(Q1) from thread 256467507(T1), T1 did 
a commit/rollback just before Q1.
 2. UPDATE task_instance SET ...(Q2) from thread 256620571(T2).

Q1 perform a scan on secondary index(`ti_state`) records, sets exclusive 
next-key lock on every record the search encounters, and also their 
corresponding clustered index(`PRIMARY`) records.
 Q2 perform a PRIMARY index scan, sets lock on it, and also implicit lock 
secondary index(`ti_state`) records that are affected.

Deadlock won't happen if the locking process is fast enough, and it's hard to 
reproduce this behavior.

Maybe this is a MySQL issue, or an expected behavior.


was (Author: 0x4ec7):
I'm using Airflow 1.9.0 now.

There are only two queries that matter for this issue.
1. UPDATE task_instance, dag_run SET ...(Q1) from thread 256467507(T1), T1 did 
a commit/rollback just before Q1.
2. UPDATE task_instance SET ...(Q2) from thread 256620571(T2).

Q1 perform a scan on secondary index(`ti_state`) records, sets exclusive 
next-key lock on every record the search encounters, and also their 
corresponding clustered index(`PRIMARY`) records.
Q2 perform a PRIMARY index scan, sets lock on it, and also implicit lock 
secondary index(`ti_state`) records that are affected.

Deadlock won't happen if the locking process is fast enough, and it's hard to 
reproduce this behavior.

Maybe this is a MySQL issue, or a expected behavior.

> Deadlock found when trying to update task_instance table
> 
>
> Key: AIRFLOW-2516
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2516
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: DagRun
>Affects Versions: 1.8.0
>Reporter: Jeff Liu
>Priority: Major
>
>  
>  
> {code:java}
> [2018-05-23 17:59:57,218] {base_task_runner.py:98} INFO - Subtask: 
> [2018-05-23 17:59:57,217] {base_executor.py:49} INFO - Adding to queue: 
> airflow run production_wipeout_wipe_manager.Carat Carat_20180227 
> 2018-05-23T17:41:18.815809 --local -sd DAGS_FOLDER/wipeout/wipeout.py
> [2018-05-23 17:59:57,231] {base_task_runner.py:98} INFO - Subtask: Traceback 
> (most recent call last):
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/bin/airflow", line 27, in 
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: 
> args.func(args)
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/bin/cli.py", line 392, in run
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: 
> pool=args.pool,
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/utils/db.py", line 50, in 
> wrapper
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: result = 
> func(*args, **kwargs)
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 1532, in 
> _run_raw_task
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: 
> self.handle_failure(e, test_mode, context)
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 1641, in 
> handle_failure
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: 
> session.merge(self)
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 
> 1920, in merge
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: 
> _resolve_conflict_map=_resolve_conflict_map)
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 
> 1974, in _merge
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: merged = 
> self.query(mapper.class_).get(key[1])
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 882, 
> in get
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: ident, 
> loading.load_on_pk_identity)
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 952, 
> in _get_impl
> [2018-05-23 17:59:57,237] {base_task_runner.py:98} INFO - Subtask: return 
> db_load_fn(self, 

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2019-12-19 Thread Zhidong (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000558#comment-17000558
 ] 

Zhidong commented on AIRFLOW-2516:
--

I'm using Airflow 1.9.0 now.

There are only two queries that matter for this issue.
1. UPDATE task_instance, dag_run SET ...(Q1) from thread 256467507(T1), T1 did 
a commit/rollback just before Q1.
2. UPDATE task_instance SET ...(Q2) from thread 256620571(T2).

Q1 perform a scan on secondary index(`ti_state`) records, sets exclusive 
next-key lock on every record the search encounters, and also their 
corresponding clustered index(`PRIMARY`) records.
Q2 perform a PRIMARY index scan, sets lock on it, and also implicit lock 
secondary index(`ti_state`) records that are affected.

Deadlock won't happen if the locking process is fast enough, and it's hard to 
reproduce this behavior.

Maybe this is a MySQL issue, or a expected behavior.

> Deadlock found when trying to update task_instance table
> 
>
> Key: AIRFLOW-2516
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2516
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: DagRun
>Affects Versions: 1.8.0
>Reporter: Jeff Liu
>Priority: Major
>
>  
>  
> {code:java}
> [2018-05-23 17:59:57,218] {base_task_runner.py:98} INFO - Subtask: 
> [2018-05-23 17:59:57,217] {base_executor.py:49} INFO - Adding to queue: 
> airflow run production_wipeout_wipe_manager.Carat Carat_20180227 
> 2018-05-23T17:41:18.815809 --local -sd DAGS_FOLDER/wipeout/wipeout.py
> [2018-05-23 17:59:57,231] {base_task_runner.py:98} INFO - Subtask: Traceback 
> (most recent call last):
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/bin/airflow", line 27, in 
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: 
> args.func(args)
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/bin/cli.py", line 392, in run
> [2018-05-23 17:59:57,232] {base_task_runner.py:98} INFO - Subtask: 
> pool=args.pool,
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/utils/db.py", line 50, in 
> wrapper
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: result = 
> func(*args, **kwargs)
> [2018-05-23 17:59:57,233] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 1532, in 
> _run_raw_task
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: 
> self.handle_failure(e, test_mode, context)
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 1641, in 
> handle_failure
> [2018-05-23 17:59:57,234] {base_task_runner.py:98} INFO - Subtask: 
> session.merge(self)
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 
> 1920, in merge
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: 
> _resolve_conflict_map=_resolve_conflict_map)
> [2018-05-23 17:59:57,235] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 
> 1974, in _merge
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: merged = 
> self.query(mapper.class_).get(key[1])
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 882, 
> in get
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: ident, 
> loading.load_on_pk_identity)
> [2018-05-23 17:59:57,236] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 952, 
> in _get_impl
> [2018-05-23 17:59:57,237] {base_task_runner.py:98} INFO - Subtask: return 
> db_load_fn(self, primary_key_identity)
> [2018-05-23 17:59:57,237] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 247, 
> in load_on_pk_i
> dentity
> [2018-05-23 17:59:57,237] {base_task_runner.py:98} INFO - Subtask: return 
> q.one()
> [2018-05-23 17:59:57,238] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2884, 
> in one
> [2018-05-23 17:59:57,238] {base_task_runner.py:98} INFO - Subtask: ret = 
> self.one_or_none()
> [2018-05-23 17:59:57,238] {base_task_runner.py:98} INFO - Subtask: File 
> "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2854, 
> in one_or_none
> [2018-05-23 17:59:57,238] {base_task_runner.py:98} INFO - Subtask: ret = 
> list(self)
> 

[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000539#comment-17000539
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 1369a494eb99a2ec735df4b646a95db05b202cf0 in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1369a49 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000534#comment-17000534
 ] 

ASF subversion and git services commented on AIRFLOW-6312:
--

Commit c8597cbf143b970ad3c7b0d62e3b44d1dfdc8afe in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c8597cb ]

[AIRFLOW-6312] Unpin marshmallow-sqlalchemy for Py>3.5 (#6861)



> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> (/usr/local/lib/python3.6/site-packages), 
> Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000532#comment-17000532
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit afebcf9cb99e9a2217e41e0b1ec1e82f3ecbe8b1 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=afebcf9 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000531#comment-17000531
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 02c4effcf54aabdf8af8bcd9e54ef09d6fab in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=02c4eff ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000536#comment-17000536
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 496e407a3050ce81d8b7ba04322979595b5f71f3 in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=496e407 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000533#comment-17000533
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit c5ed70a3f7c6c29875f25247daecc34597b369a4 in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c5ed70a ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000535#comment-17000535
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 1cd474d337373a3788b283fe1b31570b09ae8cd7 in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1cd474d ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 2.0.0
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000528#comment-17000528
 ] 

ASF subversion and git services commented on AIRFLOW-6312:
--

Commit c8597cbf143b970ad3c7b0d62e3b44d1dfdc8afe in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c8597cb ]

[AIRFLOW-6312] Unpin marshmallow-sqlalchemy for Py>3.5 (#6861)



> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> (/usr/local/lib/python3.6/site-packages), 
> Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000526#comment-17000526
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit afebcf9cb99e9a2217e41e0b1ec1e82f3ecbe8b1 in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=afebcf9 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000525#comment-17000525
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 02c4effcf54aabdf8af8bcd9e54ef09d6fab in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=02c4eff ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000527#comment-17000527
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit c5ed70a3f7c6c29875f25247daecc34597b369a4 in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c5ed70a ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread Kaxil Naik (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kaxil Naik updated AIRFLOW-6269:

Fix Version/s: (was: 1.10.7)
   2.0.0

> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 2.0.0
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000523#comment-17000523
 ] 

ASF subversion and git services commented on AIRFLOW-6312:
--

Commit 0fa2e35f730600e6bd802f606545989cdbd0c17a in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0fa2e35 ]

[AIRFLOW-6312] Unpin marshmallow-sqlalchemy for Py>3.5 (#6861)



> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> (/usr/local/lib/python3.6/site-packages), 
> Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread Kaxil Naik (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kaxil Naik resolved AIRFLOW-6312.
-
Resolution: Fixed

> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> (/usr/local/lib/python3.6/site-packages), 
> Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000502#comment-17000502
 ] 

ASF GitHub Bot commented on AIRFLOW-6312:
-

kaxil commented on pull request #6861: [AIRFLOW-6312] Unpin 
marshmallow-sqlalchemy for Py>3.5
URL: https://github.com/apache/airflow/pull/6861
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [x] https://issues.apache.org/jira/browse/AIRFLOW-6312
   
   ### Description
   
   - [x] Here are some details about my PR, including screenshots of any UI 
changes:
   ```
   As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
is conflicting versions of marshmallow-sqlalchemy
   
   With 
https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
 we should also unpin Marshmallow
   
   

 Captured stderr call 

   Traceback (most recent call last):
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 583, in _build_master
   ws.require(__requires__)
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 900, in require
   needed = self.resolve(parse_requirements(requirements))
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 791, in resolve
   raise VersionConflict(dist, req).with_context(dependent_req)
   pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
(/usr/local/lib/python3.6/site-packages), 
Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
   OptionsAttachments
   ```
   
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [x] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [x] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> 

[GitHub] [airflow] kaxil opened a new pull request #6861: [AIRFLOW-6312] Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread GitBox
kaxil opened a new pull request #6861: [AIRFLOW-6312] Unpin 
marshmallow-sqlalchemy for Py>3.5
URL: https://github.com/apache/airflow/pull/6861
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [x] https://issues.apache.org/jira/browse/AIRFLOW-6312
   
   ### Description
   
   - [x] Here are some details about my PR, including screenshots of any UI 
changes:
   ```
   As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
is conflicting versions of marshmallow-sqlalchemy
   
   With 
https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
 we should also unpin Marshmallow
   
   

 Captured stderr call 

   Traceback (most recent call last):
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 583, in _build_master
   ws.require(__requires__)
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 900, in require
   needed = self.resolve(parse_requirements(requirements))
 File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
line 791, in resolve
   raise VersionConflict(dist, req).with_context(dependent_req)
   pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
(/usr/local/lib/python3.6/site-packages), 
Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
   OptionsAttachments
   ```
   
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [x] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [x] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000501#comment-17000501
 ] 

ASF subversion and git services commented on AIRFLOW-6312:
--

Commit 55407af8c45b6e82696477f5ae47b4ff75495a6b in airflow's branch 
refs/heads/fix-marshmallow from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=55407af ]

[AIRFLOW-6312] Unpin marshmallow-sqlalchemy for Py>3.5


> Unpin marshmallow-sqlalchemy for Py>3.5
> ---
>
> Key: AIRFLOW-6312
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.7
>Reporter: Kaxil Naik
>Assignee: Kaxil Naik
>Priority: Major
> Fix For: 1.10.7
>
>
> As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there 
> is conflicting versions of marshmallow-sqlalchemy
> With 
> https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
>   we should also unpin Marshmallow
> {noformat}
> 
>  Captured stderr call 
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 583, in _build_master
> ws.require(__requires__)
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 900, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", 
> line 791, in resolve
> raise VersionConflict(dist, req).with_context(dependent_req)
> pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
> (/usr/local/lib/python3.6/site-packages), 
> Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (AIRFLOW-6312) Unpin marshmallow-sqlalchemy for Py>3.5

2019-12-19 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-6312:
---

 Summary: Unpin marshmallow-sqlalchemy for Py>3.5
 Key: AIRFLOW-6312
 URL: https://issues.apache.org/jira/browse/AIRFLOW-6312
 Project: Apache Airflow
  Issue Type: Bug
  Components: dependencies
Affects Versions: 1.10.7
Reporter: Kaxil Naik
Assignee: Kaxil Naik
 Fix For: 1.10.7


As can be seen in https://travis-ci.org/apache/airflow/jobs/627441604 there is 
conflicting versions of marshmallow-sqlalchemy

With 
https://github.com/apache/airflow/commit/a4f7ef12ca54d0e537e3d438aee3a68f76b7aebb
  we should also unpin Marshmallow

{noformat}

 Captured stderr call 

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 
583, in _build_master
ws.require(__requires__)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 
900, in require
needed = self.resolve(parse_requirements(requirements))
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 
791, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (marshmallow 3.3.0 
(/usr/local/lib/python3.6/site-packages), 
Requirement.parse('marshmallow<2.20,>=2.18.0'), {'flask-appbuilder'})
{noformat}






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6311) Remove python2 from codebase

2019-12-19 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000497#comment-17000497
 ] 

ASF GitHub Bot commented on AIRFLOW-6311:
-

xinbinhuang commented on pull request #6860: [AIRFLOW-6311] Remove python2 from 
codebase
URL: https://github.com/apache/airflow/pull/6860
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [x] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6311
   
   
   ### Description
   
   -  Remove workaround for python2 `newstr` from settings.py
   - Change default python interpreter for dataflow to python3, given that 
support is mostly finished. and they are also about to sunset python2 in 2020, 
( thought the timeline has not been set yet)
   - Dataflow python3 support roadmap: 
https://issues.apache.org/jira/browse/BEAM-1251#comment-16979381]
   - Python2 sunset schedule: 
https://issues.apache.org/jira/browse/BEAM-8371
   - Apache-beam sign (without detailed timeline) on 
https://python3statement.org/
   - It depends on when will this be merged in. We may also drop the 
`py_interpreter` all together
   
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Remove python2 from codebase
> 
>
> Key: AIRFLOW-6311
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6311
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core, gcp
>Affects Versions: 1.10.6
>Reporter: Xinbin Huang
>Priority: Major
> Fix For: 2.0.0
>
>
> Remove additional python2 related code from the code base. And also change 
> the default Python interpreter for Dataflow to python3 given that it is 
> nearly finished.
> Reference
> Dataflow python3 support roadmap: 
> https://issues.apache.org/jira/browse/BEAM-1251#comment-16979381]
> Python2 sunset schedule: https://issues.apache.org/jira/browse/BEAM-8371
> Apache-beam sign (without detailed timeline) on 
> [https://python3statement.org/]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [airflow] xinbinhuang opened a new pull request #6860: [AIRFLOW-6311] Remove python2 from codebase

2019-12-19 Thread GitBox
xinbinhuang opened a new pull request #6860: [AIRFLOW-6311] Remove python2 from 
codebase
URL: https://github.com/apache/airflow/pull/6860
 
 
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [x] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6311
   
   
   ### Description
   
   -  Remove workaround for python2 `newstr` from settings.py
   - Change default python interpreter for dataflow to python3, given that 
support is mostly finished. and they are also about to sunset python2 in 2020, 
( thought the timeline has not been set yet)
   - Dataflow python3 support roadmap: 
https://issues.apache.org/jira/browse/BEAM-1251#comment-16979381]
   - Python2 sunset schedule: 
https://issues.apache.org/jira/browse/BEAM-8371
   - Apache-beam sign (without detailed timeline) on 
https://python3statement.org/
   - It depends on when will this be merged in. We may also drop the 
`py_interpreter` all together
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Created] (AIRFLOW-6311) Remove python2 from codebase

2019-12-19 Thread Xinbin Huang (Jira)
Xinbin Huang created AIRFLOW-6311:
-

 Summary: Remove python2 from codebase
 Key: AIRFLOW-6311
 URL: https://issues.apache.org/jira/browse/AIRFLOW-6311
 Project: Apache Airflow
  Issue Type: Improvement
  Components: core, gcp
Affects Versions: 1.10.6
Reporter: Xinbin Huang
 Fix For: 2.0.0


Remove additional python2 related code from the code base. And also change the 
default Python interpreter for Dataflow to python3 given that it is nearly 
finished.

Reference

Dataflow python3 support roadmap: 
https://issues.apache.org/jira/browse/BEAM-1251#comment-16979381]

Python2 sunset schedule: https://issues.apache.org/jira/browse/BEAM-8371

Apache-beam sign (without detailed timeline) on [https://python3statement.org/]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Comment Edited] (AIRFLOW-6186) Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server

2019-12-19 Thread Xinbin Huang (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000458#comment-17000458
 ] 

Xinbin Huang edited comment on AIRFLOW-6186 at 12/19/19 10:30 PM:
--

[~memjr] Yeah pleasure.. Did not really have time to dig into this


was (Author: xbhuang):
Yeah pleasure.. Did not really have time to dig into this [~memjr]

> Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server
> 
>
> Key: AIRFLOW-6186
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6186
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6
>Reporter: Xinbin Huang
>Assignee: Mario Mendes
>Priority: Major
>
> As the author of `pymssql` project announce to discontinue supporting the 
> PyMSSQL project. It is better to switch over to other package (i.e. pyodbc) 
> for better stability 
> Note: the current workaround is to pin down the version to <3.0 ( 
> -AIRFLOW-5942- )



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (AIRFLOW-6186) Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server

2019-12-19 Thread Xinbin Huang (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xinbin Huang reassigned AIRFLOW-6186:
-

Assignee: Mario Mendes  (was: Xinbin Huang)

> Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server
> 
>
> Key: AIRFLOW-6186
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6186
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6
>Reporter: Xinbin Huang
>Assignee: Mario Mendes
>Priority: Major
>
> As the author of `pymssql` project announce to discontinue supporting the 
> PyMSSQL project. It is better to switch over to other package (i.e. pyodbc) 
> for better stability 
> Note: the current workaround is to pin down the version to <3.0 ( 
> -AIRFLOW-5942- )



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6186) Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server

2019-12-19 Thread Xinbin Huang (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000458#comment-17000458
 ] 

Xinbin Huang commented on AIRFLOW-6186:
---

Yeah pleasure.. Did not really have time to dig into this [~memjr]

> Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server
> 
>
> Key: AIRFLOW-6186
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6186
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6
>Reporter: Xinbin Huang
>Assignee: Xinbin Huang
>Priority: Major
>
> As the author of `pymssql` project announce to discontinue supporting the 
> PyMSSQL project. It is better to switch over to other package (i.e. pyodbc) 
> for better stability 
> Note: the current workaround is to pin down the version to <3.0 ( 
> -AIRFLOW-5942- )



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [airflow] ZxMYS opened a new pull request #6859: [AIRFLOW-XXXX] Fix downgrade function of db migration 0e2a74e0fc9f

2019-12-19 Thread GitBox
ZxMYS opened a new pull request #6859: [AIRFLOW-] Fix downgrade function of 
db migration 0e2a74e0fc9f
URL: https://github.com/apache/airflow/pull/6859
 
 
   ### Description
   
   - [x] Here are some details about my PR, including screenshots of any UI 
changes:
   The db migration rev 0e2a74e0fc9f has a few invalid column names in its 
downgrade steps. Obviously there's no 'DATETIME' column in the tables and they 
should be 'timestamp' (as you can see in the upgrade steps). 
   
   I think when the file was coded the author did a replace all and didn't 
check what was replaced.
   
   ### Tests
   
   - [x] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   Just fixing typos 
   
   ### Commits
   
   - [x] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread Kaxil Naik (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kaxil Naik updated AIRFLOW-6297:

Fix Version/s: (was: 1.10.7)
   2.0.0

> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread Jarek Potiuk (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jarek Potiuk resolved AIRFLOW-6309.
---
Fix Version/s: 1.10.7
   Resolution: Fixed

> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


svn commit: r37311 - /dev/airflow/1.10.7rc2/

2019-12-19 Thread kaxilnaik
Author: kaxilnaik
Date: Thu Dec 19 21:53:47 2019
New Revision: 37311

Log:
Add artifacts for Airflow 1.10.7rc2

Added:
dev/airflow/1.10.7rc2/
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz   (with props)
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz   (with props)
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl   (with 
props)
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl.asc
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl.sha512

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc Thu Dec 19 
21:53:47 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEEnF1VgQO7y7q8bnCdfzNCiX6DksFAl378QsACgkQdfzNCiX6
+Dks3zgf/W7xDf/jkPDfqi8RM+v4wcdficDIuoT/qYWUYs/dYF6r53d8STn2nBq6n
+e/Ud4SgXqf1/R7uCQ9ND4/s+wo0SP35jsL4tz4ZvqLlUuLaD4G+s2eZz7hDySeR9
+87XB8Ek8R13kcArRZinc2kVypy708SBc2+WmglLt0uODDJop+vaQZ3wSC5iMqD5G
+OsBtVb72HnJ0unawaIWHt4RbCyDKrI767DLobxwbVR6XX/pmNMgW30oSfq+WRZbt
+pbzQhXPBuvtFJGAMT3+sVgRiybkjdJ6tEBwxkylqN2v0kuff32nbsLHkVkzqorx1
+Ti9Xtg67wToAhfQlk00SlJSqVFUCew==
+=3lT4
+-END PGP SIGNATURE-

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512 (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512 Thu Dec 19 
21:53:47 2019
@@ -0,0 +1,4 @@
+apache-airflow-1.10.7rc2-bin.tar.gz: 6D24B9C9 8A489736 0D8345F4 F5421D29
+ F0C0ADC6 6D7CBE71 E32E6130 D804BE40
+ D5B12178 5F5DD217 24D802DA 51A266FF
+ 85CDB6A6 9B0BACEC 2EBC85B2 BBA1BA7B

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc Thu Dec 19 
21:53:47 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEEnF1VgQO7y7q8bnCdfzNCiX6DksFAl378QYACgkQdfzNCiX6
+Dks+6wf/e+srFd3g6AoO/6Xa5FvnRu7TePj0yA+jP/bF7IvhlvJ9kpBmuCryFcjg
+0kdwGYc8Jtrt3JKWsYcENnKxdGb0i46hRtl394HQc0bV5fTT0RGQTHUKAtfufsN1
+D1ez80ZeMZr7XRnh7BNH6sZWlS+P1hYAz5iCuNJSDS1Kw0h/W3vg6PxQn57sRf9q
+TFmV/sXsJm1LQGn44pKiyAbiCy+m3yCVLLlQygdhnaIBvNHB5SB+WP/xO+Mwsp8z
+Ay4bsj8vrChqutphHKpbcuum0d20ei1LfOd0X6uS1vxO06Ik+Uhtlfd05WFJO0e8
+47Y2v5N6g7ZsBEFNzhZfNkIv32H02g==
+=98pp
+-END PGP SIGNATURE-

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512 (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512 Thu Dec 
19 21:53:47 2019
@@ -0,0 +1,4 @@
+apache-airflow-1.10.7rc2-source.tar.gz: 02E58055 DCF28329 618D1DB7 F8CE12C4
+F6DCC363 A3F349C0 75F9F3FB 8F97FB5B
+C626663C ECC7A8DD E78729FB 9340F063
+FF47062D 0527F17E 17C192DE 390FD06F

Added: dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl
--
svn:mime-type = application/octet-stream

Added: 

[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000437#comment-17000437
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit df8674adea424f0538427c6a192aa1ad0413da95 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=df8674a ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000435#comment-17000435
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 1810c0fddf612b938112e9fd6a2499d76e7cb0ca in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1810c0f ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000439#comment-17000439
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 5a938a8a7d6eb71116acc8c13681c8d2772f96c4 in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=5a938a8 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000438#comment-17000438
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit 605f600e745eae1433256ccbd7ac4ddc67ad3a32 in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=605f600 ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000436#comment-17000436
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 18a240d3f82a83605e3d66d5c85f44f4aead745f in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=18a240d ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000432#comment-17000432
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit 605f600e745eae1433256ccbd7ac4ddc67ad3a32 in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=605f600 ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000431#comment-17000431
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit df8674adea424f0538427c6a192aa1ad0413da95 in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=df8674a ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000430#comment-17000430
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 18a240d3f82a83605e3d66d5c85f44f4aead745f in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=18a240d ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000429#comment-17000429
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 1810c0fddf612b938112e9fd6a2499d76e7cb0ca in airflow's branch 
refs/heads/v1-10-stable from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1810c0f ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000424#comment-17000424
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 5b7a9b24f7d6c13d6e98e6b140d037a8df88b6e8 in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=5b7a9b2 ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000425#comment-17000425
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 024f3aaf656a1b92865a802b5ed0096f1c3603a9 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=024f3aa ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000427#comment-17000427
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit 08cb34002647d9ab773e0bbdd57ef0f8a996cb55 in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=08cb340 ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000426#comment-17000426
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 4c925c19f561ffaeaaf811749e9496017ff57a08 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=4c925c1 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000423#comment-17000423
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 85854d4387b613475d9950993e98ff57638066df in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=85854d4 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000414#comment-17000414
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 447e66b10fc09153ed2a6080d79ce07628cc8e7c in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=447e66b ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000417#comment-17000417
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit 8a033bbb5c305248fd2e6e8fdbe0ca517e1a5335 in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=8a033bb ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000415#comment-17000415
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 869e452bc29060a87ae8663c2dc9e01538a8e67f in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=869e452 ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6308) Unpin Kombu for Python 3

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000412#comment-17000412
 ] 

ASF subversion and git services commented on AIRFLOW-6308:
--

Commit 8a033bbb5c305248fd2e6e8fdbe0ca517e1a5335 in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=8a033bb ]

[AIRFLOW-6308] Unpin Kombu for Python 3


> Unpin Kombu for Python 3
> 
>
> Key: AIRFLOW-6308
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6308
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6, 1.10.7
>Reporter: Kaxil Naik
>Priority: Minor
> Fix For: 1.10.7
>
>
> I get the following message when installing Airflow with celery. `pip install 
> apache-airflow[celery]==1.10.7rc1`
> {noformat}
>   Stored in directory: 
> /Users/kaxilnaik/Library/Caches/pip/wheels/41/25/09/b031a72c5a49481397652b172f561c44aa87a12e679922158f
> Successfully built alembic unicodecsv sqlalchemy psutil flask-admin 
> pyrsistent sqlalchemy-utils
> ERROR: celery 4.4.0 has requirement kombu<4.7,>=4.6.7, but you'll have kombu 
> 4.6.3 which is incompatible.
> Installing collected packages: attrs, six, more-itertools, zipp, 
> importlib-metadata, pyrsistent, jsonschema, docutils, lockfile, 
> python-daemon, typing-extensions, MarkupSafe, jinja2, Werkzeug, itsdangerous, 
> click, flask, certifi, urllib3, idna, chardet, requests, sqlalchemy, Mako, 
> python-editor, python-dateutil, alembic, unicodecsv, cached-property, 
> tabulate, text-unidecode, pytz, tzlocal, pytzdata, pendulum, WTForms, 
> flask-wtf, psutil, configparser, croniter, sqlalchemy-jsonfield, 
> flask-caching, cattrs, future, iso8601, colorlog, thrift, setproctitle, 
> gunicorn, funcsigs, lazy-object-proxy, PyJWT, Flask-JWT-Extended, 
> Flask-SQLAlchemy, prison, marshmallow, sqlalchemy-utils, marshmallow-enum, 
> babel, Flask-Babel, defusedxml, python3-openid, Flask-OpenID, PyYAML, 
> apispec, colorama, marshmallow-sqlalchemy, flask-login, flask-appbuilder, 
> graphviz, termcolor, zope.deprecation, argcomplete, markdown, tenacity, dill, 
> numpy, pandas, flask-admin, pygments, json-merge-patch, flask-swagger, 
> tornado, billiard, vine, amqp, kombu, celery, flower, apache-airflow
> Successfully installed Flask-Babel-0.12.2 Flask-JWT-Extended-3.24.1 
> Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.1 Mako-1.1.0 MarkupSafe-1.1.1 
> PyJWT-1.7.1 PyYAML-5.2 WTForms-2.2.1 Werkzeug-0.16.0 alembic-1.3.2 amqp-2.5.2 
> apache-airflow-1.10.7rc1 apispec-1.3.3 argcomplete-1.10.3 attrs-19.3.0 
> babel-2.7.0 billiard-3.6.1.0 cached-property-1.5.1 cattrs-0.9.0 celery-4.4.0 
> certifi-2019.11.28 chardet-3.0.4 click-7.0 colorama-0.4.3 colorlog-4.0.2 
> configparser-3.5.3 croniter-0.3.30 defusedxml-0.6.0 dill-0.3.1.1 
> docutils-0.15.2 flask-1.1.1 flask-admin-1.5.4 flask-appbuilder-2.2.1 
> flask-caching-1.3.3 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.2 
> flower-0.9.3 funcsigs-1.0.2 future-0.16.0 graphviz-0.13.2 gunicorn-19.10.0 
> idna-2.8 importlib-metadata-1.3.0 iso8601-0.1.12 itsdangerous-1.1.0 
> jinja2-2.10.3 json-merge-patch-0.2 jsonschema-3.2.0 kombu-4.6.3 
> lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-2.6.11 marshmallow-2.19.5 
> marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.18.0 more-itertools-8.0.2 
> numpy-1.17.4 pandas-0.25.3 pendulum-1.4.4 prison-0.1.2 psutil-5.6.7 
> pygments-2.5.2 pyrsistent-0.15.6 python-daemon-2.1.2 python-dateutil-2.8.1 
> python-editor-1.0.4 python3-openid-3.1.0 pytz-2019.3 pytzdata-2019.3 
> requests-2.22.0 setproctitle-1.1.10 six-1.13.0 sqlalchemy-1.3.12 
> sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.0 tabulate-0.8.6 
> tenacity-4.12.0 termcolor-1.1.0 text-unidecode-1.2 thrift-0.13.0 
> tornado-5.1.1 typing-extensions-3.7.4.1 tzlocal-1.5.1 unicodecsv-0.14.1 
> urllib3-1.25.7 vine-1.3.0 zipp-0.6.0 zope.deprecation-4.4.0
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000413#comment-17000413
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit d663c1ef802900b4a8b7ab8f7eb1358a54ce9d49 in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=d663c1e ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000416#comment-17000416
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 24154636d77e83a6187d0956011b734e076ace19 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=2415463 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000411#comment-17000411
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit ea17a0a4762b81f10e4da6ef8c6b61c215b11286 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=ea17a0a ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000409#comment-17000409
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit d0cf137e6f946c1a8312573b3701294d2439d2b3 in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=d0cf137 ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000408#comment-17000408
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 92d3ebc45846d7cb81662bc644dd1deed299828b in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=92d3ebc ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000405#comment-17000405
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit fa0e23bc7d45e44a55502685ac16cbf4cf9193a3 in airflow's branch 
refs/heads/v1-10-test from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=fa0e23b ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000406#comment-17000406
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit fa0e23bc7d45e44a55502685ac16cbf4cf9193a3 in airflow's branch 
refs/heads/v1-10-test from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=fa0e23b ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000410#comment-17000410
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit c79fdad92d8229e461fdc15fe09157e44aa822d0 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c79fdad ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5665) Add path_exists method to SFTPHook

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000407#comment-17000407
 ] 

ASF subversion and git services commented on AIRFLOW-5665:
--

Commit 7c433a8bb3f483e4012f4ce85040ad95ece74192 in airflow's branch 
refs/heads/v1-10-test from TobKed
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=7c433a8 ]

[AIRFLOW-5665] Add path_exists method to SFTPHook (#6344)

Co-Authored-By: Kamil Breguła 
(cherry picked from commit 44b6a271fb9341280256cba956704d13fbef0406)


> Add path_exists method to SFTPHook
> --
>
> Key: AIRFLOW-5665
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5665
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: contrib
>Affects Versions: 1.10.5
>Reporter: Tobiasz Kedzierski
>Assignee: Tobiasz Kedzierski
>Priority: Minor
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


svn commit: r37310 - /dev/airflow/1.10.7rc2/

2019-12-19 Thread kaxilnaik
Author: kaxilnaik
Date: Thu Dec 19 21:30:01 2019
New Revision: 37310

Log:
Add artifacts for Airflow 1.10.7rc2

Added:
dev/airflow/1.10.7rc2/
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz   (with props)
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz   (with props)
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc
dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl   (with 
props)
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl.asc
dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl.sha512

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.asc Thu Dec 19 
21:30:01 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEEnF1VgQO7y7q8bnCdfzNCiX6DksFAl376zwACgkQdfzNCiX6
+Dku9IggAg8BI99rtTUDYAOgaTCUGd+FQwP4/HlisNHZNWAAv25CLWgx3iXCoZ4nn
+UT/Fnv0b/Uutr2TxUOz5M3XnOz8b4e47qLfwmMQUjtkEdUCZDIjWoHA/+7Pj0Fm0
+yPY5eomlULJZzMIymr8B5YlMa4k9pgu4E8U4tOGiMaPTLHJAtju4vU9Op00gHCr1
+CfYFnbXd5PDtUNl0pNba+S1cCTKN8vAloj0DJJYBZh4TUAQ68qHnOFq54hwSsCrM
+/cYtaMw4NjJmCeRbh07Bo/xQjp6iYVu7C/CLpNRFFQ/q08fF+2S0rN5lvB74kZqX
+ER2lxa73Rsnlyt2CgGWlmgYC8TtFpg==
+=EbZN
+-END PGP SIGNATURE-

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512 (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-bin.tar.gz.sha512 Thu Dec 19 
21:30:01 2019
@@ -0,0 +1,4 @@
+apache-airflow-1.10.7rc2-bin.tar.gz: 62D681A9 B680B8D9 EB7D390B 7C5AD107
+ 8B48013D 538E1258 79B4AC58 9B31AEC7
+ 40F86B8E 9099C7B6 28C04497 4BCAC24B
+ BB2E939F A51515FF 4A9C07BA 8A000C12

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.asc Thu Dec 19 
21:30:01 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEEnF1VgQO7y7q8bnCdfzNCiX6DksFAl376zUACgkQdfzNCiX6
+DktDugf/cM0HFI3t1WxWqwLdYKxE1aGLcmBNd5hKwD36ZsaOscQKmh1CfTXULP3F
+wbvVEwbJJ/Vq+kTYI4ZNVdwpRGmm0pmIwSbg1cQ/EQdHpJbM+l1N3fFF2vTbqO9X
+/72tF6PWU6A/tMg7k5Dpq94+zW2BlHhSOK7aO6WHtXfJFvjEfpIcZqa/O6LZhu4U
+raSWzR+Ws+8zwijwUWgpqt8U2R4Wbbhf36QSYOWkhyHtllQHTuuQ97hOdf7sAsLG
+6jqt9S4adOKTb6Ppf/eGmhTf/t0YErC+FkQ1s8/BQVxw3QIPXj5zmPbyQzsLH0q/
+cYpcA0rIPrLsg/RWa8BBG3MKmWqNPQ==
+=kJTC
+-END PGP SIGNATURE-

Added: dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512
==
--- dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512 (added)
+++ dev/airflow/1.10.7rc2/apache-airflow-1.10.7rc2-source.tar.gz.sha512 Thu Dec 
19 21:30:01 2019
@@ -0,0 +1,4 @@
+apache-airflow-1.10.7rc2-source.tar.gz: FD12B3BB 8BF5783A DC68D1F8 FFF0E2A5
+ECD0EB25 0A2ABC8B 42CA21CC 3CC3BB56
+065DAED4 810E0582 62815451 A140E808
+6460A495 80D32197 F7E5CC5A ADEE0C75

Added: dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl
==
Binary file - no diff available.

Propchange: dev/airflow/1.10.7rc2/apache_airflow-1.10.7rc2-py2.py3-none-any.whl
--
svn:mime-type = application/octet-stream

Added: 

[jira] [Resolved] (AIRFLOW-6272) Manage front-end JS deps with yarnpkg instead of npm

2019-12-19 Thread Jarek Potiuk (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jarek Potiuk resolved AIRFLOW-6272.
---
Fix Version/s: 2.0.0
   Resolution: Fixed

> Manage front-end JS deps with yarnpkg instead of npm
> 
>
> Key: AIRFLOW-6272
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6272
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ui
>Affects Versions: 2.0.0
>Reporter: Ash Berlin-Taylor
>Assignee: Ash Berlin-Taylor
>Priority: Minor
> Fix For: 2.0.0
>
>
> NPM seems to be really slow at installing things, and is error-prone/tricky 
> to get the "locked" version installed.
> Yarn (or yarnpkg to not be confused with hadoop's yarn) is a "new" (few years 
> old now) BSD-licesned JS package manager https://yarnpkg.com out of Facebook



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6272) Manage front-end JS deps with yarnpkg instead of npm

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000401#comment-17000401
 ] 

ASF subversion and git services commented on AIRFLOW-6272:
--

Commit 2a157e32d08a2e372be733dca226662f311f54cb in airflow's branch 
refs/heads/master from Ash Berlin-Taylor
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=2a157e3 ]

[AIRFLOW-6272] Switch from npm to yarnpkg for managing front-end dependencies 
(#6844)

It is:

- quicker to install
- easier to get repeatable results
- Takes up less space (130MB/15k files vs 190MB/23k files)
- nicer to user (has better help)


> Manage front-end JS deps with yarnpkg instead of npm
> 
>
> Key: AIRFLOW-6272
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6272
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ui
>Affects Versions: 2.0.0
>Reporter: Ash Berlin-Taylor
>Assignee: Ash Berlin-Taylor
>Priority: Minor
>
> NPM seems to be really slow at installing things, and is error-prone/tricky 
> to get the "locked" version installed.
> Yarn (or yarnpkg to not be confused with hadoop's yarn) is a "new" (few years 
> old now) BSD-licesned JS package manager https://yarnpkg.com out of Facebook



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5903) Remove serve_logs command

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000400#comment-17000400
 ] 

ASF subversion and git services commented on AIRFLOW-5903:
--

Commit 0f1de0b67d7dbc8ab86dff2e0daebd21fedc2a6e in airflow's branch 
refs/heads/master from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0f1de0b ]

[AIRFLOW-5903] Remove serve_logs command from CLI (#6843) (#6857)



> Remove serve_logs command
> -
>
> Key: AIRFLOW-5903
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5903
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Major
> Fix For: 2.0.0
>
>
> The ``serve_logs`` command has been deleted. This command should be run only 
> by internal application mechanisms
> and there is no need for it to be accessible from the CLI interface.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5665) Add path_exists method to SFTPHook

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000394#comment-17000394
 ] 

ASF subversion and git services commented on AIRFLOW-5665:
--

Commit 1e3959dc25c55610a373111fa3f103b726ba3aac in airflow's branch 
refs/heads/v1-10-stable from TobKed
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1e3959d ]

[AIRFLOW-5665] Add path_exists method to SFTPHook (#6344)

Co-Authored-By: Kamil Breguła 
(cherry picked from commit 44b6a271fb9341280256cba956704d13fbef0406)


> Add path_exists method to SFTPHook
> --
>
> Key: AIRFLOW-5665
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5665
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: contrib
>Affects Versions: 1.10.5
>Reporter: Tobiasz Kedzierski
>Assignee: Tobiasz Kedzierski
>Priority: Minor
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000395#comment-17000395
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit d663c1ef802900b4a8b7ab8f7eb1358a54ce9d49 in airflow's branch 
refs/heads/v1-10-stable from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=d663c1e ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000396#comment-17000396
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 447e66b10fc09153ed2a6080d79ce07628cc8e7c in airflow's branch 
refs/heads/v1-10-stable from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=447e66b ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000398#comment-17000398
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 24154636d77e83a6187d0956011b734e076ace19 in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=2415463 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000397#comment-17000397
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 869e452bc29060a87ae8663c2dc9e01538a8e67f in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=869e452 ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000393#comment-17000393
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit 0453f72f136a94534ccee47d1b55616b9a174dbb in airflow's branch 
refs/heads/v1-10-stable from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0453f72 ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000392#comment-17000392
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit 0453f72f136a94534ccee47d1b55616b9a174dbb in airflow's branch 
refs/heads/v1-10-stable from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0453f72 ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000384#comment-17000384
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit 0453f72f136a94534ccee47d1b55616b9a174dbb in airflow's branch 
refs/heads/v1-10-test from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0453f72 ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000390#comment-17000390
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 24154636d77e83a6187d0956011b734e076ace19 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=2415463 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000388#comment-17000388
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 447e66b10fc09153ed2a6080d79ce07628cc8e7c in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=447e66b ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000389#comment-17000389
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 869e452bc29060a87ae8663c2dc9e01538a8e67f in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=869e452 ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000387#comment-17000387
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit d663c1ef802900b4a8b7ab8f7eb1358a54ce9d49 in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=d663c1e ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5665) Add path_exists method to SFTPHook

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000386#comment-17000386
 ] 

ASF subversion and git services commented on AIRFLOW-5665:
--

Commit 1e3959dc25c55610a373111fa3f103b726ba3aac in airflow's branch 
refs/heads/v1-10-test from TobKed
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1e3959d ]

[AIRFLOW-5665] Add path_exists method to SFTPHook (#6344)

Co-Authored-By: Kamil Breguła 
(cherry picked from commit 44b6a271fb9341280256cba956704d13fbef0406)


> Add path_exists method to SFTPHook
> --
>
> Key: AIRFLOW-5665
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5665
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: contrib
>Affects Versions: 1.10.5
>Reporter: Tobiasz Kedzierski
>Assignee: Tobiasz Kedzierski
>Priority: Minor
> Fix For: 1.10.7
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000385#comment-17000385
 ] 

ASF subversion and git services commented on AIRFLOW-5729:
--

Commit 0453f72f136a94534ccee47d1b55616b9a174dbb in airflow's branch 
refs/heads/v1-10-test from Bas Harenslak
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0453f72 ]

[AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config 
(#6398)

* [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

* Added test checking training config without InputDataConfig

(cherry picked from commit bdc583663efa6ca0a65455b855d52b174ef5c157)


> Make InputDataConfig in SageMakerTrainingOperator optional
> --
>
> Key: AIRFLOW-5729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5729
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: aws
>Affects Versions: 2.0.0, 1.10.5
>Reporter: Bas Harenslak
>Priority: Major
> Fix For: 1.10.7
>
>
> Currently the SageMakerTrainingOperator will fail when no config key 
> InputDataConfig is supplied, however this is not a required property, see 
> https://docs.aws.amazon.com/sagemaker/latest/dg/API_CreateTrainingJob.html#SageMaker-CreateTrainingJob-request-InputDataConfig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread Kaxil Naik (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kaxil Naik updated AIRFLOW-6271:

Fix Version/s: (was: 2.0.0)
   1.10.7

> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 1.10.7
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000375#comment-17000375
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 541a1e2a988398c7a014aaec2c766fcdb7b1adba in airflow's branch 
refs/heads/v1-10-stable from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=541a1e2 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000376#comment-17000376
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 567f42755fc3cd2bf7af92a236c8bb8a3b0b892b in airflow's branch 
refs/heads/v1-10-stable from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=567f427 ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000378#comment-17000378
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 72c07f57ba07649de268ba95901a876accc862f1 in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=72c07f5 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000377#comment-17000377
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 23680fa680d47878a393464e7c12ce5d86dd3dd4 in airflow's branch 
refs/heads/v1-10-stable from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=23680fa ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 2.0.0
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6269) Add show config command in CLI

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000371#comment-17000371
 ] 

ASF subversion and git services commented on AIRFLOW-6269:
--

Commit 567f42755fc3cd2bf7af92a236c8bb8a3b0b892b in airflow's branch 
refs/heads/v1-10-test from Kamil Breguła
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=567f427 ]

[AIRFLOW-6269] Add show config command in CLI (#6840)

(cherry picked from commit 136dead8afc6510962eb7af043fc77fc22a2d1d3)


> Add show config command in CLI
> --
>
> Key: AIRFLOW-6269
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6269
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Minor
> Fix For: 1.10.7
>
>
> Hello,
> I want to add a command that displays the current airflow configuration.
> Best regards,
> Kamil



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6271) Airflow does not inform where it reads configuration from in test mode

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000372#comment-17000372
 ] 

ASF subversion and git services commented on AIRFLOW-6271:
--

Commit 23680fa680d47878a393464e7c12ce5d86dd3dd4 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=23680fa ]

[AIRFLOW-6271] Printing log files read during load_test_config (#6842)

Airflow should show where the configuration is read from. Especially for new
user it might be confusing as it is not logged anywhere and there are several
places the configuration might be read from. 

This is printed for the main config file, but not when load_test_config is used.

(cherry picked from commit 81de282968bdd6838a3381e89e6c6b507f7d18f3)


> Airflow does not inform where it reads configuration from in test mode
> --
>
> Key: AIRFLOW-6271
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6271
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 2.0.0
>Reporter: Jarek Potiuk
>Priority: Major
> Fix For: 2.0.0
>
>
> Airflow should show where the configuration is read from. Especially for new 
> user it might be confusing as it is not logged anywhere and there are several 
> places the configuration might be read from. 
> This is printed for the main config file, but not when load_test_config is 
> used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6297) Add Airflow website link to UI docs

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000370#comment-17000370
 ] 

ASF subversion and git services commented on AIRFLOW-6297:
--

Commit 541a1e2a988398c7a014aaec2c766fcdb7b1adba in airflow's branch 
refs/heads/v1-10-test from Jiajie Zhong
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=541a1e2 ]

[AIRFLOW-6297] Add Airflow website link to UI docs (#6849)

(cherry picked from commit 8a8e65a374a5d29ef2ceb380915eda26071ea7fe)


> Add Airflow website link to UI docs
> ---
>
> Key: AIRFLOW-6297
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6297
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: ui
>Affects Versions: 1.10.6
>Reporter: zhongjiajie
>Assignee: zhongjiajie
>Priority: Major
> Fix For: 1.10.7
>
> Attachments: Screen Shot 2019-12-19 at 15.44.31.png
>
>
> Add Airflow website link to UI docs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000373#comment-17000373
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 72c07f57ba07649de268ba95901a876accc862f1 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=72c07f5 ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5458) Flask-AppBuilder shows critical security vulnerability

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000369#comment-17000369
 ] 

ASF subversion and git services commented on AIRFLOW-5458:
--

Commit 923a03c90fc093d5ac7025d9378565999d793ceb in airflow's branch 
refs/heads/v1-10-test from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=923a03c ]

[AIRFLOW-5458] Pin Flask-AppBuilder < 2.0 for Py2 (#6607)


> Flask-AppBuilder shows critical security vulnerability
> --
>
> Key: AIRFLOW-5458
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5458
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.5
>Reporter: Souvik Ghosh
>Priority: Major
> Fix For: 1.10.7
>
>
> Hello,
> our security team has detected a vulnerability for Flask-AppBuilder<2.0.0 
> with a CVE 9.8 and recommend us to move the version > 2.0. Since it is in the 
> setup.py of airflow with restrictions. I am wondering if it can be moved to 
> 2.0.0 where no vulnerability is reported.
>  
> Thanks for your help



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5458) Flask-AppBuilder shows critical security vulnerability

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000367#comment-17000367
 ] 

ASF subversion and git services commented on AIRFLOW-5458:
--

Commit 923a03c90fc093d5ac7025d9378565999d793ceb in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=923a03c ]

[AIRFLOW-5458] Pin Flask-AppBuilder < 2.0 for Py2 (#6607)


> Flask-AppBuilder shows critical security vulnerability
> --
>
> Key: AIRFLOW-5458
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5458
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.5
>Reporter: Souvik Ghosh
>Priority: Major
> Fix For: 1.10.7
>
>
> Hello,
> our security team has detected a vulnerability for Flask-AppBuilder<2.0.0 
> with a CVE 9.8 and recommend us to move the version > 2.0. Since it is in the 
> setup.py of airflow with restrictions. I am wondering if it can be moved to 
> 2.0.0 where no vulnerability is reported.
>  
> Thanks for your help



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-5458) Flask-AppBuilder shows critical security vulnerability

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000366#comment-17000366
 ] 

ASF subversion and git services commented on AIRFLOW-5458:
--

Commit 98308243e6912b675d186ffc67dd375bb5567334 in airflow's branch 
refs/heads/v1-10-stable from Kaxil Naik
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=9830824 ]

[AIRFLOW-5458] Bump Flask-AppBuilder to 2.2.0 only for Python3 (#6607)


> Flask-AppBuilder shows critical security vulnerability
> --
>
> Key: AIRFLOW-5458
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5458
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: dependencies
>Affects Versions: 1.10.5
>Reporter: Souvik Ghosh
>Priority: Major
> Fix For: 1.10.7
>
>
> Hello,
> our security team has detected a vulnerability for Flask-AppBuilder<2.0.0 
> with a CVE 9.8 and recommend us to move the version > 2.0. Since it is in the 
> setup.py of airflow with restrictions. I am wondering if it can be moved to 
> 2.0.0 where no vulnerability is reported.
>  
> Thanks for your help



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6186) Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server

2019-12-19 Thread Mario Mendes (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000351#comment-17000351
 ] 

Mario Mendes commented on AIRFLOW-6186:
---

[~xbhuang], I have a hook and basic operator for SQL Server using pyodbc done.  
Do you want to reassign this issue to me?

> Switch pymssql to pyodbc for connecting to Miscrosoft SQL Server
> 
>
> Key: AIRFLOW-6186
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6186
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 1.10.6
>Reporter: Xinbin Huang
>Assignee: Xinbin Huang
>Priority: Major
>
> As the author of `pymssql` project announce to discontinue supporting the 
> PyMSSQL project. It is better to switch over to other package (i.e. pyodbc) 
> for better stability 
> Note: the current workaround is to pin down the version to <3.0 ( 
> -AIRFLOW-5942- )



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6309) The v1-10-stable build fails with "invalid syntax"

2019-12-19 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000349#comment-17000349
 ] 

ASF subversion and git services commented on AIRFLOW-6309:
--

Commit 599442ef85aea7b04b77e9d97742b7a98e170672 in airflow's branch 
refs/heads/v1-10-test from Jarek Potiuk
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=599442e ]

[AIRFLOW-6309] Fix stable build on Travis


> The v1-10-stable build fails with "invalid syntax" 
> ---
>
> Key: AIRFLOW-6309
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6309
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: ci
>Affects Versions: 1.10.7
>Reporter: Jarek Potiuk
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (AIRFLOW-6310) Group CLI commands in subcommands

2019-12-19 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000307#comment-17000307
 ] 

ASF GitHub Bot commented on AIRFLOW-6310:
-

mik-laj commented on pull request #6858: [AIRFLOW-6310] Group CLI commands in 
subcommands
URL: https://github.com/apache/airflow/pull/6858
 
 
   
   
   This is not finished PR. It is necessary to update the tests, but I decided 
to share it to get an opinion before investing more time. I would like to 
suggest that you group several commands to help users find the right command.
   
   | Old command   | New command|
   |---||
   | airflow kerberos  | airflow run kerberos   |
   | airflow webserver | airflow run webserver  |
   | airflow scheduler | airflow run scheduler  |
   | airflow worker| airflow run worker |
   | airflow flower| airflow run flower |
   | airflow config| airflow config show|
   | airflow rotate_fernet_key | airflow config rotate_fernet_key   |
   
   After execution we will have only two clean commands in airflow (without 
subcomands):
   * sync_perm
   * version
   
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [ ] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/browse/AIRFLOW-XXX
 - In case you are fixing a typo in the documentation you can prepend your 
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
 - In case you are proposing a fundamental code change, you need to create 
an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)).
 - In case you are adding a dependency, check if the license complies with 
the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   
   ### Description
   
   - [ ] Here are some details about my PR, including screenshots of any UI 
changes:
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Group CLI commands in subcommands
> -
>
> Key: AIRFLOW-6310
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6310
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Major
>
> Some commands have been grouped to improve UX of CLI. New commands are 
> available according to the following 
> table:
> | Old command   | New command|
> |---||
> | airflow kerberos  | airflow run kerberos   |
> | airflow webserver | airflow run webserver  |
> | airflow scheduler | airflow run scheduler  |
> | airflow worker| airflow run worker |
> | airflow flower| airflow run flower |
> | airflow config| airflow config show|
> | airflow rotate_fernet_key | airflow config rotate_fernet_key   |



--

[GitHub] [airflow] mik-laj opened a new pull request #6858: [AIRFLOW-6310] Group CLI commands in subcommands

2019-12-19 Thread GitBox
mik-laj opened a new pull request #6858: [AIRFLOW-6310] Group CLI commands in 
subcommands
URL: https://github.com/apache/airflow/pull/6858
 
 
   
   
   This is not finished PR. It is necessary to update the tests, but I decided 
to share it to get an opinion before investing more time. I would like to 
suggest that you group several commands to help users find the right command.
   
   | Old command   | New command|
   |---||
   | airflow kerberos  | airflow run kerberos   |
   | airflow webserver | airflow run webserver  |
   | airflow scheduler | airflow run scheduler  |
   | airflow worker| airflow run worker |
   | airflow flower| airflow run flower |
   | airflow config| airflow config show|
   | airflow rotate_fernet_key | airflow config rotate_fernet_key   |
   
   After execution we will have only two clean commands in airflow (without 
subcomands):
   * sync_perm
   * version
   
   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [ ] My PR addresses the following [Airflow 
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references 
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
 - https://issues.apache.org/jira/browse/AIRFLOW-XXX
 - In case you are fixing a typo in the documentation you can prepend your 
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
 - In case you are proposing a fundamental code change, you need to create 
an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)).
 - In case you are adding a dependency, check if the license complies with 
the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   
   ### Description
   
   - [ ] Here are some details about my PR, including screenshots of any UI 
changes:
   
   ### Tests
   
   - [ ] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   
   ### Commits
   
   - [ ] My commits all reference Jira issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [ ] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain docstrings 
that explain what it does
 - If you implement backwards incompatible changes, please leave a note in 
the [Updating.md](https://github.com/apache/airflow/blob/master/UPDATING.md) so 
we can assign it to a appropriate release
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (AIRFLOW-6310) Group CLI commands in subcommands

2019-12-19 Thread Kamil Bregula (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kamil Bregula updated AIRFLOW-6310:
---
Summary: Group CLI commands in subcommands  (was: Group CLI commands)

> Group CLI commands in subcommands
> -
>
> Key: AIRFLOW-6310
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6310
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Major
>
> Some commands have been grouped to improve UX of CLI. New commands are 
> available according to the following 
> table:
> | Old command   | New command|
> |---||
> | airflow kerberos  | airflow run kerberos   |
> | airflow webserver | airflow run webserver  |
> | airflow scheduler | airflow run scheduler  |
> | airflow worker| airflow run worker |
> | airflow flower| airflow run flower |
> | airflow config| airflow config show|
> | airflow rotate_fernet_key | airflow config rotate_fernet_key   |



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (AIRFLOW-6310) Group CLI commands

2019-12-19 Thread Kamil Bregula (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kamil Bregula updated AIRFLOW-6310:
---
Summary: Group CLI commands  (was: Simplification of CLI commands)

> Group CLI commands
> --
>
> Key: AIRFLOW-6310
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6310
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: cli
>Affects Versions: 1.10.6
>Reporter: Kamil Bregula
>Priority: Major
>
> Some commands have been grouped to improve UX of CLI. New commands are 
> available according to the following 
> table:
> | Old command   | New command|
> |---||
> | airflow kerberos  | airflow run kerberos   |
> | airflow webserver | airflow run webserver  |
> | airflow scheduler | airflow run scheduler  |
> | airflow worker| airflow run worker |
> | airflow flower| airflow run flower |
> | airflow config| airflow config show|
> | airflow rotate_fernet_key | airflow config rotate_fernet_key   |



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


  1   2   3   >