[jira] [Created] (AIRFLOW-1864) Dags with large number of Tasks are very slow

2017-11-28 Thread Yee Ting Li (JIRA)
Yee Ting Li created AIRFLOW-1864: Summary: Dags with large number of Tasks are very slow Key: AIRFLOW-1864 URL: https://issues.apache.org/jira/browse/AIRFLOW-1864 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1863) should the gantt chart provide a drop down of the dag run like the grpah view?

2017-11-28 Thread Yee Ting Li (JIRA)
Yee Ting Li created AIRFLOW-1863: Summary: should the gantt chart provide a drop down of the dag run like the grpah view? Key: AIRFLOW-1863 URL: https://issues.apache.org/jira/browse/AIRFLOW-1863

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an `UNLOAD`

[jira] [Updated] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S Weiss updated AIRFLOW-1862: -- Description: The {{airflow/operators/redshift_to_s3_operator}} module generates an

[jira] [Created] (AIRFLOW-1862) redshift_to_s3_operator fails on BOOLEAN column in source table

2017-11-28 Thread Mark S Weiss (JIRA)
Mark S Weiss created AIRFLOW-1862: - Summary: redshift_to_s3_operator fails on BOOLEAN column in source table Key: AIRFLOW-1862 URL: https://issues.apache.org/jira/browse/AIRFLOW-1862 Project: Apache

[jira] [Updated] (AIRFLOW-1860) When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive

2017-11-28 Thread Zelko Nikolic (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zelko Nikolic updated AIRFLOW-1860: --- Description: 1. Open Web GUI -> Variables 2. Add a variable named "ABCD" and enter some

[jira] [Updated] (AIRFLOW-1860) When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive

2017-11-28 Thread Zelko Nikolic (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zelko Nikolic updated AIRFLOW-1860: --- Description: 1. Open Web GUI -> Variables 2. Add a variable named "ABCD" and enter some

[jira] [Created] (AIRFLOW-1861) If a variable is lowercase and contains words like "secret" it is encrypted, but if variable is uppercase, then it's not encrypted

2017-11-28 Thread Zelko Nikolic (JIRA)
Zelko Nikolic created AIRFLOW-1861: -- Summary: If a variable is lowercase and contains words like "secret" it is encrypted, but if variable is uppercase, then it's not encrypted Key: AIRFLOW-1861 URL:

[jira] [Created] (AIRFLOW-1860) When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive

2017-11-28 Thread Zelko Nikolic (JIRA)
Zelko Nikolic created AIRFLOW-1860: -- Summary: When adding variables in Web GUI they are case-insensitive, but everywhere else they are case-sensitive Key: AIRFLOW-1860 URL:

[jira] [Created] (AIRFLOW-1859) Allow specification of cursor_factory with PostgresHook

2017-11-28 Thread JIRA
Victor Villas Bôas Chaves created AIRFLOW-1859: -- Summary: Allow specification of cursor_factory with PostgresHook Key: AIRFLOW-1859 URL: https://issues.apache.org/jira/browse/AIRFLOW-1859

[jira] [Created] (AIRFLOW-1858) Allow connection extras to be defined with environment variables

2017-11-28 Thread JIRA
Victor Villas Bôas Chaves created AIRFLOW-1858: -- Summary: Allow connection extras to be defined with environment variables Key: AIRFLOW-1858 URL: https://issues.apache.org/jira/browse/AIRFLOW-1858

[jira] [Updated] (AIRFLOW-1857) Tree View in Web UI does not limit DAGRuns for Dags with execution interval @once or None

2017-11-28 Thread Mark Whitfield (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Whitfield updated AIRFLOW-1857: Summary: Tree View in Web UI does not limit DAGRuns for Dags with execution interval

[jira] [Updated] (AIRFLOW-1857) Tree View in Web UI shows all DAGRuns for Dags with execution interval @once or None

2017-11-28 Thread Mark Whitfield (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Whitfield updated AIRFLOW-1857: Description: The tree view in the web UI relies on the DAG's [execution

[jira] [Created] (AIRFLOW-1857) Tree View in Web UI shows all DAGRuns for Dags with execution interval @once or None

2017-11-28 Thread Mark Whitfield (JIRA)
Mark Whitfield created AIRFLOW-1857: --- Summary: Tree View in Web UI shows all DAGRuns for Dags with execution interval @once or None Key: AIRFLOW-1857 URL: https://issues.apache.org/jira/browse/AIRFLOW-1857

[jira] [Commented] (AIRFLOW-1372) "Failed to fetch log file from worker" using distributed workers

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269007#comment-16269007 ] Victor Villas Bôas Chaves commented on AIRFLOW-1372: I believe this is not a bug in

[jira] [Closed] (AIRFLOW-1372) "Failed to fetch log file from worker" using distributed workers

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Villas Bôas Chaves closed AIRFLOW-1372. -- Resolution: Cannot Reproduce > "Failed to fetch log file from worker"

[jira] [Created] (AIRFLOW-1856) How to allow airflow dags for concrete user(s) only?

2017-11-28 Thread Ikar Pohorsky (JIRA)
Ikar Pohorsky created AIRFLOW-1856: -- Summary: How to allow airflow dags for concrete user(s) only? Key: AIRFLOW-1856 URL: https://issues.apache.org/jira/browse/AIRFLOW-1856 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-873) Tests forcing availability of hive_metastore module

2017-11-28 Thread Alberto Calderari (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268902#comment-16268902 ] Alberto Calderari commented on AIRFLOW-873: --- [~wrp][~andyxhadji] I solved with pip install

[jira] [Reopened] (AIRFLOW-1790) AWS Batch Operator Suppport

2017-11-28 Thread Hugo Prudente (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugo Prudente reopened AIRFLOW-1790: It's not merged yet, so I'm reopening to evaluation as the Pull request was not evaluated

[jira] [Created] (AIRFLOW-1855) Add an Operator to copy files with a specific delimiter in a directory from one GCS bucket to another

2017-11-28 Thread Kaxil Naik (JIRA)
Kaxil Naik created AIRFLOW-1855: --- Summary: Add an Operator to copy files with a specific delimiter in a directory from one GCS bucket to another Key: AIRFLOW-1855 URL:

[jira] [Updated] (AIRFLOW-1854) Improve Spark submit hook for cluster mode

2017-11-28 Thread Milan van der Meer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan van der Meer updated AIRFLOW-1854: Description: *We are already working on this issue and will submit a PR soon*

[jira] [Updated] (AIRFLOW-1854) Improve Spark submit hook for cluster mode

2017-11-28 Thread Milan van der Meer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan van der Meer updated AIRFLOW-1854: Description: *We are already working on this issue and making a PR soon* When

[jira] [Work started] (AIRFLOW-1854) Improve Spark submit hook for cluster mode

2017-11-28 Thread Milan van der Meer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-1854 started by Milan van der Meer. --- > Improve Spark submit hook for cluster mode >

[jira] [Created] (AIRFLOW-1854) Improve Spark submit hook for cluster mode

2017-11-28 Thread Milan van der Meer (JIRA)
Milan van der Meer created AIRFLOW-1854: --- Summary: Improve Spark submit hook for cluster mode Key: AIRFLOW-1854 URL: https://issues.apache.org/jira/browse/AIRFLOW-1854 Project: Apache Airflow

incubator-airflow git commit: [AIRFLOW-1848][Airflow-1848] Fix DataFlowPythonOperator py_file extension doc comment

2017-11-28 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master d99053106 -> 02112197c [AIRFLOW-1848][Airflow-1848] Fix DataFlowPythonOperator py_file extension doc comment Closes #2816 from cjqian/1848 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Commented] (AIRFLOW-1848) Dataflow operator py_file arg doesn't require .py suffix

2017-11-28 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268479#comment-16268479 ] ASF subversion and git services commented on AIRFLOW-1848: -- Commit

[jira] [Created] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2017-11-28 Thread Yee Ting Li (JIRA)
Yee Ting Li created AIRFLOW-1853: Summary: tree view of manually triggered dags overpopulate page Key: AIRFLOW-1853 URL: https://issues.apache.org/jira/browse/AIRFLOW-1853 Project: Apache Airflow