incubator-airflow git commit: [AIRFLOW-142] setup_env.sh doesn't download hive tarball if hdp is specified as distro

2016-06-09 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 0bd5515a4 -> b7def7f1f [AIRFLOW-142] setup_env.sh doesn't download hive tarball if hdp is specified as distro Closes #1518 from sekikn/AIRFLOW-142 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo

[1/2] incubator-airflow git commit: [AIRFLOW-170] Add missing @apply_defaults

2016-05-24 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master ee248559f -> ac96fbf85 [AIRFLOW-170] Add missing @apply_defaults Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/85d23a3c Tree:

[1/2] incubator-airflow git commit: AIRFLOW-45: Support Hidden Airflow Variables

2016-05-25 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 7332c40c2 -> 456dada69 AIRFLOW-45: Support Hidden Airflow Variables Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/3e309415 Tree:

[2/2] incubator-airflow git commit: Merge pull request #1530 from mattuuh7/hidden-fields

2016-05-25 Thread criccomini
Merge pull request #1530 from mattuuh7/hidden-fields Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/456dada6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/456dada6 Diff:

incubator-airflow git commit: [AIRFLOW-206] Always load local log files if they exist

2016-06-04 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c78101eaa -> 275aa15fa [AIRFLOW-206] Always load local log files if they exist Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-23] Support for Google Cloud DataProc

2016-05-31 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 03e8e5d49 -> 0a5364cd4 [AIRFLOW-23] Support for Google Cloud DataProc Dear Airflow Maintainers, Please accept this PR that addresses the following issues: - AIRFLOW-23 Spark, Hadoop, PySpart, SparkSQL, Pig an Hive support of

[2/2] incubator-airflow git commit: Merge pull request #1541 from msumit/AIRFLOW-167

2016-05-26 Thread criccomini
Merge pull request #1541 from msumit/AIRFLOW-167 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/b9efdc62 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/b9efdc62 Diff:

[1/2] incubator-airflow git commit: AIRFLOW-167: Add dag_state option in cli

2016-05-26 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master fedbacb0e -> b9efdc620 AIRFLOW-167: Add dag_state option in cli Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/9db00511 Tree:

[2/2] incubator-airflow git commit: Merge pull request #1545 from jgao54/zip-bug-fix

2016-05-26 Thread criccomini
Merge pull request #1545 from jgao54/zip-bug-fix Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/01b3291c Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/01b3291c Diff:

incubator-airflow git commit: [AIRFLOW-179] DbApiHook string serialization fails when string contains non-ASCII characters

2016-05-27 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 4aac54d64 -> 87b4b8fa1 [AIRFLOW-179] DbApiHook string serialization fails when string contains non-ASCII characters Dear Airflow Maintainers, Please accept this PR that addresses the following issues: -

incubator-airflow git commit: [AIRFLOW-196] Fix bug that exception is not handled in HttpSensor

2016-05-31 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master df8e331ef -> 92f44f5b5 [AIRFLOW-196] Fix bug that exception is not handled in HttpSensor Dear Airflow Maintainers, Please accept this PR that addresses the following issues: -

incubator-airflow git commit: [AIRFLOW-155] Documentation of Qubole Operator

2016-06-01 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c2384cb41 -> dce08f68b [AIRFLOW-155] Documentation of Qubole Operator Dear Airflow Maintainers, Please accept this PR that addresses the following issues: - *https://issues.apache.org/jira/browse/AIRFLOW-155* Thanks, Sumit

[1/2] incubator-airflow git commit: [AIRFLOW-241] Add testing done section to PR template

2016-06-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 5963ac8b7 -> 8aa7160c4 [AIRFLOW-241] Add testing done section to PR template Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/2] incubator-airflow git commit: Merge pull request #1592 from aoen/ddavydov/add_testing_done_section_to_pr_template

2016-06-14 Thread criccomini
Merge pull request #1592 from aoen/ddavydov/add_testing_done_section_to_pr_template Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/8aa7160c Tree:

[1/2] incubator-airflow git commit: [AIRFLOW-225] Better units for task duration graph

2016-06-16 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 949479cf7 -> ea2904610 [AIRFLOW-225] Better units for task duration graph Right now the job duration window defaults to hours, which for short lived tasks results in numbers out to five decimals. This patch adjusts the scale of

[1/3] incubator-airflow git commit: [AIRFLOW-248] Add Apache license header to all files

2016-06-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master f4c44146c -> 3ffa656d9 http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/3ffa656d/tests/testconfig/conf/ha-port-hdfs-site.xml -- diff --git

[2/3] incubator-airflow git commit: [AIRFLOW-248] Add Apache license header to all files

2016-06-21 Thread criccomini
http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/3ffa656d/airflow/www/static/heatmap-canvas.js -- diff --git a/airflow/www/static/heatmap-canvas.js b/airflow/www/static/heatmap-canvas.js index ccea814..01ee471 100644

[1/2] incubator-airflow git commit: [AIRFLOW-252] Raise Sqlite exceptions when deleting tasks instance in WebUI

2016-06-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 3ffa656d9 -> 072fa8ee5 [AIRFLOW-252] Raise Sqlite exceptions when deleting tasks instance in WebUI If users who use SQLite as backend try to delete a task via browser, it fails with an exception. Though this is a bug on

[2/2] incubator-airflow git commit: Merge pull request #1609 from sekikn/AIRFLOW-252

2016-06-21 Thread criccomini
Merge pull request #1609 from sekikn/AIRFLOW-252 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/072fa8ee Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/072fa8ee Diff:

incubator-airflow git commit: [AIRFLOW-162] Allow variable to be accessible into templates

2016-06-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 072fa8ee5 -> 54f1c11b6 [AIRFLOW-162] Allow variable to be accessible into templates Closes #1540 from alexvanboxel/AIRFLOW-162 AIRFLOW-162 Allow variable to be accessible into templates Project:

[1/2] incubator-airflow git commit: [AIRFLOW-262] Simplify commands in MANIFEST.in

2016-06-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 26c31d9bc -> 7992036f5 [AIRFLOW-262] Simplify commands in MANIFEST.in Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/05a1150b

[2/2] incubator-airflow git commit: Merge pull request #1612 from ajayyadava/262

2016-06-20 Thread criccomini
Merge pull request #1612 from ajayyadava/262 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/7992036f Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/7992036f Diff:

incubator-airflow git commit: [AIRFLOW-274] Add XCom functionality to GoogleCloudStorageDownloadOperator

2016-06-23 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master bd9127ebb -> 518e0073a [AIRFLOW-274] Add XCom functionality to GoogleCloudStorageDownloadOperator Updated GoogleCloudStorageDownloadOperator so that it has the option to store the downloaded file's contents in an XCom instead

[2/3] incubator-airflow git commit: AIRFLOW-119: List support for tags in QuboleOperator

2016-05-20 Thread criccomini
AIRFLOW-119: List support for tags in QuboleOperator Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/41a88c7d Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/41a88c7d Diff:

[3/3] incubator-airflow git commit: Merge branch '1505'

2016-05-20 Thread criccomini
Merge branch '1505' Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/5898de18 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/5898de18 Diff:

[1/3] incubator-airflow git commit: [AIRFLOW-119] Fix Template not found error and default tags for Qubole operator

2016-05-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master ccfc4c8c1 -> 5898de186 [AIRFLOW-119] Fix Template not found error and default tags for Qubole operator Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[1/2] incubator-airflow git commit: [AIRFLOW-125] Add file to GCS operator

2016-05-18 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master af43db5af -> 20a536cc7 [AIRFLOW-125] Add file to GCS operator Adds an operator to upload a file to Google Cloud Storage. Used as follows: ```py from airflow.contrib.operators.file_to_gcs import FileToGoogleCloudStorageOperator

[2/2] incubator-airflow git commit: Merge branch '1507'

2016-05-18 Thread criccomini
Merge branch '1507' Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/20a536cc Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/20a536cc Diff:

[2/2] incubator-airflow git commit: Merge branch '1508'

2016-05-18 Thread criccomini
Merge branch '1508' Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/959d1fe1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/959d1fe1 Diff:

[1/2] incubator-airflow git commit: [AIRFLOW-127] Makes filter_by_owner aware of multi-owner DAG

2016-05-18 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 20a536cc7 -> 959d1fe10 [AIRFLOW-127] Makes filter_by_owner aware of multi-owner DAG Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-143] setup_env.sh doesn't leverage cache for downloading minicluster

2016-05-19 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 8ae86814b -> 4b78e1a0f [AIRFLOW-143] setup_env.sh doesn't leverage cache for downloading minicluster Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/2] incubator-airflow git commit: Merge pull request #1533 from markreddy/AIRFLOW-153-fix-typos

2016-05-20 Thread criccomini
Merge pull request #1533 from markreddy/AIRFLOW-153-fix-typos Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/e711028a Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/e711028a Diff:

[1/2] incubator-airflow git commit: [AIRFLOW-153] fixed minor typos in help message

2016-05-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 98f10d544 -> e711028ac [AIRFLOW-153] fixed minor typos in help message Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/defb0c05

[1/2] incubator-airflow git commit: [AIRFLOW-148] Use BQ connection project by default in view access

2016-05-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 5898de186 -> 8bf335bdf [AIRFLOW-148] Use BQ connection project by default in view access Updates the internals of the BigQuery view access tools to make the source and destination projects optional, where both values will

[2/2] incubator-airflow git commit: Merge branch '1524'

2016-05-20 Thread criccomini
Merge branch '1524' Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/8bf335bd Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/8bf335bd Diff:

incubator-airflow git commit: ssl gunicorn support

2016-05-12 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master dddfd3b5b -> e332f6362 ssl gunicorn support Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/e332f636 Tree:

[1/2] incubator-airflow git commit: [AIRFLOW-121] Documenting dag doc_md feature

2016-05-17 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 6f4696ba2 -> abc43c144 [AIRFLOW-121] Documenting dag doc_md feature Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/15056822 Tree:

[2/2] incubator-airflow git commit: Merge branch '1493'

2016-05-17 Thread criccomini
Merge branch '1493' Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/abc43c14 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/abc43c14 Diff:

incubator-airflow git commit: [AIRFLOW-75] Fix bug in S3 config file parsing

2016-05-09 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 181d37321 -> eb0960975 [AIRFLOW-75] Fix bug in S3 config file parsing Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/eb096097

incubator-airflow git commit: [AIRFLOW-331] modify the LDAP authentication config lines in 'Security' sample codes

2016-07-27 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 0a8410d4d -> 7dbc3cd40 [AIRFLOW-331] modify the LDAP authentication config lines in 'Security' sample codes Closes #1674 from impangt/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[1/2] incubator-airflow git commit: need to import login_user if we're going to use it

2016-07-27 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master a89d1015c -> 0a8410d4d need to import login_user if we're going to use it login is broken in GHE for new users: ``` [2016-07-26 22:11:43,077] {github_enterprise_auth.py:199} ERROR - Traceback (most recent call last): File

incubator-airflow git commit: Link to wiki in README

2016-07-28 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 7dbc3cd40 -> b4aa64731 Link to wiki in README Closes #1695 from criccomini/readme-links Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airf

incubator-airflow git commit: [AIRFLOW-383] Cleanup example qubole operator dag

2016-08-01 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master fdb7e9491 -> eb989dcb5 [AIRFLOW-383] Cleanup example qubole operator dag Closes #1698 from yogesh2021/AIRFLOW-383 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-335] Fix simple style errors/warnings

2016-07-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master aea1fa2d6 -> dc1bdf622 [AIRFLOW-335] Fix simple style errors/warnings Closes #1665 from skudriashev/airflow-335 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[1/2] incubator-airflow git commit: Update README.md

2016-07-12 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 14561f20d -> 7f7f8bfdb Update README.md Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/040d41a0 Tree:

incubator-airflow git commit: [AIRFLOW-327] Add rename method to the FTPHook

2016-07-12 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 7f7f8bfdb -> 3c91bbb5d [AIRFLOW-327] Add rename method to the FTPHook Closes #1660 from skudriashev/airflow-327 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/2] incubator-airflow git commit: Merge pull request #1657 from Shekharv/master

2016-07-12 Thread criccomini
Merge pull request #1657 from Shekharv/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/7f7f8bfd Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/7f7f8bfd Diff:

[2/2] incubator-airflow git commit: Merge pull request #1659 from sekikn/AIRFLOW-321

2016-07-12 Thread criccomini
Merge pull request #1659 from sekikn/AIRFLOW-321 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/14561f20 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/14561f20 Diff:

incubator-airflow git commit: [AIRFLOW-281] Add port to mssql_hook

2016-06-28 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master d6d3f5367 -> be6766a6a [AIRFLOW-281] Add port to mssql_hook Closes #1626 from lukem-ow/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/3] incubator-airflow git commit: [AIRFLOW-285] Use Airflow 2.0 style imports for all remaining hooks/operators

2016-06-28 Thread criccomini
[AIRFLOW-285] Use Airflow 2.0 style imports for all remaining hooks/operators Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/dc84fdec Tree:

[1/3] incubator-airflow git commit: [AIRFLOW-200] Make hook/operator imports lazy, and print proper exceptions

2016-06-28 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master be6766a6a -> 7b382b4e9 [AIRFLOW-200] Make hook/operator imports lazy, and print proper exceptions Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-314] Fix BigQuery cursor run_table_upsert method

2016-07-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c08b02229 -> 2d7c83085 [AIRFLOW-314] Fix BigQuery cursor run_table_upsert method Closes #1652 from mtagle/fix_bq_table_upsert By default, bigquery will only return 50 tables when you ask for a list of all the tables in a

incubator-airflow git commit: [AIRFLOW-297] support exponential backoff option for retry delay

2016-07-06 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 9a61a5bd5 -> 8b86ee6a7 [AIRFLOW-297] support exponential backoff option for retry delay Closes #1639 from jgao54/support-retry-backoff Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-308] Add link to refresh DAG within DAG view header

2016-07-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 2d7c83085 -> 35d07a8bd [AIRFLOW-308] Add link to refresh DAG within DAG view header Closes #1646 from Firehed/refresh_on_dag Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-296] template_ext is being treated as a string rather than a tuple in qubole operator

2016-06-30 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 002cf85bd -> 24d41b890 [AIRFLOW-296] template_ext is being treated as a string rather than a tuple in qubole operator Closes #1638 from msumit/AIRFLOW-296 Project:

incubator-airflow git commit: [AIRFLOW-781] Allow DataFlowOperators to accept jobs stored in GCS

2017-02-01 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 3cac39674 -> 259c864a0 [AIRFLOW-781] Allow DataFlowOperators to accept jobs stored in GCS Closes #2037 from fenglu-g/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-782] Add support for DataFlowPythonOperator.

2017-01-26 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 5184c6e2f -> dc97bcd3b [AIRFLOW-782] Add support for DataFlowPythonOperator. DataFlowPythonOperator allows users to definie GCP dataflow task where the pipeline job is specified in Python. The corresponding unit tests are also

incubator-airflow git commit: [AIRFLOW-896] Remove unicode to 8-bit conversion in BigQueryOperator

2017-02-24 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master daa405e2b -> 2bceeed80 [AIRFLOW-896] Remove unicode to 8-bit conversion in BigQueryOperator For some reason, we have a str() call on a string when logging an error. This causes a unicode error if the BigQuery query string has

incubator-airflow git commit: [AIRFLOW-826] Add Zendesk hook

2017-02-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 485280a9f -> a097627d8 [AIRFLOW-826] Add Zendesk hook Closes #2066 from shreyasjoshis/add-zendesk-hook Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-877] Remove .sql template extension from GCS download operator

2017-02-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master a097627d8 -> debc69e27 [AIRFLOW-877] Remove .sql template extension from GCS download operator Prior to this patch, if you use a templated file with a .sql extension, and it's templated, you'd receive an exception because

incubator-airflow git commit: [AIRFLOW-509][AIRFLOW-1] Create operator to delete tables in BigQuery

2016-09-15 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master fb7b98b63 -> 0e3ed447b [AIRFLOW-509][AIRFLOW-1] Create operator to delete tables in BigQuery We have a use case to delete BigQuery tables and views. This patch adds a delete operator that allows us to do so. Closes #1798 from

incubator-airflow git commit: [AIRFLOW-539] Updated BQ hook and BQ operator to support Standard SQL.

2016-10-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 573fb991f -> c970b09c4 [AIRFLOW-539] Updated BQ hook and BQ operator to support Standard SQL. Closes #1820 from illop/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[1/2] incubator-airflow git commit: closes apache/incubator-airflow#1432 *PR abandoned by submitter*

2016-10-25 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 61370fbf7 -> e835cb356 closes apache/incubator-airflow#1432 *PR abandoned by submitter* Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-588] Add Google Cloud Storage Object sensor[]

2016-10-25 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c49d0b36b -> 61370fbf7 [AIRFLOW-588] Add Google Cloud Storage Object sensor[] The Cloud Storage sensor will check for the existence if an object in a bucket. It will wait till the object exists before continuing. Closes #1849

[2/2] incubator-airflow git commit: Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/incubator-airflow

2016-10-25 Thread criccomini
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/incubator-airflow Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/e835cb35 Tree:

incubator-airflow git commit: closes apache/incubator-airflow#837 *PR abandonned by submitter*

2016-10-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 8886591a2 -> a920035a9 closes apache/incubator-airflow#837 *PR abandonned by submitter* Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-583] Fix decode error in gcs_to_bq

2016-10-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master f8185f9d8 -> e4cca0de2 [AIRFLOW-583] Fix decode error in gcs_to_bq Closes #1845 from Jalepeno112/bug/schema_object_decode_error Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-587] Fix incorrect scope for Google Auth[]

2016-10-24 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c65f403a5 -> 928fa986c [AIRFLOW-587] Fix incorrect scope for Google Auth[] The requested scope is incorrect when calling the Googe API. This splits the scope defines as a single script into an array. Closes #1850 from

incubator-airflow git commit: [AIRFLOW-589] Add templatable job_name[]

2016-10-24 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master c5f663387 -> c65f403a5 [AIRFLOW-589] Add templatable job_name[] The jobname is the name that will appear in the DataProc web console. It's helpfull to have a one-to-one mapping between the airflow task and the job running on

incubator-airflow git commit: [AIRFLOW-638] Add schema_update_options to GCP ops

2016-11-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master dedc54eea -> beb285205 [AIRFLOW-638] Add schema_update_options to GCP ops Closes #1891 from Jalepeno112/feature/gcs_to_bq_schemaUpdateOptions Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-643] Improve date handling for sf_hook

2016-11-21 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master beb285205 -> 935ede22a [AIRFLOW-643] Improve date handling for sf_hook Closes #1898 from Jalepeno112/feature/salesforce- hook-coerce Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-628] Adding SalesforceHook to contrib/hooks

2016-11-18 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 0fd6c2c39 -> b93e6519c [AIRFLOW-628] Adding SalesforceHook to contrib/hooks Also added a salesforce option to setup.py Closes #1881 from Jalepeno112/feature/salesforce- hook Project:

[1/2] incubator-airflow git commit: closes apache/incubator-airflow#1816 *No movement on PR*

2016-11-17 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 15a81e653 -> 0fd6c2c39 closes apache/incubator-airflow#1816 *No movement on PR* Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-514] hive hook loads data from pandas DataFrame into hive and infers types

2016-11-17 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master e1bc51691 -> 15a81e653 [AIRFLOW-514] hive hook loads data from pandas DataFrame into hive and infers types Closes #1801 from danfrankj/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-626][AIRFLOW-1] HTML Content does not show up when sending email with attachment

2016-11-15 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 561b95abb -> 356fa029a [AIRFLOW-626][AIRFLOW-1] HTML Content does not show up when sending email with attachment Closes #1885 from illop/send_email_mimetype Project:

incubator-airflow git commit: [AIRFLOW-626][AIRFLOW-1] HTML Content does not show up when sending email with attachment

2016-11-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 4609f689c -> 55af3e04f [AIRFLOW-626][AIRFLOW-1] HTML Content does not show up when sending email with attachment Closes #1880 from illop/send_email_mimetype Project:

incubator-airflow git commit: [AIRFLOW-577] Output BigQuery job for improved debugging

2016-10-17 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master e36f9a750 -> 0235d59d0 [AIRFLOW-577] Output BigQuery job for improved debugging Closes #1838 from waltherg/fix/bq_error_message Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-658] Improve schema_update_options in GCP

2016-11-29 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master d9bba86e9 -> 209e7e9fa [AIRFLOW-658] Improve schema_update_options in GCP Default argument for `schema_update_options` needs to be immutable. Changed to an empty tuple instead of an empty list. Closes #1909 from

incubator-airflow git commit: [AIRFLOW-667] Handle BigQuery 503 error

2016-12-14 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 67ab416db -> cac133001 [AIRFLOW-667] Handle BigQuery 503 error Closes #1938 from krmettu/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-704][AIRFLOW-1] Fix invalid syntax in BQ hook

2016-12-16 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master cac133001 -> 0be87d5c4 [AIRFLOW-704][AIRFLOW-1] Fix invalid syntax in BQ hook Closes #1947 from criccomini/AIRFLOW-704 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-

svn commit: r17768 - /dev/incubator/airflow/

2017-01-11 Thread criccomini
Author: criccomini Date: Wed Jan 11 15:51:22 2017 New Revision: 17768 Log: Adding Airflow to dev dist Added: dev/incubator/airflow/

incubator-airflow git commit: [AIRFLOW-656] Add dag/task/date index to xcom table

2016-11-30 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 209e7e9fa -> 05f7adb46 [AIRFLOW-656] Add dag/task/date index to xcom table Closes #1907 from criccomini/AIRFLOW-656 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.

incubator-airflow git commit: [AIRFLOW-702] Fix LDAP Regex Bug

2017-01-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 3f7b87501 -> 794540f95 [AIRFLOW-702] Fix LDAP Regex Bug Closes #1945 from robin-miller- ow/feature/LDAPAuthRegexFix Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-734] Fix SMTP auth regression when not using user/pass

2017-01-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 794540f95 -> a6b148149 [AIRFLOW-734] Fix SMTP auth regression when not using user/pass Closes #1974 from criccomini/AIRFLOW-734 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-

svn commit: r17664 - in /release/incubator/airflow: ./ KEYS

2017-01-03 Thread criccomini
Author: criccomini Date: Tue Jan 3 19:14:39 2017 New Revision: 17664 Log: Add airflow to incubator repo Added: release/incubator/airflow/ release/incubator/airflow/KEYS Added: release/incubator/airflow/KEYS

[4/4] incubator-airflow git commit: Merge branch 'master' into v1-8-test

2017-01-05 Thread criccomini
Merge branch 'master' into v1-8-test Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/3fe53cb0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/3fe53cb0 Diff:

[1/4] incubator-airflow git commit: [AIRFLOW-730] Add Handshake to Airflow users

2017-01-05 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 55842308f -> 3fe53cb0e [AIRFLOW-730] Add Handshake to Airflow users Closes #1972 from mhickman/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/4] incubator-airflow git commit: [AIRFLOW-702] Fix LDAP Regex Bug

2017-01-05 Thread criccomini
[AIRFLOW-702] Fix LDAP Regex Bug Closes #1945 from robin-miller- ow/feature/LDAPAuthRegexFix Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/794540f9 Tree:

[3/4] incubator-airflow git commit: [AIRFLOW-734] Fix SMTP auth regression when not using user/pass

2017-01-05 Thread criccomini
[AIRFLOW-734] Fix SMTP auth regression when not using user/pass Closes #1974 from criccomini/AIRFLOW-734 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/a6b14814 Tree: http://git-wip-us.apache.org

incubator-airflow git commit: [AIRFLOW-858] Configurable database name for DB operators

2017-03-29 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test eb12f0164 -> 5eb33358f [AIRFLOW-858] Configurable database name for DB operators Closes #2063 from s7anley/configurable-schema (cherry picked from commit 94dc7fb0a6bb3c563d9df6566cd52a59bd0c4629) Project:

[1/3] incubator-airflow git commit: [AIRFLOW-1017] get_task_instance shouldn't throw exception when no TI

2017-03-29 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 15600e42c -> eb12f0164 [AIRFLOW-1017] get_task_instance shouldn't throw exception when no TI get_task_instance should return None instead of throwing exception in the case where dagrun does not have the task instance.

[3/3] incubator-airflow git commit: [AIRFLOW-832] Let debug server run without SSL

2017-03-29 Thread criccomini
[AIRFLOW-832] Let debug server run without SSL Closes #2051 from gsakkis/fix-debug-server (cherry picked from commit b0ae70d3a8e935dc9266b6853683ae5375a7390b) Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[2/3] incubator-airflow git commit: [AIRFLOW-906] Update Code icon from lightning bolt to file

2017-03-29 Thread criccomini
[AIRFLOW-906] Update Code icon from lightning bolt to file Lightning bolts are not a visual metaphor for code or files. Since Glyphicon doesn't have a code icon (<>, for instance), we should use its file icon. Dear Airflow Maintainers, Please accept this PR that addresses the following issues:

incubator-airflow git commit: [AIRFLOW-1054] Fix broken import in test_dag

2017-04-03 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master daa281c03 -> c64e876bd [AIRFLOW-1054] Fix broken import in test_dag Closes #2201 from r39132/fix_broken_import_on_test_dag Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: [AIRFLOW-1054] Fix broken import in test_dag

2017-04-03 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 5eb33358f -> 68b1c982e [AIRFLOW-1054] Fix broken import in test_dag Closes #2201 from r39132/fix_broken_import_on_test_dag (cherry picked from commit c64e876bd50eeb6c9e2600ac9d832c05eb5e9640) Project:

incubator-airflow git commit: [AIRFLOW-1095] Make ldap_auth memberOf come from configuration

2017-04-10 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/master 177d34157 -> 6b1c327ee [AIRFLOW-1095] Make ldap_auth memberOf come from configuration If the key ldap/group_member_attr is set in the airflow.cfg, this value is used to lookup groups for the user. Closes #2232 from

[1/4] incubator-airflow git commit: [AIRFLOW-111] Include queued tasks in scheduler concurrency check

2017-04-10 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 4199cd3d2 -> a9e0894ba [AIRFLOW-111] Include queued tasks in scheduler concurrency check The concurrency argument in dags appears to not be obeyed because the scheduler does not check the concurrency properly when checking

[2/4] incubator-airflow git commit: [AIRFLOW-1001] Fix landing times if there is no following schedule

2017-04-10 Thread criccomini
[AIRFLOW-1001] Fix landing times if there is no following schedule @once does not have a following schedule. This was not checked for and therefore the landing times page could bork. Closes #2213 from bolkedebruin/AIRFLOW-1001 (cherry picked from commit 0371df4f1bd78e220e591d5cb23630d6a062f109)

incubator-airflow git commit: [AIRFLOW-1121][AIRFLOW-1004] Fix `airflow webserver --pid` to write out pid file

2017-04-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test f0d072cfb -> aef7dd0a5 [AIRFLOW-1121][AIRFLOW-1004] Fix `airflow webserver --pid` to write out pid file After AIRFLOW-1004, --pid option is no longer honored and the pid file is not being written out. This PR fixes it.

incubator-airflow git commit: [AIRFLOW-1127] Move license notices to LICENSE

2017-04-20 Thread criccomini
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test aef7dd0a5 -> dc6ebaab9 [AIRFLOW-1127] Move license notices to LICENSE Closes #2250 from bolkedebruin/AIRFLOW-1127 (cherry picked from commit 659827639e256a668d669d0d229abf49d6010bb8) Project:

  1   2   3   4   5   >