mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r255364693
########## File path: docs/integration.rst ########## @@ -134,8 +134,31 @@ The AzureContainerRegistryHook requires a host/login/password to be defined in t Interface with ACR +Azure HDInsight +''''''''''''''' + +Azure HDInsight provides quickly spin up big data clusters on demand, scale them up or down based. +The AzureHDInsightHook requires a service principal to be defined in the connection extras and +a host/login/password(for Only HDInsight cluster) to be defined in the connection. + +:class:`airflow.contrib.operators.azure_hdinsight_create_cluster_operator.AzureHDInsightCreateClusterOperator` + Create and Start a HDInsight cluster. + +:class:`airflow.contrib.operators.azure_hdinsight_delete_cluster_operator.AzureHDInsightDeleteClusterOperator` + Delete HDInsight cluster that it's created. + +:class:`airflow.contrib.operators.azure_livysparksubmit_operator.AzureLivySparkSubmitOperator` + Submit a spark job or execute sparksql into a HDInsight cluster + +:class:`airflow.contrib.operators.azure_webhcathivesubmit_operator.AzureWebHCatHiveSubmitOperator` + Submit a Hive file or execute Hive sql into a HDInsight cluster + +:class:`airflow.contrib.hooks.azure_hdinsight_hook.AzureHDInsightHook` + Interface with Azure HDInsight + +:class:`airflow.contrib.hooks.hortonworks_ambari_hook.HdpAmbariHook` + Interface with Azure HortonWorks Ambari Instance -.. _AWS: Review comment: This is necessary. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services