[jira] [Commented] (AIRFLOW-3363) Plugin templates not rendered by Flask appbuilder's baseview
[ https://issues.apache.org/jira/browse/AIRFLOW-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157404#comment-17157404 ] igor commented on AIRFLOW-3363: --- Hello [~ran.zvi] I had the same issue, but after investigation it was noticed that template path in Blueprints was incorrect. Please do remember that you need to create and register Blueprint for your custom view. > Plugin templates not rendered by Flask appbuilder's baseview > > > Key: AIRFLOW-3363 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3363 > Project: Apache Airflow > Issue Type: Bug > Components: plugins >Affects Versions: 1.10.0 > Environment: Docker >Reporter: Ran Zvi >Priority: Major > > Hello, we're having issues with the new F.A.B plugins (rbac), the > documentation lacks the import for *{{AppBuilderBaseView}}*{{:}} > > {code:java} > # Creating a flask appbuilder BaseView > class TestAppBuilderBaseView(AppBuilderBaseView): > @expose("/") > def test(self): > return self.render("test_plugin/test.html", content="Hello galaxy!"){code} > However after a bit of digging I found out it is probably imported from F.A.B > {code:java} > from flask_appbuilder import BaseView as AppBuilderBaseView{code} > > The next issue is that the class lacks a *{{render}}* function and F.A.B only > provides a *{{render_template}}* function which ignores the > *{{plugins_folder}}* definition in *{{airflow.cfg}}* and the Blueprint's > *{{template_folder}}* definition in the plugin's code. > We've found out that in F.A.B's *{{Environment}}* Object created by Airflow > the only location defined for template location is under *{{www_rbac}}*{{.}} > We're unable to make any progress due to this Bug, does anyone know how to > Thanks in advance! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor reassigned AIRFLOW-5118: - Assignee: Igor (was: Kaxil Naik) > Airflow DataprocClusterCreateOperator does not currently support setting > optional components > > > Key: AIRFLOW-5118 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5118 > Project: Apache Airflow > Issue Type: New Feature > Components: operators >Affects Versions: 1.10.3 >Reporter: Omid Vahdaty >Assignee: Igor >Priority: Minor > > there need to be an option to install optional components via > DataprocClusterCreateOperator . components such as zeppelin. > From the source code of the DataprocClusterCreateOperator[1], the only > software configs that can be set are the imageVersion and the properties. As > the Zeppelin component needs to be set through softwareConfig > optionalComponents[2], the DataprocClusterCreateOperator does not currently > support setting optional components. > > As a workaround for the time being, you could create your clusters by > directly using the gcloud command rather than the > DataprocClusterCreateOperator . Using the Airflow BashOperator[4], you can > execute gcloud commands that create your Dataproc cluster with the required > optional components. > [1] > [https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py] > > [2] > [https://cloud.google.com/dataproc/docs/reference/rest/v1/ClusterConfig#softwareconfig] > > [3] [https://airflow.apache.org/howto/operator/bash.html] -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (AIRFLOW-5045) Add ability to create Google Dataproc cluster with custom image from a different project
[ https://issues.apache.org/jira/browse/AIRFLOW-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor updated AIRFLOW-5045: -- Description: Custom image support has been added for Dataproc by https://issues.apache.org/jira/browse/AIRFLOW-2797. Unfortunately the code assumes that the images come from the same project. It would be useful to add a new parameter 'custom_image_project_id' to specify the source project of the image. was: Thank you for adding support for custom images in Dataproc (https://issues.apache.org/jira/browse/AIRFLOW-2797). Unfortunately the code assumes that the images come from the same project. Would it be possible to add a new parameter 'image_project' to specify the source project of the image? > Add ability to create Google Dataproc cluster with custom image from a > different project > > > Key: AIRFLOW-5045 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5045 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, gcp, operators >Affects Versions: 1.10.3 >Reporter: Igor >Assignee: Igor >Priority: Minor > > Custom image support has been added for Dataproc by > https://issues.apache.org/jira/browse/AIRFLOW-2797. > Unfortunately the code assumes that the images come from the same project. > It would be useful to add a new parameter 'custom_image_project_id' to > specify the source project of the image. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work started] (AIRFLOW-5045) Add ability to create Google Dataproc cluster with custom image from a different project
[ https://issues.apache.org/jira/browse/AIRFLOW-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5045 started by Igor. - > Add ability to create Google Dataproc cluster with custom image from a > different project > > > Key: AIRFLOW-5045 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5045 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, gcp, operators >Affects Versions: 1.10.3 >Reporter: Igor >Assignee: Igor >Priority: Minor > > Thank you for adding support for custom images in Dataproc > (https://issues.apache.org/jira/browse/AIRFLOW-2797). > Unfortunately the code assumes that the images come from the same project. > Would it be possible to add a new parameter 'image_project' to specify the > source project of the image? -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Assigned] (AIRFLOW-5045) Add ability to create Google Dataproc cluster with custom image from a different project
[ https://issues.apache.org/jira/browse/AIRFLOW-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor reassigned AIRFLOW-5045: - Assignee: Igor (was: Jarosław Śmietanka) > Add ability to create Google Dataproc cluster with custom image from a > different project > > > Key: AIRFLOW-5045 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5045 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, gcp, operators >Affects Versions: 1.10.3 >Reporter: Igor >Assignee: Igor >Priority: Minor > > Thank you for adding support for custom images in Dataproc > (https://issues.apache.org/jira/browse/AIRFLOW-2797). > Unfortunately the code assumes that the images come from the same project. > Would it be possible to add a new parameter 'image_project' to specify the > source project of the image? -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (AIRFLOW-5045) Add ability to create Google Dataproc cluster with custom image from a different project
[ https://issues.apache.org/jira/browse/AIRFLOW-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor updated AIRFLOW-5045: -- Description: Thank you for adding support for custom images in Dataproc (https://issues.apache.org/jira/browse/AIRFLOW-2797). Unfortunately the code assumes that the images come from the same project. Would it be possible to add a new parameter 'image_project' to specify the source project of the image? was: Thank you for adding support for custom images in Dataproc. Unfortunately the code assumes that the images come from the same project. Would it be possible to add a new parameter 'image_project' to specify the source project of the image? > Add ability to create Google Dataproc cluster with custom image from a > different project > > > Key: AIRFLOW-5045 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5045 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, gcp, operators >Affects Versions: 1.10.3 >Reporter: Igor >Assignee: Jarosław Śmietanka >Priority: Minor > > Thank you for adding support for custom images in Dataproc > (https://issues.apache.org/jira/browse/AIRFLOW-2797). > Unfortunately the code assumes that the images come from the same project. > Would it be possible to add a new parameter 'image_project' to specify the > source project of the image? -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (AIRFLOW-5045) Add ability to create Google Dataproc cluster with custom image from a different project
Igor created AIRFLOW-5045: - Summary: Add ability to create Google Dataproc cluster with custom image from a different project Key: AIRFLOW-5045 URL: https://issues.apache.org/jira/browse/AIRFLOW-5045 Project: Apache Airflow Issue Type: Improvement Components: contrib, gcp, operators Affects Versions: 1.10.3 Reporter: Igor Assignee: Jarosław Śmietanka Thank you for adding support for custom images in Dataproc. Unfortunately the code assumes that the images come from the same project. Would it be possible to add a new parameter 'image_project' to specify the source project of the image? -- This message was sent by Atlassian JIRA (v7.6.14#76016)