[
https://issues.apache.org/jira/browse/SPARK-52759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza reassigned SPARK-52759:
----------------------------------
Assignee: Jacky Wang
> [SDP] Throw Exception when pipeline is run but no tables are defined
> --------------------------------------------------------------------
>
> Key: SPARK-52759
> URL: https://issues.apache.org/jira/browse/SPARK-52759
> Project: Spark
> Issue Type: Sub-task
> Components: Declarative Pipelines
> Affects Versions: 4.1
> Reporter: Jacky Wang
> Assignee: Jacky Wang
> Priority: Major
> Labels: pull-request-available
>
> In Spark Declarative Pipelines, using the CLI tool users run a pipeline that
> is defined from the configured pipeline root directory. This directory
> contains information such as the pipeline spec, and the source code files
> (Python, SQL) that define the pipeline tables/flows/views.
> It’s possible the user tries to run a pipeline defined from a pipeline
> directory whose source files don’t actually define any tables or views.
> An exception should be thrown if the pipeline does not have any tables or
> views, to inform the user they should double check that they are running the
> pipeline in the correct directory. The current behavior is that the pipeline
> just run to completion without emitting any info.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
