Jacky Wang created SPARK-52759:
----------------------------------
Summary: [SDP] Throw Exception when pipeline is run but no tables
are defined
Key: SPARK-52759
URL: https://issues.apache.org/jira/browse/SPARK-52759
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.1
Reporter: Jacky Wang
In Spark Declarative Pipelines, using the CLI tool users run a pipeline that is
defined from the configured pipeline root directory. This directory contains
information such as the pipeline spec, and the source code files (Python, SQL)
that define the pipeline tables/flows/views.
It’s possible the user tries to run a pipeline defined from a pipeline
directory whose source files don’t actually define any tables or views.
An exception should be thrown if the pipeline does not have any tables or
views, to inform the user they should double check that they are running the
pipeline in the correct directory. The current behavior is that the pipeline
just run to completion without emitting any info.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
