Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
voonhous commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3922240568
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
+ incrementalOrCDCIndex(fsRelation.location)
+.flatMap(index => buildCatalogTable(index.metaClient,
lr.schema))
Review Comment:
One more data point for the CDC schema question: the identifier form
(`HoodieSparkBaseAnalysis.scala:104-110`) uses the metastore schema, so shipped
behavior for CDC is table-schema-in-`catalogTable`; the envelope here would be
the new inconsistency.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
voonhous commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3922237105
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
+ incrementalOrCDCIndex(fsRelation.location)
+.flatMap(index => buildCatalogTable(index.metaClient,
lr.schema))
+.map(catalogTable => lr.copy(catalogTable =
Some(catalogTable)))
+.getOrElse(lr)
+case _ => lr
+ }
+ }
+}
+
+ /**
+ * Narrows a [[FileIndex]] to the incremental/CDC Hudi indexes this rule
handles, or
+ * `None` for anything else. Both are [[HoodieFileIndex]] subclasses, so the
widening is
+ * checked by the compiler rather than by an `asInstanceOf` that a future
third index
+ * type could silently break.
+ */
+ private def incrementalOrCDCIndex(location: FileIndex):
Option[HoodieFileIndex] =
+location match {
+ case index: HoodieIncrementalFileIndex => Some(index)
+ case index: HoodieCDCFileIndex => Some(index)
+ case _ => None
+}
+
+ private def buildCatalogTable(
+ metaClient: HoodieTableMetaClient,
+ schema: StructType): Option[CatalogTable] = {
+val tableConfig = metaClient.getTableConfig
+// `hoodie.table.name` is required for a valid Hudi table, but if it is
somehow unset
+// leave `catalogTable` as `None` -- the pre-existing behavior -- rather
than synthesize
+// a `TableIdentifier(null)` that would surface downstream as a garbage
dataset name.
+Option(tableConfig.getTableName).filter(_.nonEmpty).map { tableName =>
+ // Falls back to Spark's `default` database when `hoodie.database.name`
is unset --
+ // matches existing path-based DataFrame read behavior.
+ val dbName = Option(tableConfig.getDatabaseName).filter(_.nonEmpty)
+ CatalogTable(
+identifier = TableIdentifier(tableName, dbName),
Review Comment:
**minor:** this name is `hoodie.properties`-derived and can diverge from the
catalog identity: `CREATE TABLE ... LOCATION` over an existing table leaves
name/db untouched (`HoodieCatalogTable.scala:204,234-235` set them only when
`!hoodieTableExists`; `TestCreateTable.scala:240-313` registers one path under
three names), and DataFrame-written tables default `hoodie.database.name` to
`""` (`HoodieSparkSqlWriter.scala:241`), so they stamp unqualified. Not
blocking. Could the scaladoc say `storage.locationUri` is the stable key and
the identifier may not be catalog-resolvable?
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
Review Comment:
**minor:** OpenLineage never falls back to a class name:
`LogicalRelationDatasetBuilder` checks `catalogTable.isDefined` first, then
handles any `HadoopFsRelation` via `relation.location().rootPaths()` (unhandled
relations throw). Since #17457 (`0c0c402a9a03`, 2025-12-07) incremental/CDC
reads
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
voonhous commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3921176476
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
+ incrementalOrCDCIndex(fsRelation.location)
+.flatMap(index => buildCatalogTable(index.metaClient,
lr.schema))
Review Comment:
**minor:** `lr.schema` is the plan output, not the table. For CDC it is the
`(op, ts_ms, before, after)` envelope
(`HoodieHadoopFsRelationFactory.scala:353,468`), while
`hudi_table_changes('db.tbl', 'cdc', ...)` attaches the real table schema to
the same relation (`HoodieSparkBaseAnalysis.scala:104-110`), so one table is
published under two schemas. And if the first analysis references `_metadata`,
`AddMetadataColumns` has already appended it to `lr.output`
(`LogicalRelation.withMetadataColumns`). Not blocking. Could we pass
`fsRelation.schema` here, and for CDC either resolve the table schema or say in
the scaladoc that the envelope is intentional?
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
+ incrementalOrCDCIndex(fsRelation.location)
+.flatMap(index => buildCatalogTable(index.metaClient,
lr.schema))
+.map(catalogTable => lr.copy(catalogTable =
Some(catalogTable)))
+.getOrElse(lr)
+case _ => lr
+ }
+ }
+}
+
+ /**
+ * Narrows a [[FileIndex]] to the incremental/CDC Hudi indexes this rule
handles, or
+ * `None` for anything else. Both are [[HoodieFileIndex]] subclasses, so the
widening is
+ * checked by the compiler rather than by an `asInstanceOf` that a future
third index
+ * type could silently break.
+ */
+ private def incrementalOrCDCIndex(location: FileIndex):
Option[HoodieFileIndex] =
+location match {
+ case index: HoodieIncrementalFileIndex => Some(index)
+ case index: HoodieCDCFileIndex => Some(index)
+ case _ => None
+}
+
+ private
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-agent commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3831947233
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
Review Comment:
🤖 nit: the lambda parameter `catalogTable` shadows the field name
`catalogTable` in `lr.copy(catalogTable = Some(catalogTable))`, so parsing the
expression requires a double-take. Could you rename the parameter to something
like `ct` or `table` to make the chain scan a bit faster?
⚠️ AI-generated; verify before applying. React 👍/👎 to flag
quality.
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -639,3 +643,70 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + nested match avoids destructuring `LogicalRelation`,
whose
+// case-class arity differs between Spark 3.x (4 args) and Spark 4.x
(5 args). This
+// rule lives in `hudi-spark`, which is compiled against every
supported profile.
+case lr: LogicalRelation if lr.catalogTable.isEmpty =>
+ lr.relation match {
+case fsRelation: HadoopFsRelation =>
+ incrementalOrCDCIndex(fsRelation.location)
+.flatMap(index => buildCatalogTable(index.metaClient,
lr.schema))
+.map(catalogTable => lr.copy(catalogTable =
Some(catalogTable)))
+.getOrElse(lr)
+case _ => lr
+ }
+ }
+}
+
+ /**
Review Comment:
🤖 nit: the phrase "the widening is checked by the compiler rather than by an
`asInstanceOf`" is a bit hard to parse -- `asInstanceOf` is a cast, not a
check, so the comparison is a little off. Could you rephrase to something like:
"Typed as `Option[HoodieFileIndex]` so the compiler verifies both matched types
are subtypes -- a future third index added without updating this method won't
accidentally slip through as `None`"?
⚠️ AI-generated; verify before applying. React 👍/👎 to flag
quality.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5367065048 ## CI report: * 560c4d95865c3b37d90d3adbad1209410c90c128 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16445) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5366222907 ## CI report: * 6a7070bf37f638881714330e4548c1baa3e655a6 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16441) * 560c4d95865c3b37d90d3adbad1209410c90c128 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16445) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5365883627 ## CI report: * 7e276b20fb508db050f77bc2458694a75f9ba1dc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16404) * 6a7070bf37f638881714330e4548c1baa3e655a6 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16441) * 560c4d95865c3b37d90d3adbad1209410c90c128 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16445) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5365430531 ## CI report: * 7e276b20fb508db050f77bc2458694a75f9ba1dc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16404) * 6a7070bf37f638881714330e4548c1baa3e655a6 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16441) * 560c4d95865c3b37d90d3adbad1209410c90c128 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-536539 ## CI report: * 7e276b20fb508db050f77bc2458694a75f9ba1dc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16404) * 6a7070bf37f638881714330e4548c1baa3e655a6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5352372754 ## CI report: * 7e276b20fb508db050f77bc2458694a75f9ba1dc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16404) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-agent commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3818967888
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/analysis/TestHoodieIncrementalRelationIdentifier.scala:
##
@@ -0,0 +1,182 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.analysis
+
+import org.apache.hudi.{HoodieFileIndex, HoodieIncrementalFileIndex,
ScalaAssertionSupport}
+import org.apache.hudi.HoodieConversionUtils.toJavaOption
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieInstant
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+import org.apache.hudi.testutils.HoodieClientTestBase
+import org.apache.hudi.util.JFunction
+
+import org.apache.spark.sql.{SparkSession, SparkSessionExtensions}
+import org.apache.spark.sql.execution.datasources.{HadoopFsRelation,
LogicalRelation}
+import org.apache.spark.sql.hudi.HoodieSparkSessionExtension
+import org.junit.jupiter.api.{BeforeEach, Test}
+import org.junit.jupiter.api.Assertions.{assertEquals, assertFalse, assertTrue}
+import org.junit.jupiter.params.ParameterizedTest
+import org.junit.jupiter.params.provider.ValueSource
+
+import java.util.function.Consumer
+
+/**
+ * Verifies that [[HoodieIncrementalRelationIdentifier]] enriches path-based
incremental
+ * reads (and only those), so that lineage tooling sees a real table
identifier instead
+ * of falling back to the relation's class name.
+ */
+class TestHoodieIncrementalRelationIdentifier extends HoodieClientTestBase
with ScalaAssertionSupport {
+
+ private var spark: SparkSession = _
+
+ @BeforeEach
+ override def setUp() {
+setTableName("hoodie_incr_id_test")
+initPath()
+initSparkContexts()
+spark = sqlContext.sparkSession
+ }
+
+ override def getSparkSessionExtensionsInjector:
org.apache.hudi.common.util.Option[Consumer[SparkSessionExtensions]] =
+toJavaOption(
+ Some(
+JFunction.toJavaConsumer((receiver: SparkSessionExtensions) => new
HoodieSparkSessionExtension().apply(receiver)))
+)
+
+ @ParameterizedTest
+ @ValueSource(strings = Array("cow", "mor"))
+ def testPathBasedIncrementalReadGetsCatalogTable(tableType: String): Unit = {
+val tablePath = s"$basePath/$tableName"
+createAndPopulateTable(tableType, tablePath)
+
+val firstInstant = firstCompletedInstantTime(tablePath)
+
+val df = spark.read.format("hudi")
+ .option("hoodie.datasource.query.type", "incremental")
+ .option("hoodie.datasource.read.begin.instanttime", firstInstant)
+ .load(tablePath)
+
+val analyzed = df.queryExecution.analyzed
+
+val lrOpt = analyzed.collectFirst { case lr: LogicalRelation => lr }
+assertTrue(lrOpt.isDefined,
+ s"Expected a LogicalRelation in analyzed plan, got:\n$analyzed")
+val lr = lrOpt.get
+
+// Sanity: confirm the path under test really exercises the incremental
file index.
+val location = lr.relation.asInstanceOf[HadoopFsRelation].location
+assertTrue(location.isInstanceOf[HoodieIncrementalFileIndex],
+ s"Expected HoodieIncrementalFileIndex, got:
${location.getClass.getName}")
+
+assertTrue(lr.catalogTable.isDefined,
+ s"Expected catalogTable to be populated by
HoodieIncrementalRelationIdentifier, got None")
+
+val ct = lr.catalogTable.get
+assertEquals(tableName, ct.identifier.table,
+ s"Expected catalogTable identifier to use Hudi table name '$tableName',
got '${ct.identifier.table}'")
+assertEquals(Some("hudi"), ct.provider,
+ s"Expected provider 'hudi', got '${ct.provider}'")
+assertTrue(ct.storage.locationUri.isDefined,
+ "Expected catalogTable.storage.locationUri to be populated from
metaClient.getBasePath")
+assertTrue(ct.schema.fields.nonEmpty,
+ "Expected catalogTable.schema to mirror the relation's resolved output
schema")
+ }
+
+ @Test
+ def testCatalogRegisteredIncrementalReadIsNotMutated(): Unit = {
+spark.sql(
+ s"""
Review Comment:
🤖 nit: the method name says `IncrementalRead` but the test body runs a plain
`SELECT * FROM tableName` snapshot query, not an incremental one. Could you
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5351929200 ## CI report: * 6d8ab2e9a7dd9270d2d8d1e0a6c62bc3ad3eccfb Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16343) * 7e276b20fb508db050f77bc2458694a75f9ba1dc Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16404) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5351879229 ## CI report: * 6d8ab2e9a7dd9270d2d8d1e0a6c62bc3ad3eccfb Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16343) * 7e276b20fb508db050f77bc2458694a75f9ba1dc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codope commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5351842536 @voonhous @yihua PTAL. We have landed a version of this internally in our release-1.2 fork. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5317072284 ## CI report: * 6d8ab2e9a7dd9270d2d8d1e0a6c62bc3ad3eccfb Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16343) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codope commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3796656780
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -620,3 +624,54 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
Review Comment:
no need.. it will unnecessarily create confusion
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5316573716 ## CI report: * 21143fe37b6f8930bcbd2362777672d525a5200c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14006) * 6d8ab2e9a7dd9270d2d8d1e0a6c62bc3ad3eccfb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-5316641804 ## CI report: * 21143fe37b6f8930bcbd2362777672d525a5200c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14006) * 6d8ab2e9a7dd9270d2d8d1e0a6c62bc3ad3eccfb Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16343) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460253969 ## CI report: * 21143fe37b6f8930bcbd2362777672d525a5200c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14006) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460151807 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.14%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.14% +0.03% - Complexity2902029092 +72 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796175 +188 + Misses3705837046 -12 - Partials 7889 7914 +25 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `49.02% <82.60%> (+0.02%)` | :arrow_up: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460148329 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.14%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.14% +0.03% - Complexity2902029092 +72 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796175 +188 + Misses3705837046 -12 - Partials 7889 7914 +25 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `49.02% <82.60%> (+0.02%)` | :arrow_up: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460118354 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.14%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.14% +0.03% - Complexity2902029091 +71 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796174 +187 + Misses3705837046 -12 - Partials 7889 7915 +26 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.99% <82.60%> (-0.01%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460036043 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.13%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.13% +0.02% - Complexity2902029091 +71 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796164 +177 + Misses3705837055 -3 - Partials 7889 7916 +27 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.93% <82.60%> (-0.07%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460045044 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.14%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.14% +0.03% - Complexity2902029091 +71 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796172 +185 + Misses3705837048 -10 - Partials 7889 7915 +26 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.95% <82.60%> (-0.04%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460038032 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.13%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.13% +0.02% - Complexity2902029091 +71 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796164 +177 + Misses3705837055 -3 - Partials 7889 7916 +27 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.93% <82.60%> (-0.07%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <82.60%> (+0.01%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460017894 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.01%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 68.01% -0.10% - Complexity2902029025 +5 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598795996 +9 - Misses3705837239 +181 - Partials 7889 7900 +11 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.62% <82.60%> (-0.37%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460025254 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.08%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 68.08% -0.02% - Complexity2902029062 +42 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598796098 +111 - Misses3705837131 +73 - Partials 7889 7906 +17 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.89% <82.60%> (-0.11%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460016736 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.01%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 68.01% -0.10% - Complexity2902029025 +5 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 + Hits 9598795996 +9 - Misses3705837239 +181 - Partials 7889 7900 +11 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.62% <82.60%> (-0.37%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4460009240 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 67.23%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 67.23% -0.87% + Complexity2902028709 -311 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598794899-1088 - Misses3705838292+1234 - Partials 7889 7944 +55 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.07% <82.60%> (-3.92%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459991427 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 65.35%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 65.35% -2.76% + Complexity2902027877-1143 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598792236-3751 - Misses3705840936+3878 - Partials 7889 7963 +74 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.61% <78.26%> (-17.39%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.75% <82.60%> (-0.15%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-446490 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 67.12%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 67.12% -0.99% + Complexity2902028641 -379 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598794740-1247 - Misses3705838468+1410 - Partials 7889 7927 +38 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.74% <82.60%> (-4.25%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459997566 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 66.97%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 66.97% -1.14% + Complexity2902028558 -462 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598794529-1458 - Misses3705838676+1618 - Partials 7889 7930 +41 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `41.92% <82.60%> (-7.08%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <82.60%> (-0.07%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459994717 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 66.93%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 66.93% -1.18% + Complexity2902028528 -492 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598794472-1515 - Misses3705838744+1686 - Partials 7889 7919 +30 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `41.92% <82.60%> (-7.08%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.75% <82.60%> (-0.15%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459953347 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 65.22%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 65.22% -2.88% + Complexity2902027819-1201 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598792060-3927 - Misses3705841108+4050 - Partials 7889 7967 +78 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.61% <78.26%> (-17.39%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.53% <82.60%> (-0.37%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459908410 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 58.48%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 20 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|6| >|spark-java-tests|18|5| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 58.48% -9.63% + Complexity2902025003-4017 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598782544 -13443 - Misses3705851201 +14143 + Partials 7889 7390 -499 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.61% <78.26%> (-17.39%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.76% <82.60%> (-12.14%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459913024 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 60.87%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 19 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|6| >|spark-java-tests|18|5| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 60.87% -7.24% + Complexity2902025966-3054 Files 2516 2517 +1 Lines140934 141135 +201 Branches 1747517514 +39 - Hits 9598785918 -10069 - Misses3705847675 +10617 + Partials 7889 7542 -347 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <21.73%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.61% <78.26%> (-17.39%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.76% <82.60%> (-12.14%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.62% <78.26%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459902045 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 47.91%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 21 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|6| >|spark-java-tests|18|5| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 47.91% -20.19% + Complexity2902017174-11846 = Files 2516 2050 -466 Lines140934 117358-23576 Branches 1747515272 -2203 = - Hits 9598756237-39750 - Misses3705854923+17865 + Partials 7889 6198 -1691 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.61% <78.26%> (-17.39%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.76% <82.60%> (-12.14%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459895756 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 47.55%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 25 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|4| >|spark-java-tests|18|3| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 47.55% -20.55% + Complexity2902017001-12019 = Files 2516 2050 -466 Lines140934 117358-23576 Branches 1747515272 -2203 = - Hits 9598755815-40172 - Misses3705855429+18371 + Partials 7889 6114 -1775 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.34% <78.26%> (-16.66%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.91% <82.60%> (-12.00%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459893676 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 47.93%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 27 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|2| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 47.93% -20.18% + Complexity2902016739-12281 = Files 2516 2028 -488 Lines140934 114814-26120 Branches 1747514722 -2753 = - Hits 9598755034-40953 - Misses3705853859+16801 + Partials 7889 5921 -1968 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.71% <78.26%> (-16.29%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.90% <82.60%> (-12.00%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459900746 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 47.89%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 22 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|6| >|spark-java-tests|18|4| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 47.89% -20.22% + Complexity2902017165-11855 = Files 2516 2050 -466 Lines140934 117358-23576 Branches 1747515272 -2203 = - Hits 9598756204-39783 - Misses3705854952+17894 + Partials 7889 6202 -1687 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.98% <78.26%> (-17.01%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.76% <82.60%> (-12.14%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459889528 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 48.69%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 28 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|1| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 48.69% -19.42% + Complexity2902016631-12389 = Files 2516 1998 -518 Lines140934 112107-28827 Branches 1747514152 -3323 = - Hits 9598754589-41398 - Misses3705851698+14640 + Partials 7889 5820 -2069 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.10% <78.26%> (-15.90%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.90% <82.60%> (-12.00%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459886959 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 45.90%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 29 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 45.90% -22.21% + Complexity2902015736-13284 = Files 2516 1998 -518 Lines140934 112076-28858 Branches 1747514063 -3412 = - Hits 9598751446-44541 - Misses3705855000+17942 + Partials 7889 5630 -2259 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.90% <82.60%> (-12.00%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459882697 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `82.60870%` with `4 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 46.38%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 82.60% | [0 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 30 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|2| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 46.38% -21.73% + Complexity2902015530-13490 = Files 2516 1981 -535 Lines140934 109690-31244 Branches 1747513552 -3923 = - Hits 9598750877-45110 - Misses3705853368+16310 + Partials 7889 5445 -2444 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.10% <82.60%> (-11.81%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459860306 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 54.00%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 32 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|0| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 54.00% -14.10% + Complexity2902012456-16564 = Files 2516 1434 -1082 Lines14093472161-68773 Branches 17475 8245 -9230 = - Hits 9598738973-57014 + Misses3705829691 -7367 + Partials 7889 3497 -4392 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.32% <ø> (-0.03%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. [see 1863 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18726/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) :rocket: New features to boost your workflow: - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459700215 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 45.00%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`21143fe`](https://app.codecov.io/gh/apache/hudi/commit/21143fe37b6f8930bcbd2362777672d525a5200c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 7 commits behind head on master. > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (21143fe). Click for more details. > > HEAD has 33 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (21143fe) | >|--|--|--| >|spark-scala-tests|12|0| >|spark-client-hadoop-common|1|0| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 45.00% -23.11% + Complexity29020 8571-20449 = Files 2516 1202 -1314 Lines14093462816-78118 Branches 17475 6811-10664 = - Hits 9598728271-67716 + Misses3705831428 -5630 + Partials 7889 3117 -4772 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. [see 2115 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18726/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) :rocket: New features to boost your workflow: - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-agent commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3248083753
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -620,3 +624,54 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
Review Comment:
🤖 nit: the object handles both incremental and CDC reads (per
`isIncrementalOrCDC`), but the name only mentions `Incremental`. Could you
rename to something like `HoodieIncrementalAndCDCRelationIdentifier` (or just
`HoodiePathBasedRelationIdentifier`) so future readers searching for CDC
behavior find it here?
- AI-generated; verify before applying. React 👍/👎 to flag
quality.
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -620,3 +624,54 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+// Type pattern + guard avoids destructuring `LogicalRelation`, whose
case-class
+// arity differs between Spark 3.x (4 args) and Spark 4.x (5 args).
This rule
+// lives in `hudi-spark`, which is compiled against every supported
profile.
+case lr: LogicalRelation
+if lr.catalogTable.isEmpty
+ && lr.relation.isInstanceOf[HadoopFsRelation]
+ &&
isIncrementalOrCDC(lr.relation.asInstanceOf[HadoopFsRelation].location) =>
+ val fsRelation = lr.relation.asInstanceOf[HadoopFsRelation]
Review Comment:
🤖 nit: `lr.relation.asInstanceOf[HadoopFsRelation]` is repeated three times
across the guard, the rebinding, and the `metaClient` extraction. Could you
bind it once (e.g. an `@` pattern or a `val` after the match) so the cast
appears in only one place?
- AI-generated; verify before applying. React 👍/👎 to flag
quality.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459650363 ## CI report: * 1bbc5cadc8065fa3644c662049fb2736eafb77be Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13956) * 21143fe37b6f8930bcbd2362777672d525a5200c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14006) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4459621588 ## CI report: * 1bbc5cadc8065fa3644c662049fb2736eafb77be Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13956) * 21143fe37b6f8930bcbd2362777672d525a5200c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-agent commented on code in PR #18726:
URL: https://github.com/apache/hudi/pull/18726#discussion_r3235391470
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -620,3 +624,48 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
Review Comment:
🤖 The 4-arg pattern `LogicalRelation(hfsr, _, None, _)` will fail to compile
against Spark 4.0/4.1, where `LogicalRelation` is a 5-arg case class (see e.g.
`BaseSpark4Adapter`, `Spark4HoodiePruneFileSourcePartitions`,
`HoodieSpark40/41Analysis` — all 5-arg). Since `hudi-spark` is built per Spark
profile, this would break the Spark 4 builds. Could you switch to a
Spark-version-agnostic type pattern (e.g. `case lr: LogicalRelation if
lr.catalogTable.isEmpty && lr.relation.isInstanceOf[HadoopFsRelation] &&
isIncrementalOrCDC(lr.relation.asInstanceOf[HadoopFsRelation].location] =>
...`) to match the convention used by every other `LogicalRelation` reference
in `hudi-spark`? @yihua
- AI-generated; verify before applying. React 👍/👎 to flag
quality.
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala:
##
@@ -620,3 +624,48 @@ case class HoodiePostAnalysisRule(sparkSession:
SparkSession) extends Rule[Logic
}
}
}
+
+/**
+ * Stamps a synthesized [[CatalogTable]] (table name, base path, schema) onto
path-based
+ * Hudi reads whose underlying file index is incremental or CDC. Without it,
lineage and
+ * governance tooling sees `LogicalRelation.catalogTable = None` and falls
back to the
+ * relation's class name as the dataset identifier -- useless for tracking
which table
+ * an incremental query came from.
+ *
+ * Scope is intentionally limited to incremental and CDC reads:
+ * - Catalog-registered reads already have `catalogTable` populated.
+ * - Path-based snapshot reads have a working file-path-based fallback in
existing
+ *lineage tooling; changing their behavior is a separate decision.
+ */
+object HoodieIncrementalRelationIdentifier extends Rule[LogicalPlan] {
+ override def apply(plan: LogicalPlan): LogicalPlan =
+AnalysisHelper.allowInvokingTransformsInAnalyzer {
+ plan transform {
+case lr @ LogicalRelation(hfsr: HadoopFsRelation, _, None, _)
Review Comment:
🤖 nit: `hfsr` requires a moment of mental decoding — could you use
`fsRelation` or just `rel` so the reader doesn't have to expand the
abbreviation?
- AI-generated; verify before applying. React 👍/👎 to flag
quality.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441993546 ## CI report: * 1bbc5cadc8065fa3644c662049fb2736eafb77be Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13956) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441956684 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 69.42%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 69.42% +1.31% + Complexity2902028421 -599 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598794256-1731 + Misses3705833946-3112 + Partials 7889 7570 -319 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.74% <90.00%> (-1.26%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <90.00%> (+0.58%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441942785 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 69.42%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 69.42% +1.31% + Complexity2902028421 -599 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598794256-1731 + Misses3705833946-3112 + Partials 7889 7570 -319 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.71% <90.00%> (-1.29%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <90.00%> (+0.58%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441806089 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 69.42%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 69.42% +1.31% + Complexity2902028419 -601 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598794253-1734 + Misses3705833948-3110 + Partials 7889 7571 -318 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.67% <90.00%> (-1.32%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <90.00%> (+0.58%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441790033 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.64%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.64% +0.53% + Complexity2902028114 -906 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598793195-2792 + Misses3705834948-2110 + Partials 7889 7629 -260 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.91% <90.00%> (-5.08%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <90.00%> (+0.58%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441737986 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.51%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.51% +0.41% + Complexity2902028042 -978 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598793030-2957 + Misses3705835130-1928 + Partials 7889 7612 -277 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.53% <90.00%> (-5.46%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <90.00%> (+0.58%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441731297 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.34%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.34% +0.24% + Complexity2902027964-1056 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598792799-3188 + Misses3705835391-1667 + Partials 7889 7582 -307 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.13% <90.00%> (-5.86%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.36% <90.00%> (+0.46%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441725634 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 68.28%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## + Coverage 68.10% 68.28% +0.18% + Complexity2902027934-1086 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598792716-3271 + Misses3705835485-1573 + Partials 7889 7571 -318 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.13% <90.00%> (-5.86%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.25% <90.00%> (+0.34%)` | :arrow_up: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441714935 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 64.23%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 64.23% -3.88% + Complexity2902026270-2750 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598787211-8776 - Misses3705841401+4343 + Partials 7889 7160 -729 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.13% <90.00%> (-5.86%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.92% <90.00%> (-11.98%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| |
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441695828 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 62.10%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 24 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|3| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 62.10% -6.01% + Complexity2902025428-3592 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598784315 -11672 - Misses3705844272+7214 + Partials 7889 7185 -704 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.35% <85.00%> (-16.64%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.92% <90.00%> (-11.98%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441674446 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 62.07%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 25 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|2| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 62.07% -6.04% + Complexity2902025419-3601 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598784281 -11706 - Misses3705844301+7243 + Partials 7889 7190 -699 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.72% <85.00%> (-16.27%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.92% <90.00%> (-11.98%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441656469 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 62.04%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 26 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|1| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 62.04% -6.07% + Complexity2902025404-3616 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598784236 -11751 - Misses3705844339+7281 + Partials 7889 7197 -692 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.98% <85.00%> (-16.02%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.92% <90.00%> (-11.98%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.63% <85.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441597478 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 59.54%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 27 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|3| >|spark-java-tests|18|1| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 59.54% -8.57% + Complexity2902024436-4584 Files 2516 2465 -51 Lines140934 135772-5162 Branches 1747516287-1188 - Hits 9598780842 -15145 - Misses3705847886 +10828 + Partials 7889 7044 -845 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.98% <85.00%> (-16.02%)` | :arrow_down: | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.92% <90.00%> (-11.98%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441577686 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 58.34%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 29 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|2| >|spark-java-tests|18|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## - Coverage 68.10% 58.34% -9.76% + Complexity2902023553-5467 Files 2516 2447 -69 Lines140934 133384-7550 Branches 1747515775-1700 - Hits 9598777828 -18159 - Misses3705848862 +11804 + Partials 7889 6694-1195 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.41% <25.00%> (+0.03%)` | :arrow_up: | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.04% <90.00%> (-11.86%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441568337 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 46.34%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 30 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|2| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 46.34% -21.76% + Complexity2902015513-13507 = Files 2516 1980 -536 Lines140934 109619-31315 Branches 1747513537 -3938 = - Hits 9598750807-45180 - Misses3705853376+16318 + Partials 7889 5436 -2453 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.04% <90.00%> (-11.86%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441566971 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `90.0%` with `2 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 46.34%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...pache/spark/sql/hudi/analysis/HoodieAnalysis.scala](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fanalysis%2FHoodieAnalysis.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9hbmFseXNpcy9Ib29kaWVBbmFseXNpcy5zY2FsYQ==) | 90.00% | [0 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18726?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 30 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|2| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 46.34% -21.76% + Complexity2902015513-13507 = Files 2516 1980 -536 Lines140934 109619-31315 Branches 1747513537 -3938 = - Hits 9598750807-45180 - Misses3705853376+16318 + Partials 7889 5436 -2453 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.04% <90.00%> (-11.86%)` | :arrow_down: | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files with missing
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441540097 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 54.02%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 32 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|0| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 54.02% -14.08% + Complexity2902012452-16568 = Files 2516 1434 -1082 Lines14093472134-68800 Branches 17475 8238 -9237 = - Hits 9598738973-57014 + Misses3705829662 -7396 + Partials 7889 3499 -4390 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.34% <ø> (-0.01%)` | :arrow_down: | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. [see 1861 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18726/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) :rocket: New features to boost your workflow: - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codecov-commenter commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441460837 ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18726?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 45.00%. Comparing base ([`b6bc165`](https://app.codecov.io/gh/apache/hudi/commit/b6bc1658e8f2862583c22425eaa0665ae100f5a3?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1bbc5ca`](https://app.codecov.io/gh/apache/hudi/commit/1bbc5cadc8065fa3644c662049fb2736eafb77be?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). :warning: Report is 1 commits behind head on master. > :exclamation: There is a different number of reports uploaded between BASE (b6bc165) and HEAD (1bbc5ca). Click for more details. > > HEAD has 33 uploads less than BASE > >| Flag | BASE (b6bc165) | HEAD (1bbc5ca) | >|--|--|--| >|spark-scala-tests|12|0| >|spark-client-hadoop-common|1|0| >|spark-java-tests|18|0| >|common-and-other-modules|1|0| >|utilities|1|0| > Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #18726 +/- ## = - Coverage 68.10% 45.00% -23.11% + Complexity29020 8568-20452 = Files 2516 1202 -1314 Lines14093462805-78129 Branches 17475 6809-10666 = - Hits 9598728263-67724 + Misses3705831427 -5631 + Partials 7889 3115 -4774 ``` | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.03%)` | :arrow_down: | | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18726/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more. [see 2114 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18726/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) :rocket: New features to boost your workflow: - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441259807 ## CI report: * 1bbc5cadc8065fa3644c662049fb2736eafb77be Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13956) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
hudi-bot commented on PR #18726: URL: https://github.com/apache/hudi/pull/18726#issuecomment-4441221213 ## CI report: * 1bbc5cadc8065fa3644c662049fb2736eafb77be UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
[PR] feat(spark): Make Hudi's analyzed plans introspectable to lineage tooling [hudi]
codope opened a new pull request, #18726:
URL: https://github.com/apache/hudi/pull/18726
### Describe the issue this Pull Request addresses
Today, a downstream consumer that walks an analyzed Spark plan to extract
column lineage hits two dead ends on Hudi:
- **Hudi MERGE is opaque.** `MergeIntoHoodieTableCommand` extends
`HoodieLeafRunnableCommand`, which forces `children = Nil`. That is the right
call for the Catalyst optimizer (we don't want generic optimizer rules
rewriting the source/target subtrees out from under our custom resolution), but
it also hides the source plan, target plan, and merge condition from every plan
walker, so lineage tooling sees a leaf with no inputs and reports the merge as
having no upstream columns. The other Hudi write commands (`Insert`, `Update`,
`Delete`, `CTAS`) were already migrated to `DataWritingCommand`/`UnaryCommand`
in #12772, which exposes the source plan via standard `children`, so MERGE is
the lone gap on master.
- **Path-based incremental / CDC reads are anonymous.** When a user runs
`spark.read.format("hudi").option("hoodie.datasource.query.type",
"incremental").load(path)`, the resulting `LogicalRelation.catalogTable` is
`None`. Lineage tooling then falls back to the relation's class name
("HadoopFsRelation") as the dataset identifier, which collides across every
Hudi incremental read in the job and is useless for tracking which table a
query came from.
### Summary and Changelog
Make Hudi's analyzed plans introspectable to lineage tooling that walks
Catalyst plans (e.g. OpenLineage Spark integration, Atlas, custom analyzer
extensions, etc.). Two changes:
1. **`MergeIntoHoodieTableCommand.innerChildren`**: expose the analyzed
`MergeIntoTable` (source plan, target plan, merge condition, matched /
not-matched actions) without breaking the optimizer leaf contract.
2. **`HoodieIncrementalRelationIdentifier`**: post-hoc analyzer rule that
stamps a synthesized `CatalogTable` (table name, base path, schema) onto
`LogicalRelation`s backed by `HoodieIncrementalFileIndex` /
`HoodieCDCFileIndex` when the read entered via path (i.e. no catalog
registration).
Tracking issue: apache/hudi#18298
### Impact
`innerChildren` for MERGE
`TreeNode.innerChildren` is Spark's documented escape hatch for plan nodes
that need to expose subtrees for display/inspection without participating in
optimizer traversal. It is *not* visited by `transform` / `mapChildren`, so
there is no risk of generic Catalyst rules re-writing the inner
`MergeIntoTable`. It *is* rendered by `EXPLAIN` and is the conventional access
point for plan walkers. This is the same pattern Spark itself uses for
`WriteToDataSourceV2Exec` and other commands that wrap a logical plan they
don't want optimized as a child. The `HoodieLeafLike#children = Nil` contract
is preserved. This change is a purely additive method override.
`HoodieIncrementalRelationIdentifier`
The rule runs as a `customPostHocResolutionRule`, so it sees the resolved
plan after Hudi's own analyzer rules have built the relation. It only fires
when **all** of the following hold:
- The node is a `LogicalRelation` over `HadoopFsRelation`
- `catalogTable` is `None` (catalog-registered reads are left alone)
- The location is `HoodieIncrementalFileIndex` or `HoodieCDCFileIndex`
When it matches, it pulls the table name, base path, and database name from
the existing `HoodieTableMetaClient` carried by the existing file index (no
extra metadata / FS calls), and synthesizes a `CatalogTable` from that plus the
relation's resolved schema. Database falls back to Spark's `default` when
`hoodie.database.name` is unset, matching existing path-based read behavior.
**Why scope is limited to incremental and CDC:**
- Catalog reads already populate `catalogTable`.
- Path-based snapshot reads have a working file-path-based fallback in
existing lineage extractors. Whether to enrich them too is a separate decision
(easy to extend later.
The transform is wrapped in
`AnalysisHelper.allowInvokingTransformsInAnalyzer { ... }`, matching existing
convention in `HoodieAnalysis.scala` (e.g.
`AdaptIngestionTargetLogicalRelations`).
### Risk Level
Low.
- `innerChildren` is consumed only by `EXPLAIN` rendering and opt-in plan
walkers; nothing in Hudi's write path or Spark's optimizer traverses it.
- The analyzer rule is a no-op when `catalogTable` is already set, so
catalog-registered tables are unaffected.
- No write path, no public API surface, no config changes.
### Test plan
Two new Spark integration tests under
`hudi-spark-datasource/hudi-spark/src/test/scala/.../analysis/`:
`TestMergeIntoHoodieTableCommandInnerChildren`:
- `testMergeIntoExposesAnalyzedMergeIntoTableViaInnerChildren`: asserts
`cmd.children.isEmpty` (leaf contract
