AngersZhuuuu commented on a change in pull request #29739:
URL: https://github.com/apache/spark/pull/29739#discussion_r490003795
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
##########
@@ -693,4 +694,29 @@ case class HiveTableRelation(
override def newInstance(): HiveTableRelation = copy(
dataCols = dataCols.map(_.newInstance()),
partitionCols = partitionCols.map(_.newInstance()))
+
+ override def simpleString(maxFields: Int): String = {
+ val catalogTable = tableMeta.storage.serde match {
+ case Some(serde) => tableMeta.identifier :: serde :: Nil
+ case _ => tableMeta.identifier :: Nil
+ }
+
+ val metadataEntries = Map(
+ "CatalogTable" -> catalogTable.mkString(", "),
+ "Data Cols" -> truncatedString(dataCols, "[", ", ", "]", maxFields),
+ "Partition Cols" -> truncatedString(partitionCols, "[", ", ", "]",
maxFields),
+ "Statistic" -> tableStats.map(_.simpleString).getOrElse(""),
+ "Pruned Partitions" -> prunedPartitions.map { partitions =>
Review comment:
> AFAIK, in Hive each partition can have a different serde. Shall we
display partition serde like before?
Since table level `serde` wan shown, show partition's `serde` is ok for me.
But be honest, default meta value length is 100, one partition `serde`
length always more than 30. It won't show too much info....
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
