Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22979#discussion_r233009506
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityParser.scala
---
@@ -104,6 +106,14 @@ class UnivocityParser(
requiredSchema.map(f => makeConverter(f.name, f.dataType, f.nullable,
options)).toArray
}
+ private val decimalParser = if (SQLConf.get.legacyDecimalParsing) {
+ (s: String) => new BigDecimal(s.replaceAll(",", ""))
--- End diff --
@MaxGekk, looks we should do the same thing in schema inference path as
well.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
