[
https://issues.apache.org/jira/browse/SPARK-20361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz updated SPARK-20361:
---------------------------------------
Description:
Steps to reproduce:
{code}
from pyspark.sql.types import IntegerType
locale = sc._jvm.java.util.Locale
locale.setDefault(locale.forLanguageTag("tr-TR"))
spark.createDataFrame([1, 2, 3], IntegerType())
{code}
{code}
Py4JJavaError: An error occurred while calling o24.applySchemaToPythonRDD.
: java.util.NoSuchElementException: key not found: integer
at scala.collection.MapLike$class.default(MapLike.scala:228)
...
{code}
was:
Steps to reproduce:
{code}
from pyspark.sql.types import IntegerType
locale = sc._jvm.java.util.Locale
locale.setDefault(locale.forLanguageTag("tr-TR"))
spark.createDataFrame([1, 2, 3], IntegerType())
{code}
> JVM locale affects SQL type names
> ----------------------------------
>
> Key: SPARK-20361
> URL: https://issues.apache.org/jira/browse/SPARK-20361
> Project: Spark
> Issue Type: Bug
> Components: PySpark, SQL
> Affects Versions: 2.1.0
> Reporter: Maciej Szymkiewicz
>
> Steps to reproduce:
> {code}
> from pyspark.sql.types import IntegerType
> locale = sc._jvm.java.util.Locale
> locale.setDefault(locale.forLanguageTag("tr-TR"))
> spark.createDataFrame([1, 2, 3], IntegerType())
> {code}
> {code}
> Py4JJavaError: An error occurred while calling o24.applySchemaToPythonRDD.
> : java.util.NoSuchElementException: key not found: integer
> at scala.collection.MapLike$class.default(MapLike.scala:228)
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
