Rui Wang created SPARK-39012:
--------------------------------

             Summary: SparkSQL Infer schema path does not support all data types
                 Key: SPARK-39012
                 URL: https://issues.apache.org/jira/browse/SPARK-39012
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Rui Wang


When Spark needs to infer schema, it needs to parse string to a type. Not all 
data types are supported so far in this path. For example, binary is spotted to 
not supported.

string might be converted to all types except ARRAY, MAP, STRUCT, etc.

Spark SQL data types: 
https://spark.apache.org/docs/latest/sql-ref-datatypes.html



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to