[GitHub] [spark] AngersZhuuuu commented on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

Sun, 27 Dec 2020 19:54:11 -0800 


AngersZhuuuu commented on pull request #30942:
URL: https://github.com/apache/spark/pull/30942#issuecomment-751565576


   Add UT 
   ```
   val query4 = sql(
         """
           |SELECT split(value, "&") FROM (
           |SELECT TRANSFORM(a, b, c)
           |  ROW FORMAT SERDE 
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
           |USING 'cat'
           |  ROW FORMAT SERDE 
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
           |  WITH SERDEPROPERTIES (
           |   'serialization.last.column.takes.rest' = 'true',
           |   'field.delim' = '&'
           |  )
           |FROM (SELECT 1 AS a, 2 AS b, 3 AS c) t
           |) temp;
         """.stripMargin)
       checkAnswer(query4, identity, Row(null) :: Nil)
   ```
   Since in Hive
   
![image](https://user-images.githubusercontent.com/46485123/103188394-3fdb5380-4903-11eb-8c26-bbbf79f71cb1.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to