A single json object would mean for most parsers it needs to fit in memory when reading or writing
On Oct 15, 2016 11:09, "codlife" <1004910...@qq.com> wrote: > Hi: > I'm doubt about the design of spark.read.json, why the json file is not > a standard json file, who can tell me the internal reason. Any advice is > appreciated. > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Why-the-json-file-used-by- > sparkSession-read-json-must-be-a-valid-json-object-per-line-tp27907.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
