On Fri, Feb 5, 2016 at 12:58 PM, Gerard Maas wrote:
> Hi,
>
> We're facing a situation where simple queries to parquet files stored in
> Swift through a Hive Metastore sometimes fail with this exception:
>
> org.apache.spark.SparkException: Job aborted due to stage failure: Task 6
> in stage 58.0
1. How to read the JSON file
> 2. How to parse the JSON file
>
> Please share any example program based on Scala
>
> Regards,
> Rajesh
>
>
>
--
Peter Vandenabeele
http://www.allthingsdata.io
http://www.linkedin.com/in/petervandenabeele
https://twitter.com/peter_v
gsm: +32-478-27.40.69
e-mail: pe...@vandenabeele.com
skype: peter_v_be
On Sun, Nov 30, 2014 at 1:10 PM, Peter Vandenabeele
wrote:
> On spark 1.1.0 in Standalone mode, I am following
>
>
> https://spark.apache.org/docs/1.1.0/sql-programming-guide.html#json-datasets
>
> to try to load a simple test JSON file (on my local filesystem, not in
>
askSetManager: Finished task 0.0 in stage
6.0 (TID 12) in 8 ms on localhost (2/2)
14/11/30 12:48:20 INFO scheduler.DAGScheduler: Stage 6 (count at
:19) finished in 0.009 s
14/11/30 12:48:20 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 6.0,
whose tasks have all completed, from pool
14/11/30 12:48:20 INFO spark.SparkContext: Job finished: count at
:19, took 0.012281729 s
res9: Long = 13
--
Peter Vandenabeele
http://www.allthingsdata.io
