Hi everybody,

I installed Spark 1.6.1, I have two parquet files, but when I need show
registers using unionAll, Spark crash I don't understand what happens.

But when I use show() only one parquet file this is work correctly.

code with fault:

path = '/data/train_parquet/'
train_df = sqlContext.read.parquet(path)
train_df.take(1)

code works:

path = '/data/train_parquet/0_0_0.parquet'
train0_df = sqlContext.read.load(path)
train_df.take(1)

Thanks in advance.

Samir

Reply via email to