Hi, What's the schema in the parquets? Also, could you show us the stack trace when the error happens?
// maropu On Mon, Jul 11, 2016 at 11:42 AM, Javier Rey <[email protected]> wrote: > Hi everybody, > > I installed Spark 1.6.1, I have two parquet files, but when I need show > registers using unionAll, Spark crash I don't understand what happens. > > But when I use show() only one parquet file this is work correctly. > > code with fault: > > path = '/data/train_parquet/' > train_df = sqlContext.read.parquet(path) > train_df.take(1) > > code works: > > path = '/data/train_parquet/0_0_0.parquet' > train0_df = sqlContext.read.load(path) > train_df.take(1) > > Thanks in advance. > > Samir > -- --- Takeshi Yamamuro
