I'm not sure if Spark 1.6 is still maintained, can you try a 2.x spark
version and see if the problem still exists?
On Sun, Sep 30, 2018 at 4:14 PM 白也诗无敌 <445484...@qq.com> wrote:
> Besides I have tried ANALYZE statement. It has no use cause I need the
> single partition but get the total table s
Besides I have tried ANALYZE statement. It has no use cause I need the single
partition but get the total table size by hive parameter 'totalSize' or
'rawSize' and so on
Hi, guys:
I'm using Spark1.6.2.
There are two tables and the small one is a partitioned parquet table;
T
Hi, guys:
I'm using Spark1.6.2.
There are two tables and the small one is a partitioned parquet table;
The total size of the small table is 1000M but each partition only 1M;
When I set spark.sql.autoBroadcastJoinThreshold to 50m and join the two
tables with single partition, I
