> > My question is that is "NOSCAN" option a must? If I execute "ANALYZE TABLE > <tablename> compute statistics" command in Hive shell, is the statistics > going to be used by SparkSQL to decide broadcast join?
Yes, spark SQL will only accept the simple no scan version. However, as long as the sizeInBytes statistic is present, we will use it.
