spark git commit: [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 1d5c7f452 -> 2b18bd4b9 [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics This patch reduces the default number element estimation for arrays and maps from 100 to 1. The issue with the 100 number is

spark git commit: [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 af12a21ca -> e8866f9fc [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics ## What changes were proposed in this pull request? This patch reduces the default number element estimation for arrays and ma

spark git commit: [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 89ae26dcd -> 5d7994736 [SPARK-18853][SQL] Project (UnaryNode) is way too aggressive in estimating statistics ## What changes were proposed in this pull request? This patch reduces the default number element estimation for arrays and maps