git commit: [SPARK-3594] [PySpark] [SQL] take more rows to infer schema or sampling

2014-11-03 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2b6e1ce6e -> 24544fbce [SPARK-3594] [PySpark] [SQL] take more rows to infer schema or sampling This patch will try to infer schema for RDD which has empty value (None, [], {}) in the first row. It will try first 100 rows and merge the type

git commit: [SPARK-3594] [PySpark] [SQL] take more rows to infer schema or sampling

2014-11-03 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.2 292da4ef2 -> cc5dc4247 [SPARK-3594] [PySpark] [SQL] take more rows to infer schema or sampling This patch will try to infer schema for RDD which has empty value (None, [], {}) in the first row. It will try first 100 rows and merge the