Re: pyspark: sqlContext.read.text() does not work with a list of paths

2016-10-06 Thread Laurent Legrand
Hello, I've just created the issue: https://issues.apache.org/jira/browse/SPARK-17805 For the PR, I can work on it tomorrow. Laurent Le 06/10/2016 à 09:29, Hyukjin Kwon a écrit : It seems obviously a bug. It was introduced from my PR, https://github.com/apache/spark/commit/d37c7f7f042f79

Re: pyspark: sqlContext.read.text() does not work with a list of paths

2016-10-06 Thread Hyukjin Kwon
It seems obviously a bug. It was introduced from my PR, https://github.com/apache/spark/commit/d37c7f7f042f7943b5b684e53cf4284c601fb347 +1 for creating a JIRA and PR. If you have any problem with this, I would like to do this quickly. On 5 Oct 2016 9:12 p.m., "Laurent Legrand" wrote: > Hello,

pyspark: sqlContext.read.text() does not work with a list of paths

2016-10-05 Thread Laurent Legrand
Hello, When I try to load multiple text files with the sqlContext, I get the following error: spark-2.0.0-bin-hadoop2.4/python/lib/pyspark.zip/pyspark/sql/readwriter.py", line 282, in text UnboundLocalError: local variable 'path' referenced before assignment According to the code (https://github