I think the problem is that comma is actually a legitimate character for file name, and as a result ...
On Tuesday, October 6, 2015, Josh Rosen <[email protected]> wrote: > Could someone please file a JIRA to track this? > https://issues.apache.org/jira/browse/SPARK > > On Tue, Oct 6, 2015 at 1:21 AM, Koert Kuipers <[email protected] > <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> i ran into the same thing in scala api. we depend heavily on comma >> separated paths, and it no longer works. >> >> >> On Tue, Oct 6, 2015 at 3:02 AM, Blaž Šnuderl <[email protected] >> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: >> >>> Hello everyone. >>> >>> It seems pyspark dataframe read is broken for reading multiple files. >>> >>> sql.read.json( "file1,file2") fails with java.io.IOException: No input >>> paths specified in job. >>> >>> This used to work in spark 1.4 and also still work with sc.textFile >>> >>> Blaž >>> >> >> >
