i use multi level wildcard with hadoop fs -ls, which is the exact same glob function call
On Wed, Mar 9, 2016 at 9:24 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Hadoop glob pattern doesn't support multi level wildcard. > > Thanks > > On Mar 9, 2016, at 6:15 AM, Koert Kuipers <ko...@tresata.com> wrote: > > if its based on HadoopFsRelation shouldn't it support it? HadoopFsRelation > handles globs > > On Wed, Mar 9, 2016 at 8:56 AM, Ted Yu <yuzhih...@gmail.com> wrote: > >> This is currently not supported. >> >> On Mar 9, 2016, at 4:38 AM, Jakub Liska <liska.ja...@gmail.com> wrote: >> >> Hey, >> >> is something like this possible? >> >> sqlContext.read.json("/mnt/views-p/base/2016/01/*/*-xyz.json") >> >> I switched to DataFrames because my source files changed from TSV to JSON >> but now I'm not able to load the files as I did before. I get this error >> if I try that : >> >> https://github.com/apache/spark/pull/9142#issuecomment-194248531 >> >> >