Re: Move files read by flink

FileSystem class provides by Flink. https://ci.apache.org/projects/flink/flink-docs-master/api/java/ > On 10. Mar 2018, at 00:44, flinkuser101 wrote: > > Is there any way to do that? I have been searching for way to do that but in > vain. > > > > -- > Sent from: > http://apache-flink-user-m

Re: Move files read by flink

Where does Flink expose filesystem? Is it from env? or inputstream? TextInputFormat format = new TextInputFormat(new org.apache.flink.core.fs.Path(url.toString())); DataStream inputStream = env.readFile(format,url.toString(),FileProcessingMode.PROCESS_CONTINUOUSLY, 1); DataStream parsedStream =

Re: Move files read by flink

Path has a method getFileSystem > On 10. Mar 2018, at 10:36, flinkuser101 wrote: > > Where does Flink expose filesystem? Is it from env? or inputstream? > > TextInputFormat format = new TextInputFormat(new > org.apache.flink.core.fs.Path(url.toString())); > DataStream inputStream = > env.readFi

Re: Move files read by flink

Alternatively static method FileSystem.get > On 10. Mar 2018, at 10:36, flinkuser101 wrote: > > Where does Flink expose filesystem? Is it from env? or inputstream? > > TextInputFormat format = new TextInputFormat(new > org.apache.flink.core.fs.Path(url.toString())); > DataStream inputStream = >

Re: Move files read by flink

>From path flink thread it seems like there is thread showing this. But just wonder is this resolved?Where to find if final split is complete

Re: [DISCUSS] Inverted (child-first) class loading

This is an interesting question and it usually has consequences that are far-reaching in user experience. If a Flink app is supposed to be a "standalone app" that any Flink installation should be able to run, then the child-first classloading makes sense. This is how we build many of the Java appl