Re: DFS problem with removing checkpoint

2018-05-16 Thread Szymon Szczypiński
aybe someone can of users know where pool is created. Best regards On 22.04.2018 17:22, Szymon Szczypiński wrote: HI, the problem was started on 1.3.1. Now I upgraded to Flink 1.3.3. I changed my cluster to 1.3.3  because of jira https://issues.apache.org/jira/browse/FLINK-8807. I will c

Re: DFS problem with removing checkpoint

2018-04-22 Thread Szymon Szczypiński
parent directory. In Flink 1.5, it is the disposal call of the CheckpointStorageLocation. Best, Stephan On Sat, Apr 7, 2018 at 1:11 AM, Szymon Szczypiński <simo...@poczta.fm <mailto:simo...@poczta.fm>> wrote: Hi, in my case both doesn't deleted. In high-availability.

FlinkML

2018-04-16 Thread Szymon Szczypiński
Hi, i wonder if there are possibility to build FlinkML streaming job not a batch job. Examples on https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/libs/ml/ are only batch examples. Is there any possibility? Best regards.

Re: DFS problem with removing checkpoint

2018-04-06 Thread Szymon Szczypiński
directories in S3) are not deleted. This is fixed in Flink 1.5. A workaround for Flink 1.4 is to use the "flink-s3-fs-presto", which does not uses these marker files. On Thu, Mar 29, 2018 at 8:49 PM, Szymon Szczypiński <simo...@poczta.fm <mailto:simo...@poczta.fm>> wrote

Re: Plain text SSL passwords in Log file

2018-03-29 Thread Szymon Szczypiński
to separate file not to global log file. I thin that you also set to log to /dev/null. But in my opinion it is enough to log to separate file that is not send to another machine because in that case password is still visible in configuration file. Regards Szymon Szczypiński On 29.03.2018 16:29

DFS problem with removing checkpoint

2018-03-28 Thread Szymon Szczypiński
rk without deleting dirs from DFS. I don't want to delete dirs from DFS because than  i need to redeploy all jobs. Best regards Szymon Szczypiński