[jira] (FLINK-5690) protobuf is not shaded properly

2017-01-31 Thread Andrey (JIRA)
Title: Message Title Andrey created an issue

[jira] (FLINK-5685) Connection leak in Taskmanager

2017-01-31 Thread Andrey (JIRA)
Title: Message Title Andrey commented on FLINK-5685

[jira] (FLINK-5685) Connection leak in Taskmanager

2017-01-31 Thread Andrey (JIRA)
Title: Message Title Andrey edited a comment on FLINK-5685

[jira] (FLINK-5690) protobuf is not shaded properly

2017-01-31 Thread Andrey (JIRA)
Title: Message Title Andrey commented on FLINK-5690

[jira] (FLINK-5690) protobuf is not shaded properly

2017-01-31 Thread Andrey (JIRA)
Title: Message Title Andrey commented on FLINK-5690

[jira] [Commented] (FLINK-5690) protobuf is not shaded properly

2017-02-07 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855933#comment-15855933 ] Andrey commented on FLINK-5690: --- Not blocking actually. We were able to shade our own jars > protobuf is

[jira] [Commented] (FLINK-5690) protobuf is not shaded properly

2017-02-07 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856009#comment-15856009 ] Andrey commented on FLINK-5690: --- Your project contains dependency on protobuf 2.5.0 which means protobuf was

[jira] (FLINK-5685) Connection leak in Taskmanager

2017-01-30 Thread Andrey (JIRA)
Title: Message Title Andrey created an issue

[jira] [Commented] (FLINK-3704) JobManagerHAProcessFailureBatchRecoveryITCase.testJobManagerProcessFailure unstable

2017-02-09 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859242#comment-15859242 ] Andrey commented on FLINK-3704: --- Could this issue be reproduced by killing job manager (kill -9) in HA mode?

[jira] [Created] (FLINK-5787) Unable to run jobs uploaded from IE

2017-02-13 Thread Andrey (JIRA)
Andrey created FLINK-5787: - Summary: Unable to run jobs uploaded from IE Key: FLINK-5787 URL: https://issues.apache.org/jira/browse/FLINK-5787 Project: Flink Issue Type: Bug Affects Versions:

[jira] [Commented] (FLINK-5690) protobuf is not shaded properly

2017-02-13 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863399#comment-15863399 ] Andrey commented on FLINK-5690: --- Hi Robert, I'm okay. However I would handle several things before closing:

[jira] [Updated] (FLINK-5757) Initial JobManager address required during access from cli to HA cluster

2017-02-09 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-5757: -- Component/s: Client > Initial JobManager address required during access from cli to HA cluster >

[jira] [Updated] (FLINK-5761) ClassNotFoundException during cancel job

2017-02-09 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-5761: -- Affects Version/s: 1.1.4 > ClassNotFoundException during cancel job >

[jira] [Created] (FLINK-5761) ClassNotFoundException during cancel job

2017-02-09 Thread Andrey (JIRA)
Andrey created FLINK-5761: - Summary: ClassNotFoundException during cancel job Key: FLINK-5761 URL: https://issues.apache.org/jira/browse/FLINK-5761 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-5757) Initial JobManager address required during access from cli to HA cluster

2017-02-09 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-5757: -- Affects Version/s: 1.1.4 > Initial JobManager address required during access from cli to HA cluster >

[jira] [Created] (FLINK-5757) Initial JobManager address required during access from cli to HA cluster

2017-02-09 Thread Andrey (JIRA)
Andrey created FLINK-5757: - Summary: Initial JobManager address required during access from cli to HA cluster Key: FLINK-5757 URL: https://issues.apache.org/jira/browse/FLINK-5757 Project: Flink

[jira] [Created] (FLINK-5551) NPE at SourceStreamTask

2017-01-18 Thread Andrey (JIRA)
Andrey created FLINK-5551: - Summary: NPE at SourceStreamTask Key: FLINK-5551 URL: https://issues.apache.org/jira/browse/FLINK-5551 Project: Flink Issue Type: Bug Components: DataStream API

[jira] [Updated] (FLINK-5551) NPE at SourceStreamTask

2017-01-18 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-5551: -- Description: Prerequisites: * Configure hdfs-based backend for the job * cancel it using webapp admin In

[jira] [Created] (FLINK-5449) Time drift in MetricRegistry

2017-01-11 Thread Andrey (JIRA)
Andrey created FLINK-5449: - Summary: Time drift in MetricRegistry Key: FLINK-5449 URL: https://issues.apache.org/jira/browse/FLINK-5449 Project: Flink Issue Type: Bug Components: Metrics

[jira] [Commented] (FLINK-5449) Time drift in MetricRegistry

2017-01-11 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818929#comment-15818929 ] Andrey commented on FLINK-5449: --- Sorry, but I still don't understand how deploy/cleanup relates to the task

[jira] [Commented] (FLINK-5449) Time drift in MetricRegistry

2017-01-11 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818786#comment-15818786 ] Andrey commented on FLINK-5449: --- Sorry, could you please clarify what "reporting actions" means? this method

[jira] [Updated] (FLINK-6083) [TaskManager] Support readiness/liveness probes

2017-03-16 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-6083: -- Description: Currently there is no way to tell if TaskManager is operating or not. Operating means "its

[jira] [Updated] (FLINK-6083) [TaskManager] Support readiness/liveness probes

2017-03-16 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-6083: -- Description: Currently there is no way to tell if TaskManager is operating or not. Operating means "its

[jira] [Created] (FLINK-6083) [TaskManager] Support readiness/liveness probes

2017-03-16 Thread Andrey (JIRA)
Andrey created FLINK-6083: - Summary: [TaskManager] Support readiness/liveness probes Key: FLINK-6083 URL: https://issues.apache.org/jira/browse/FLINK-6083 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-4973) Flakey Yarn tests due to recently added latency marker

2017-04-12 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965884#comment-15965884 ] Andrey commented on FLINK-4973: --- Was able to reproduce in 1.2.0. It looks like components shutdown in

[jira] [Created] (FLINK-6278) After "FATAL" message in logs taskmanager still working

2017-04-07 Thread Andrey (JIRA)
Andrey created FLINK-6278: - Summary: After "FATAL" message in logs taskmanager still working Key: FLINK-6278 URL: https://issues.apache.org/jira/browse/FLINK-6278 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6277) RuntimeException in logs during normal shutdown

2017-04-07 Thread Andrey (JIRA)
Andrey created FLINK-6277: - Summary: RuntimeException in logs during normal shutdown Key: FLINK-6277 URL: https://issues.apache.org/jira/browse/FLINK-6277 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-6278) After "FATAL" message in logs taskmanager still working

2017-04-07 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-6278: -- Attachment: threaddump.txt > After "FATAL" message in logs taskmanager still working >

[jira] [Created] (FLINK-6294) BucketingSink throws NPE while cancelling job

2017-04-11 Thread Andrey (JIRA)
Andrey created FLINK-6294: - Summary: BucketingSink throws NPE while cancelling job Key: FLINK-6294 URL: https://issues.apache.org/jira/browse/FLINK-6294 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-6083) [TaskManager] Support readiness/liveness probes

2017-04-21 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978521#comment-15978521 ] Andrey commented on FLINK-6083: --- Currently we were able to create workaround by implementing

[jira] [Commented] (FLINK-4973) Flakey Yarn tests due to recently added latency marker

2017-04-21 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978513#comment-15978513 ] Andrey commented on FLINK-4973: --- Actually we were able to reproduce this stacktrace in the running Flink

[jira] [Commented] (FLINK-4973) Flakey Yarn tests due to recently added latency marker

2017-04-18 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972750#comment-15972750 ] Andrey commented on FLINK-4973: --- Proper handling InterruptedException will make it possible to clean and

[jira] [Commented] (FLINK-6294) BucketingSink throws NPE while cancelling job

2017-04-18 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972752#comment-15972752 ] Andrey commented on FLINK-6294: --- I have the same version. Maybe this issue happens when BuckingSink is not

[jira] [Commented] (FLINK-4973) Flakey Yarn tests due to recently added latency marker

2017-04-24 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981426#comment-15981426 ] Andrey commented on FLINK-4973: --- This was happen during the job cancellation. However it was controlled job

[jira] [Commented] (FLINK-4973) Flakey Yarn tests due to recently added latency marker

2017-04-26 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984659#comment-15984659 ] Andrey commented on FLINK-4973: --- Here is more logs. Job was executed for some time and then was cancelled

[jira] [Created] (FLINK-6370) FileAlreadyExistsException on startup

2017-04-24 Thread Andrey (JIRA)
Andrey created FLINK-6370: - Summary: FileAlreadyExistsException on startup Key: FLINK-6370 URL: https://issues.apache.org/jira/browse/FLINK-6370 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-6412) Stream has already been closed durign job cancel

2017-04-28 Thread Andrey (JIRA)
Andrey created FLINK-6412: - Summary: Stream has already been closed durign job cancel Key: FLINK-6412 URL: https://issues.apache.org/jira/browse/FLINK-6412 Project: Flink Issue Type: Bug Affects

[jira] [Commented] (FLINK-6541) Jar upload directory not created

2017-05-12 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007905#comment-16007905 ] Andrey commented on FLINK-6541: --- Hi! Sure, I would love to provide pull request. However due to the legal

[jira] [Created] (FLINK-6541) Jar upload directory not created

2017-05-11 Thread Andrey (JIRA)
Andrey created FLINK-6541: - Summary: Jar upload directory not created Key: FLINK-6541 URL: https://issues.apache.org/jira/browse/FLINK-6541 Project: Flink Issue Type: Bug Affects Versions: 1.2.0

[jira] [Commented] (FLINK-6613) OOM during reading big messages from Kafka

2017-05-17 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014307#comment-16014307 ] Andrey commented on FLINK-6613: --- -Xmx2g and ParallelGC. Default for openjdk. > OOM during reading big

[jira] [Commented] (FLINK-6613) OOM during reading big messages from Kafka

2017-05-17 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014647#comment-16014647 ] Andrey commented on FLINK-6613: --- Hi Dmytro. There are several problems still exist: 1) I want to fail fast

[jira] [Created] (FLINK-6613) OOM during reading big messages from Kafka

2017-05-17 Thread Andrey (JIRA)
Andrey created FLINK-6613: - Summary: OOM during reading big messages from Kafka Key: FLINK-6613 URL: https://issues.apache.org/jira/browse/FLINK-6613 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-6615) tmp directory not cleaned up on shutdown

2017-05-17 Thread Andrey (JIRA)
Andrey created FLINK-6615: - Summary: tmp directory not cleaned up on shutdown Key: FLINK-6615 URL: https://issues.apache.org/jira/browse/FLINK-6615 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-6592) RawLocalFileSystem created even if fs.hdfs.hadoopconf specified

2017-05-15 Thread Andrey (JIRA)
Andrey created FLINK-6592: - Summary: RawLocalFileSystem created even if fs.hdfs.hadoopconf specified Key: FLINK-6592 URL: https://issues.apache.org/jira/browse/FLINK-6592 Project: Flink Issue Type:

[jira] [Closed] (FLINK-6592) RawLocalFileSystem created even if fs.hdfs.hadoopconf specified

2017-05-16 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey closed FLINK-6592. - Resolution: Invalid Looks like by default new org.apache.hadoop.conf.Configuration loads defaultFS. When

[jira] [Created] (FLINK-6627) Expose tmp directories via API

2017-05-18 Thread Andrey (JIRA)
Andrey created FLINK-6627: - Summary: Expose tmp directories via API Key: FLINK-6627 URL: https://issues.apache.org/jira/browse/FLINK-6627 Project: Flink Issue Type: Improvement Affects Versions:

[jira] [Commented] (FLINK-6613) OOM during reading big messages from Kafka

2017-05-18 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015715#comment-16015715 ] Andrey commented on FLINK-6613: --- Hi Dmytro, The problem is that Flink creates too much objects :) When I

[jira] [Commented] (FLINK-5685) Connection leak in Taskmanager

2017-05-19 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017318#comment-16017318 ] Andrey commented on FLINK-5685: --- {code} #: ulimit -n 1024 {code} This issue caused by

[jira] [Created] (FLINK-6647) Fail-fast on invalid RocksDBStateBackend configuration

2017-05-19 Thread Andrey (JIRA)
Andrey created FLINK-6647: - Summary: Fail-fast on invalid RocksDBStateBackend configuration Key: FLINK-6647 URL: https://issues.apache.org/jira/browse/FLINK-6647 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-6627) Expose tmp directories via API

2017-05-18 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016346#comment-16016346 ] Andrey commented on FLINK-6627: --- That's the problem. How cleanup script will know if "container" dir is used

[jira] [Commented] (FLINK-6613) OOM during reading big messages from Kafka

2017-05-24 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022593#comment-16022593 ] Andrey commented on FLINK-6613: --- Hey! Looks like "fetch.max.bytes" option is what we need. I will try it.

[jira] [Created] (FLINK-6464) Metric name is not stable

2017-05-05 Thread Andrey (JIRA)
Andrey created FLINK-6464: - Summary: Metric name is not stable Key: FLINK-6464 URL: https://issues.apache.org/jira/browse/FLINK-6464 Project: Flink Issue Type: Bug Affects Versions: 1.2.0

[jira] [Commented] (FLINK-5787) Unable to run jobs uploaded from IE

2017-05-08 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000683#comment-16000683 ] Andrey commented on FLINK-5787: --- [~StephanEwen] it looks like i can't contribute due to legal issues. Sorry

[jira] [Commented] (FLINK-5787) Unable to run jobs uploaded from IE

2017-05-04 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996795#comment-15996795 ] Andrey commented on FLINK-5787: --- Yes, sure. Will have a look this or next week. > Unable to run jobs

[jira] [Resolved] (FLINK-6613) OOM during reading big messages from Kafka

2017-06-01 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey resolved FLINK-6613. --- Resolution: Not A Bug I was able to setup "fetch.max.bytes" property and limit number of incoming message.

[jira] [Updated] (FLINK-5787) Unable to run jobs uploaded from IE

2017-09-22 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey updated FLINK-5787: -- Affects Version/s: 1.3.2 > Unable to run jobs uploaded from IE > --- > >

[jira] [Created] (FLINK-7682) Invalid state size formatting

2017-09-25 Thread Andrey (JIRA)
Andrey created FLINK-7682: - Summary: Invalid state size formatting Key: FLINK-7682 URL: https://issues.apache.org/jira/browse/FLINK-7682 Project: Flink Issue Type: Bug Affects Versions: 1.3.0

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-11-22 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262584#comment-16262584 ] Andrey commented on FLINK-5465: --- We were able to reproduce this issue on Flink 1.3.2. This is very critical

[jira] [Comment Edited] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-11-22 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262584#comment-16262584 ] Andrey edited comment on FLINK-5465 at 11/22/17 2:19 PM: - We were able to

[jira] [Commented] (FLINK-6615) tmp directory not cleaned up on shutdown

2017-10-30 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224757#comment-16224757 ] Andrey commented on FLINK-6615: --- I would object, as this: * generates false alerts in our monitoring. * may

[jira] [Commented] (FLINK-5761) ClassNotFoundException during cancel job

2018-02-19 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368917#comment-16368917 ] Andrey commented on FLINK-5761: --- Hi! Haven't seen it for a while. Let's close it. Will re-open if reproduce