[jira] [Created] (FLINK-7774) Deserializers are not cleaned up when closing input streams

2017-10-06 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7774: -- Summary: Deserializers are not cleaned up when closing input streams Key: FLINK-7774 URL: https://issues.apache.org/jira/browse/FLINK-7774 Project: Flink Issue

[jira] [Updated] (FLINK-7773) Test instability in UtilsTest#testYarnFlinkResourceManagerJobManagerLostLeadership

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7773: --- Labels: test-stability (was: ) > Test instability in >

[jira] [Created] (FLINK-7773) Test instability in UtilsTest#testYarnFlinkResourceManagerJobManagerLostLeadership

2017-10-06 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7773: -- Summary: Test instability in UtilsTest#testYarnFlinkResourceManagerJobManagerLostLeadership Key: FLINK-7773 URL: https://issues.apache.org/jira/browse/FLINK-7773

[jira] [Updated] (FLINK-7772) Test instability in BlobCacheDeleteTest

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7772: --- Priority: Critical (was: Major) > Test instability in BlobCacheDeleteTest >

[jira] [Updated] (FLINK-7772) Test instability in BlobCacheDeleteTest

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7772: --- Labels: test-stability (was: ) > Test instability in BlobCacheDeleteTest >

[jira] [Created] (FLINK-7772) Test instability in BlobCacheDeleteTest

2017-10-06 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7772: -- Summary: Test instability in BlobCacheDeleteTest Key: FLINK-7772 URL: https://issues.apache.org/jira/browse/FLINK-7772 Project: Flink Issue Type: Bug

[jira] [Resolved] (FLINK-7261) avoid unnecessary exceptions in the logs in non-HA cases

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-7261. Resolution: Fixed Fix Version/s: 1.4.0 > avoid unnecessary exceptions in the logs in non-HA

[jira] [Closed] (FLINK-6380) BlobService concurrency issues between delete and put/get methods

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-6380. -- Resolution: Fixed Fix Version/s: 1.4.0 This should be fixed by FLINK-7068. Please re-open if it

[jira] [Closed] (FLINK-5908) Blob Cache can (rarely) get corrupted on failed blob downloads

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-5908. -- Resolution: Fixed Assignee: Nico Kruber Fix Version/s: 1.4.0 This should be fixed by

[jira] [Resolved] (FLINK-7068) change BlobService sub-classes for permanent and transient BLOBs

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-7068. Resolution: Fixed Fix Version/s: 1.4.0 > change BlobService sub-classes for permanent and

[jira] [Resolved] (FLINK-7483) BlobCache cleanup timer not reset after job re-registration

2017-10-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-7483. Resolution: Fixed Fix Version/s: 1.4.0 > BlobCache cleanup timer not reset after job

[jira] [Updated] (FLINK-7748) remove event listener behaviour from ResultPartitionWriter

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7748: --- Description: {{ResultPartitionWriter}} currently implements the {{EventListener}} interface and is

[jira] [Updated] (FLINK-7746) move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7746: --- Description: As a step towards removing the (unneeded) {{ResultPartitionWriter}} wrapper, we should

[jira] [Updated] (FLINK-7749) remove the ResultPartitionWriter

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7749: --- Summary: remove the ResultPartitionWriter (was: remove ResultPartitionWriter) > remove the

[jira] [Updated] (FLINK-7747) remove the ResultPartitionWriter wrapper

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7747: --- Summary: remove the ResultPartitionWriter wrapper (was: remove ResultPartitionWriter wrapper) >

[jira] [Updated] (FLINK-7749) remove ResultPartitionWriter

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7749: --- Description: After changing task event notification to the {{TaskEventDispatcher}} (FLINK-7746) and

[jira] [Created] (FLINK-7749) remove ResultPartitionWriter

2017-10-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7749: -- Summary: remove ResultPartitionWriter Key: FLINK-7749 URL: https://issues.apache.org/jira/browse/FLINK-7749 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7748) remove event listener behaviour from ResultPartitionWriter

2017-10-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7748: -- Summary: remove event listener behaviour from ResultPartitionWriter Key: FLINK-7748 URL: https://issues.apache.org/jira/browse/FLINK-7748 Project: Flink Issue

[jira] [Updated] (FLINK-7747) remove ResultPartitionWriter wrapper

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7747: --- Description: The {{ResultPartitionWriter}} is a simple wrapper around the {{ResultPartition}} that is

[jira] [Updated] (FLINK-7746) move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7746: --- Description: As a step towards removing the (unneeded) {{ResultPartitionWriter}} wrapper, we should

[jira] [Updated] (FLINK-7747) remove ResultPartitionWriter wrapper

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7747: --- Summary: remove ResultPartitionWriter wrapper (was: remove RecordWriter wrapper) > remove

[jira] [Updated] (FLINK-7746) move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7746: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7747 > move

[jira] [Created] (FLINK-7747) remove RecordWriter wrapper

2017-10-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7747: -- Summary: remove RecordWriter wrapper Key: FLINK-7747 URL: https://issues.apache.org/jira/browse/FLINK-7747 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-7746) move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition

2017-10-02 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7746: --- Issue Type: Improvement (was: Sub-task) Parent: (was: FLINK-7612) > move

[jira] [Created] (FLINK-7746) move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition

2017-10-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7746: -- Summary: move ResultPartitionWriter#writeBufferToAllChannels up into ResultPartition Key: FLINK-7746 URL: https://issues.apache.org/jira/browse/FLINK-7746 Project: Flink

[jira] [Created] (FLINK-7745) add tests for ensuring NetworkBufferPool overprovisioning behaviour

2017-10-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7745: -- Summary: add tests for ensuring NetworkBufferPool overprovisioning behaviour Key: FLINK-7745 URL: https://issues.apache.org/jira/browse/FLINK-7745 Project: Flink

[jira] [Created] (FLINK-7734) test instability in ResourceManagerTest

2017-09-28 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7734: -- Summary: test instability in ResourceManagerTest Key: FLINK-7734 URL: https://issues.apache.org/jira/browse/FLINK-7734 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-7734) test instability in ResourceManagerTest

2017-09-28 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7734: --- Labels: test-stability (was: ) > test instability in ResourceManagerTest >

[jira] [Updated] (FLINK-7733) test instability in Kafa end-to-end test (RetriableCommitFailedException)

2017-09-28 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7733: --- Priority: Critical (was: Major) > test instability in Kafa end-to-end test

[jira] [Updated] (FLINK-7732) test instability in Kafa end-to-end test (invalid Kafka offset)

2017-09-28 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7732: --- Labels: test-stability (was: ) > test instability in Kafa end-to-end test (invalid Kafka offset) >

[jira] [Created] (FLINK-7733) test instability in Kafa end-to-end test (RetriableCommitFailedException)

2017-09-28 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7733: -- Summary: test instability in Kafa end-to-end test (RetriableCommitFailedException) Key: FLINK-7733 URL: https://issues.apache.org/jira/browse/FLINK-7733 Project: Flink

[jira] [Updated] (FLINK-7733) test instability in Kafa end-to-end test (RetriableCommitFailedException)

2017-09-28 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7733: --- Labels: test-stability (was: ) > test instability in Kafa end-to-end test

[jira] [Created] (FLINK-7732) test instability in Kafa end-to-end test (invalid Kafka offset)

2017-09-28 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7732: -- Summary: test instability in Kafa end-to-end test (invalid Kafka offset) Key: FLINK-7732 URL: https://issues.apache.org/jira/browse/FLINK-7732 Project: Flink

[jira] [Updated] (FLINK-7699) Define the BufferListener interface to replace EventListener in BufferProvider

2017-09-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7699: --- Summary: Define the BufferListener interface to replace EventListener in BufferProvider (was: Define

[jira] [Created] (FLINK-7701) IllegalArgumentException in Netty bootstrap with small memory state segment size

2017-09-27 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7701: -- Summary: IllegalArgumentException in Netty bootstrap with small memory state segment size Key: FLINK-7701 URL: https://issues.apache.org/jira/browse/FLINK-7701 Project:

[jira] [Created] (FLINK-7612) Implement Event-driven Network IO

2017-09-12 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7612: -- Summary: Implement Event-driven Network IO Key: FLINK-7612 URL: https://issues.apache.org/jira/browse/FLINK-7612 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-7598) ineffective shaded artifacts checks in travis_mvn_watchdog.sh

2017-09-07 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7598: --- Description: The {{check_shaded_artifacts()}} checks have some shortcomings which render them

[jira] [Created] (FLINK-7598) ineffective shaded artifacts checks in travis_mvn_watchdog.sh

2017-09-07 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7598: -- Summary: ineffective shaded artifacts checks in travis_mvn_watchdog.sh Key: FLINK-7598 URL: https://issues.apache.org/jira/browse/FLINK-7598 Project: Flink

[jira] [Commented] (FLINK-7512) avoid unnecessary buffer copies during network serialization

2017-08-28 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143520#comment-16143520 ] Nico Kruber commented on FLINK-7512: Hi [~phoenixjiangnan], no, the error you are seeing is not

[jira] [Updated] (FLINK-7523) test instability in LocalStreamEnvironmentITCase#testRunIsolatedJob

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7523: --- Labels: flip-6 test-stability (was: ) > test instability in

[jira] [Created] (FLINK-7523) test instability in LocalStreamEnvironmentITCase#testRunIsolatedJob

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7523: -- Summary: test instability in LocalStreamEnvironmentITCase#testRunIsolatedJob Key: FLINK-7523 URL: https://issues.apache.org/jira/browse/FLINK-7523 Project: Flink

[jira] [Updated] (FLINK-7516) HybridMemorySegment: do not allow copies into a read-only ByteBuffer

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7516: --- Description: {{HybridMemorySegment#get(int, ByteBuffer, int)}} allows writing into a read-only

[jira] [Updated] (FLINK-7516) HybridMemorySegment: do not allow copies into a read-only ByteBuffer

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7516: --- Summary: HybridMemorySegment: do not allow copies into a read-only ByteBuffer (was: MemorySegment:

[jira] [Closed] (FLINK-7512) avoid unnecessary buffer copies during network serialization

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-7512. -- Resolution: Duplicate > avoid unnecessary buffer copies during network serialization >

[jira] [Updated] (FLINK-7520) let our Buffer class extend from netty's buffer class

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7520: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > let our Buffer class extend from

[jira] [Updated] (FLINK-7518) pass our own buffer instances to netty

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7518: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > pass our own buffer instances to netty

[jira] [Updated] (FLINK-7518) pass our own buffer instances to netty

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7518: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > pass our own buffer

[jira] [Updated] (FLINK-7517) let NettyBufferPool extend PooledByteBufAllocator

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7517: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > let NettyBufferPool extend

[jira] [Updated] (FLINK-7517) let NettyBufferPool extend PooledByteBufAllocator

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7517: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > let NettyBufferPool extend

[jira] [Updated] (FLINK-7520) let our Buffer class extend from netty's buffer class

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7520: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > let our Buffer class extend

[jira] [Updated] (FLINK-7516) MemorySegment: do not allow copies into a read-only ByteBuffer

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7516: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > MemorySegment: do not allow copies into

[jira] [Updated] (FLINK-7515) allow actual 0-length content in NettyMessage#allocateBuffer()

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7515: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > allow actual 0-length content in

[jira] [Updated] (FLINK-7515) allow actual 0-length content in NettyMessage#allocateBuffer()

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7515: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > allow actual 0-length

[jira] [Updated] (FLINK-7516) MemorySegment: do not allow copies into a read-only ByteBuffer

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7516: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > MemorySegment: do not allow

[jira] [Updated] (FLINK-7513) remove TestBufferFactory#MOCK_BUFFER

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7513: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > remove

[jira] [Updated] (FLINK-7513) remove TestBufferFactory#MOCK_BUFFER

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7513: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > remove TestBufferFactory#MOCK_BUFFER >

[jira] [Updated] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7499: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > double buffer release in

[jira] [Updated] (FLINK-7514) fix BackPressureStatsTrackerITCase releasing buffers twice

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7514: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > fix

[jira] [Updated] (FLINK-7428) avoid one additional buffer copy when receiving messages

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7428: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > avoid one additional buffer copy when

[jira] [Updated] (FLINK-7514) fix BackPressureStatsTrackerITCase releasing buffers twice

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7514: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > fix BackPressureStatsTrackerITCase

[jira] [Updated] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7499: --- Priority: Blocker (was: Major) > double buffer release in SpillableSubpartitionView >

[jira] [Updated] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7499: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > double buffer release in

[jira] [Updated] (FLINK-7427) integrate PartitionRequestProtocol into NettyProtocol

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7427: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > integrate

[jira] [Updated] (FLINK-7428) avoid one additional buffer copy when receiving messages

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7428: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > avoid one additional buffer

[jira] [Updated] (FLINK-7427) integrate PartitionRequestProtocol into NettyProtocol

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7427: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > integrate PartitionRequestProtocol into

[jira] [Updated] (FLINK-7412) optimise NettyMessage.TaskEventRequest#readFrom() to read from netty buffers directly

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7412: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > optimise

[jira] [Updated] (FLINK-7412) optimise NettyMessage.TaskEventRequest#readFrom() to read from netty buffers directly

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7412: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > optimise

[jira] [Updated] (FLINK-7411) minor performance improvements in NettyMessage

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7411: --- Issue Type: Bug (was: Sub-task) Parent: (was: FLINK-7512) > minor performance

[jira] [Updated] (FLINK-7411) minor performance improvements in NettyMessage

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7411: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7315 > minor performance improvements in

[jira] [Updated] (FLINK-7312) activate checkstyle for flink/core/memory/*

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7312: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7315 > activate checkstyle for

[jira] [Created] (FLINK-7520) let our Buffer class extend from netty's buffer class

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7520: -- Summary: let our Buffer class extend from netty's buffer class Key: FLINK-7520 URL: https://issues.apache.org/jira/browse/FLINK-7520 Project: Flink Issue Type:

[jira] [Created] (FLINK-7518) pass our own buffer instances to netty

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7518: -- Summary: pass our own buffer instances to netty Key: FLINK-7518 URL: https://issues.apache.org/jira/browse/FLINK-7518 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7517) let NettyBufferPool extend PooledByteBufAllocator

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7517: -- Summary: let NettyBufferPool extend PooledByteBufAllocator Key: FLINK-7517 URL: https://issues.apache.org/jira/browse/FLINK-7517 Project: Flink Issue Type:

[jira] [Created] (FLINK-7516) MemorySegment: do not allow copies into a read-only ByteBuffer

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7516: -- Summary: MemorySegment: do not allow copies into a read-only ByteBuffer Key: FLINK-7516 URL: https://issues.apache.org/jira/browse/FLINK-7516 Project: Flink

[jira] [Created] (FLINK-7515) allow actual 0-length content in NettyMessage#allocateBuffer()

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7515: -- Summary: allow actual 0-length content in NettyMessage#allocateBuffer() Key: FLINK-7515 URL: https://issues.apache.org/jira/browse/FLINK-7515 Project: Flink

[jira] [Created] (FLINK-7514) fix BackPressureStatsTrackerITCase releasing buffers twice

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7514: -- Summary: fix BackPressureStatsTrackerITCase releasing buffers twice Key: FLINK-7514 URL: https://issues.apache.org/jira/browse/FLINK-7514 Project: Flink Issue

[jira] [Created] (FLINK-7513) remove TestBufferFactory#MOCK_BUFFER

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7513: -- Summary: remove TestBufferFactory#MOCK_BUFFER Key: FLINK-7513 URL: https://issues.apache.org/jira/browse/FLINK-7513 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-7428) avoid one additional buffer copy when receiving messages

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7428: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7512 > avoid one additional buffer

[jira] [Updated] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7499: --- Issue Type: Sub-task (was: Bug) Parent: FLINK-7512 > double buffer release in

[jira] [Updated] (FLINK-7411) minor performance improvements in NettyMessage

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7411: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7512 > minor performance improvements

[jira] [Updated] (FLINK-7427) integrate PartitionRequestProtocol into NettyProtocol

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7427: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7512 > integrate

[jira] [Updated] (FLINK-7512) avoid unnecessary buffer copies during network serialization

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7512: --- Description: Currently, we have our own {{Buffer}} class backed by a {{MemorySegment}} and whenever

[jira] [Updated] (FLINK-7412) optimise NettyMessage.TaskEventRequest#readFrom() to read from netty buffers directly

2017-08-25 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7412: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-7512 > optimise

[jira] [Created] (FLINK-7512) avoid unnecessary buffer copies during network serialization

2017-08-25 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7512: -- Summary: avoid unnecessary buffer copies during network serialization Key: FLINK-7512 URL: https://issues.apache.org/jira/browse/FLINK-7512 Project: Flink

[jira] [Created] (FLINK-7499) double buffer release in SpillableSubpartitionView

2017-08-24 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7499: -- Summary: double buffer release in SpillableSubpartitionView Key: FLINK-7499 URL: https://issues.apache.org/jira/browse/FLINK-7499 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7487) test instability in ClassLoaderITCase (no resources available)

2017-08-21 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7487: -- Summary: test instability in ClassLoaderITCase (no resources available) Key: FLINK-7487 URL: https://issues.apache.org/jira/browse/FLINK-7487 Project: Flink

[jira] [Updated] (FLINK-7487) test instability in ClassLoaderITCase (no resources available)

2017-08-21 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7487: --- Labels: test-stability (was: ) > test instability in ClassLoaderITCase (no resources available) >

[jira] [Closed] (FLINK-5671) Test ClassLoaderITCase#testJobsWithCustomClassLoader fails

2017-08-21 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-5671. -- Resolution: Auto Closed Closing this now since there is not enough information to track this down and

[jira] [Created] (FLINK-7483) BlobCache cleanup timer not reset after job re-registration

2017-08-21 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7483: -- Summary: BlobCache cleanup timer not reset after job re-registration Key: FLINK-7483 URL: https://issues.apache.org/jira/browse/FLINK-7483 Project: Flink Issue

[jira] [Commented] (FLINK-7473) Possible Leak in GlobalWindows

2017-08-18 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16132125#comment-16132125 ] Nico Kruber commented on FLINK-7473: Another fix: properly fix your event time use (which is the

[jira] [Created] (FLINK-7467) a slow client on the BlobServer may block writing operations

2017-08-17 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7467: -- Summary: a slow client on the BlobServer may block writing operations Key: FLINK-7467 URL: https://issues.apache.org/jira/browse/FLINK-7467 Project: Flink

[jira] [Created] (FLINK-7431) test instability in JobManagerFailsITCase

2017-08-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7431: -- Summary: test instability in JobManagerFailsITCase Key: FLINK-7431 URL: https://issues.apache.org/jira/browse/FLINK-7431 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-7431) test instability in JobManagerFailsITCase

2017-08-11 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7431: --- Labels: test-stability (was: ) > test instability in JobManagerFailsITCase >

[jira] [Created] (FLINK-7428) avoid one additional buffer copy when receiving messages

2017-08-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7428: -- Summary: avoid one additional buffer copy when receiving messages Key: FLINK-7428 URL: https://issues.apache.org/jira/browse/FLINK-7428 Project: Flink Issue

[jira] [Created] (FLINK-7427) integrate PartitionRequestProtocol into NettyProtocol

2017-08-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7427: -- Summary: integrate PartitionRequestProtocol into NettyProtocol Key: FLINK-7427 URL: https://issues.apache.org/jira/browse/FLINK-7427 Project: Flink Issue Type:

[jira] [Created] (FLINK-7412) optimise NettyMessage.TaskEventRequest#readFrom() to read from netty buffers directly

2017-08-10 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7412: -- Summary: optimise NettyMessage.TaskEventRequest#readFrom() to read from netty buffers directly Key: FLINK-7412 URL: https://issues.apache.org/jira/browse/FLINK-7412

[jira] [Created] (FLINK-7411) minor performance improvements in NettyMessage

2017-08-10 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7411: -- Summary: minor performance improvements in NettyMessage Key: FLINK-7411 URL: https://issues.apache.org/jira/browse/FLINK-7411 Project: Flink Issue Type:

[jira] [Updated] (FLINK-7400) off-heap limits set to conservatively in cluster environments

2017-08-09 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7400: --- Summary: off-heap limits set to conservatively in cluster environments (was: off-heap limits set to

[jira] [Updated] (FLINK-7400) off-heap limits set to conservatively in yarn

2017-08-09 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-7400: --- Component/s: Mesos Cluster Management > off-heap limits set to conservatively in

[jira] [Commented] (FLINK-7316) always use off-heap network buffers

2017-08-09 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119981#comment-16119981 ] Nico Kruber commented on FLINK-7316: After changing to off-heap network buffers, we are hit by

  1   2   3   4   >