[
https://issues.apache.org/jira/browse/FLINK-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986064#comment-14986064
]
Stephan Ewen commented on FLINK-2618:
-------------------------------------
Same here, although the test failure is a curious one.
One thing we could do is enhance the test to log the Random Number Generator
seed used for a test. Upon a failure, we can then reproduce that particular
test. Except for the RNG, the test should be deterministic. The merging phase
is also single threaded and if the spill buffers are of deterministic size
(they should be if memory budget is fix and sequence of records is
deterministic) any inherent issue should be reproducible.
It may still be that there is data corruption on disk. That is a very small
chance, but then again it happens only every few hundreds of tests that spill
large amounts...
> ExternalSortITCase failure
> --------------------------
>
> Key: FLINK-2618
> URL: https://issues.apache.org/jira/browse/FLINK-2618
> Project: Flink
> Issue Type: Bug
> Reporter: Sachin Goel
> Labels: test-stability
>
> {{ExternalSortITCase.testSpillingSortWithIntermediateMerge}} fails with the
> exception:
> {code}
> org.apache.flink.types.NullKeyFieldException: Field 0 is null, but expected
> to hold a key.
> at
> org.apache.flink.api.common.typeutils.record.RecordComparator.setReference(RecordComparator.java:212)
> at
> org.apache.flink.api.common.typeutils.record.RecordComparator.setReference(RecordComparator.java:40)
> at
> org.apache.flink.runtime.operators.sort.MergeIterator$HeadStream.nextHead(MergeIterator.java:127)
> at
> org.apache.flink.runtime.operators.sort.MergeIterator.next(MergeIterator.java:88)
> at
> org.apache.flink.runtime.operators.sort.MergeIterator.next(MergeIterator.java:69)
> at
> org.apache.flink.runtime.operators.sort.ExternalSortITCase.testSpillingSortWithIntermediateMerge(ExternalSortITCase.java:301)
> {code}
> Here is the build log:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/78579607/log.txt
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
