Yu Li created FLINK-11990:
-----------------------------
Summary: Streaming bucketing end-to-end test fail with hadoop 2.8
Key: FLINK-11990
URL: https://issues.apache.org/jira/browse/FLINK-11990
Project: Flink
Issue Type: Bug
Components: Connectors / Hadoop Compatibility
Reporter: Yu Li
As titled, running the {{test_streaming_bucketing.sh}} case with hadoop 2.8
bundles always fail, while running with 2.6 bundles could pass.
Command to run the case:
{{FLINK_DIR=<flink dir> flink-end-to-end-tests/run-single-test.sh
test-scripts/test_streaming_bucketing.sh skip_check_exceptions}}
The output with hadoop 2.8
[bundle|https://repository.apache.org/content/repositories/orgapacheflink-1213/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar]
or [dist|http://archive.apache.org/dist/hadoop/core/hadoop-2.8.5]:
{noformat}
Starting taskexecutor daemon on host z05f06378.sqa.zth.
Waiting for job (905ae10bae4b99031e724b9c29f0ca7b) to reach terminal state
FINISHED ...
Truncating buckets
Truncating to
{noformat}
The output of the success run with hadoop 2.6
[bundle|https://repository.apache.org/content/repositories/orgapacheflink-1213/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar]
or [dist|http://archive.apache.org/dist/hadoop/core/hadoop-2.6.5]:
{noformat}
Truncating
/home/jueding.ly/flink_rc_check/flink-1.8.0-src/flink-end-to-end-tests/test-scripts/temp-test-directory-06210353709/out/result3/part-3-0
to 51250
1+0 records in
1+0 records out
51250 bytes (51 kB) copied, 0.000377998 s, 136 MB/s
Truncating
/home/jueding.ly/flink_rc_check/flink-1.8.0-src/flink-end-to-end-tests/test-scripts/temp-test-directory-06210353709/out/result7/part-3-0
to 51250
1+0 records in
1+0 records out
51250 bytes (51 kB) copied, 0.00033118 s, 155 MB/s
pass Bucketing Sink
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
