[
https://issues.apache.org/jira/browse/FLINK-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055535#comment-16055535
]
ASF GitHub Bot commented on FLINK-6652:
---------------------------------------
Github user zentol commented on a diff in the pull request:
https://github.com/apache/flink/pull/4088#discussion_r122929860
--- Diff:
flink-core/src/main/java/org/apache/flink/api/common/io/DelimitedInputFormat.java
---
@@ -269,6 +272,9 @@ public void setBufferSize(int bufferSize) {
if (bufferSize < 1) {
throw new IllegalArgumentException("Buffer size must be
at least 1.");
}
+ if (bufferSize <= delimiter.length) {
--- End diff --
we should also adjust the condition above that `bufferSize` must be be
greater than one.
> Problem with DelimitedInputFormat
> ---------------------------------
>
> Key: FLINK-6652
> URL: https://issues.apache.org/jira/browse/FLINK-6652
> Project: Flink
> Issue Type: Bug
> Components: Batch Connectors and Input/Output Formats
> Affects Versions: 1.2.1
> Reporter: Moritz Schubotz
> Assignee: Fabian Hueske
> Fix For: 1.2.0
>
>
> After upgrading from Flink 1.2.0 to 1.2.1 I got the following error
> ```
> 07:54:52,395 ERROR org.apache.flink.api.common.io.DelimitedInputFormat
> - Unexpected problen while getting the file statistics for file
> 'mytestfile': -1
> java.lang.ArrayIndexOutOfBoundsException: -1
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.readLine(DelimitedInputFormat.java:572)
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics(DelimitedInputFormat.java:423)
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics(DelimitedInputFormat.java:48)
> at
> org.apache.flink.optimizer.dag.DataSourceNode.computeOperatorSpecificDefaultEstimates(DataSourceNode.java:166)
> ```
> I have created a test repo to isolate the issue here
> https://github.com/physikerwelt/flinkReadTest
> and reproduced the bug using travis
> https://travis-ci.org/physikerwelt/flinkReadTest
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
