[
https://issues.apache.org/jira/browse/KAFKA-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated KAFKA-7334:
--------------------------
Description:
Quoting stack trace from KAFKA-5998 :
{code}
WARN [2018-08-22 03:17:03,745]
org.apache.kafka.streams.processor.internals.ProcessorStateManager: task [0_45]
Failed to write offset checkpoint file to /tmp/kafka-streams/<application_id>
{{ /0_45/.checkpoint: {}}}
{{ ! java.nio.file.NoSuchFileException:
/tmp/kafka-streams/<application_id>/0_45/.checkpoint.tmp}}
{{ ! at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
{{ ! at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
{code}
When state.dir is left at default configuration, there is a chance that certain
files under the state directory are cleaned by OS since the default dir starts
with /tmp/kafka-streams.
[~mjsax] and I proposed to suggest user, through exception message, to change
the location for state.dir .
was:
Quoting stack trace from KAFKA-5998 :
{code}
WARN [2018-08-22 03:17:03,745]
org.apache.kafka.streams.processor.internals.ProcessorStateManager: task [0_45]
Failed to write offset checkpoint file to /tmp/kafka-streams/<application_id>
{{ /0_45/.checkpoint: {}}}
{{ ! java.nio.file.NoSuchFileException:
/tmp/kafka-streams/<application_id>/0_45/.checkpoint.tmp}}
{{ ! at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
{{ ! at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
{code}
When state.dir is left at default configuration, there is a chance that certain
files under the state directory are cleaned by OS.
[~mjsax] and I proposed to suggest user, through exception message, to change
the location for state.dir .
> Suggest changing config for state.dir in case of FileNotFoundException
> ----------------------------------------------------------------------
>
> Key: KAFKA-7334
> URL: https://issues.apache.org/jira/browse/KAFKA-7334
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Ted Yu
> Priority: Major
>
> Quoting stack trace from KAFKA-5998 :
> {code}
> WARN [2018-08-22 03:17:03,745]
> org.apache.kafka.streams.processor.internals.ProcessorStateManager: task
> [0_45] Failed to write offset checkpoint file to
> /tmp/kafka-streams/<application_id>
> {{ /0_45/.checkpoint: {}}}
> {{ ! java.nio.file.NoSuchFileException:
> /tmp/kafka-streams/<application_id>/0_45/.checkpoint.tmp}}
> {{ ! at
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
> {{ ! at
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
> {code}
> When state.dir is left at default configuration, there is a chance that
> certain files under the state directory are cleaned by OS since the default
> dir starts with /tmp/kafka-streams.
> [~mjsax] and I proposed to suggest user, through exception message, to change
> the location for state.dir .
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
