[
https://issues.apache.org/jira/browse/FLUME-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13437603#comment-13437603
]
Mike Percy commented on FLUME-1419:
-----------------------------------
The functionality here is already available using the timestamp interceptor,
and this changes the semantics so that the bucketing is not consistent: whereas
right now the logic is event centric, it now can be local time centric, but
that depends on whether the event is annotated with timestamp or not.
This change seems like it would make things more confusing and less predictable.
> Using system time if 'timestamp' property is absent in event header
> -------------------------------------------------------------------
>
> Key: FLUME-1419
> URL: https://issues.apache.org/jira/browse/FLUME-1419
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.2.0
> Reporter: Denny Ye
> Assignee: Denny Ye
> Fix For: v1.3.0
>
> Attachments: FLUME-1419.patch
>
>
> If we want to use pattern for generating HDFS path but the 'timestamp'
> property is absent in event header, it may cause the exception...
> Event may comes from several Sources and doesn't use Interceptor(pupulate
> 'timestamp' property). Thus, event may be haven't this property normally.
> Use the local system time to replace it.
> java.lang.RuntimeException: Flume wasn't able to parse timestamp header in
> the event to resolve time based bucketing. Please check that you're correctly
> populating timestamp header (for example using TimestampInterceptor source
> interceptor).
> at
> org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:149)
> at
> org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:318)
> at
> org.apache.flume.formatter.output.TestBucketPath.testDateFormatHours(TestBucketPath.java:46)
> Caused by: java.lang.NumberFormatException: null
> at java.lang.Long.parseLong(Unknown Source)
> at java.lang.Long.valueOf(Unknown Source)
> at
> org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:147)
> ... 26 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
