Sam Rohde created BEAM-8738:
-------------------------------

             Summary: Revisit timestamp and duration representation
                 Key: BEAM-8738
                 URL: https://issues.apache.org/jira/browse/BEAM-8738
             Project: Beam
          Issue Type: Improvement
          Components: beam-model
            Reporter: Sam Rohde


The current proto representation of timesetamp and durations in Beam is either 
raw int64s or the well-known Google protobuf types "google.protobuf.timestamp" 
and "google.protobuf.duration". Apache Beam uses int64 MAX and MIN as sentinel 
values for an +inf watermark and -inf watermark. However, the 
google.protobuf.timestamp is compliant with RFC3339, meaning it can only 
represent date-times between 0001-01-01 and 9999-12-31. This is not the same as 
the int64 MAX and MIN representation. The questions remain:
 * What should the timestamp and duration representations be?
 * What units should the timestamps and duration be? Nanos? Micros?
 * What algebra is allowed when dealing with timestamps and durations? What is 
needed?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to