Hi Rahul,

According to the parquet specification
<https://github.com/Parquet/parquet-format/blob/master/LogicalTypes.md#timestamp_millis>
the primitive datatype for the TIMESTAMP logical type is INT64 (INT96 has a
deprecated label). That's why Drill has not a mechanism to generate such
values.
But it seems that Spark is going to support INT64 TIMESTAMP values -
SPARK-10364 <https://issues.apache.org/jira/browse/SPARK-10364>

Kind regards
Vitalii

On Sat, Apr 1, 2017 at 2:56 PM, Rahul Raj <[email protected]>
wrote:

> I'm unable to read drill generated timestamp column inside a spark program.
> Drill 1.10 has support for reading int96 as timestamp. Is it possible to
> generate the same from drill?
>
> Is there any mechanism to read drills int64 from spark?
>
> Rahul
>
> --
> **** This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom it is
> addressed. If you are not the named addressee then you should not
> disseminate, distribute or copy this e-mail. Please notify the sender
> immediately and delete this e-mail from your system.****
>

Reply via email to