Edit:
Here is the error:
Error: SYSTEM ERROR:
org.apache.drill.common.exceptions.DrillRuntimeException: Error in parquet
record reader.
Message:
Hadoop path: /data/1440002040405/part-r-00001.parquet
Total records read: 0
Mock records read: 0
Records to read: 32768
Row group index: 0
Records in row group: 343411
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message root {
optional binary PROVDATAPOINTID (UTF8);
optional binary ARRIVALDTUTC (UTF8);
optional binary CAPTURETIMEUTC (UTF8);
optional binary LATITUDE (UTF8);
optional binary LONGITUDE (UTF8);
optional binary SPEED (UTF8);
optional binary HEADING (UTF8);
optional binary UNITID (UTF8);
}
, metadata:
{org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"PROVDATAPOINTID","type":"string","nullable":true,"metadata":{"name":"PROVDATAPOINTID"}},{"name":"ARRIVALDTUTC","type":"string","nullable":true,"metadata":{"name":"ARRIVALDTUTC"}},{"name":"CAPTURETIMEUTC","type":"string","nullable":true,"metadata":{"name":"CAPTURETIMEUTC"}},{"name":"LATITUDE","type":"string","nullable":true,"metadata":{"name":"LATITUDE"}},{"name":"LONGITUDE","type":"string","nullable":true,"metadata":{"name":"LONGITUDE"}},{"name":"SPEED","type":"string","nullable":true,"metadata":{"name":"SPEED"}},{"name":"HEADING","type":"string","nullable":true,"metadata":{"name":"HEADING"}},{"name":"UNITID","type":"string","nullable":true,"metadata":{"name":"UNITID"}}]}}},
blocks: [BlockMetaData{343411, 5831751 [ColumnMetaData{GZIP
[PROVDATAPOINTID] BINARY [RLE, PLAIN, BIT_PACKED], 4}, ColumnMetaData{GZIP
[ARRIVALDTUTC] BINARY [RLE, PLAIN_DICTIONARY, BIT_PACKED], 265676},
ColumnMetaData{GZIP [CAPTURETIMEUTC] BINARY [RLE, PLAIN_DICTIONARY,
BIT_PACKED], 266187}, ColumnMetaData{GZIP [LATITUDE] BINARY [RLE,
PLAIN_DICTIONARY, BIT_PACKED], 358091}, ColumnMetaData{GZIP [LONGITUDE]
BINARY [RLE, PLAIN_DICTIONARY, BIT_PACKED], 884833}, ColumnMetaData{GZIP
[SPEED] BINARY [RLE, PLAIN_DICTIONARY, BIT_PACKED], 1422417},
ColumnMetaData{GZIP [HEADING] BINARY [RLE, PLAIN_DICTIONARY, BIT_PACKED],
1494318}, ColumnMetaData{GZIP [UNITID] BINARY [RLE, PLAIN_DICTIONARY,
BIT_PACKED], 1605213}]}]}
Regards,
Usman Ali
On Wed, Aug 19, 2015 at 9:55 PM, Usman Ali <[email protected]>
wrote:
> Hi,
> I received following error while querying a parquet file stored on
> S3.
> Any Help?
>
> Regards,
> Usman Ali
>
