[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Ollala updated DRILL-5097: - Reviewer: Krystal (was: Karthikeyan Manivannan) > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Data Types, Storage - Parquet >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Labels: ready-to-commit > Fix For: 1.10.0 > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthikeyan Manivannan updated DRILL-5097: -- Labels: ready-to-commit (was: ) > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Data Types, Storage - Parquet >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Labels: ready-to-commit > Fix For: Future > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zelaine Fong updated DRILL-5097: Reviewer: Karthikeyan Manivannan Assigned Reviewer to [~karthikm] > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Data Types, Storage - Parquet >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Fix For: Future > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Diravka updated DRILL-5097: --- Component/s: (was: Execution - Codegen) Storage - Parquet Execution - Data Types > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Data Types, Storage - Parquet >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Fix For: Future > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Diravka updated DRILL-5097: --- Labels: (was: FreeMarker TimestampVector) > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Codegen >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Fix For: Future > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (DRILL-5097) Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works
[ https://issues.apache.org/jira/browse/DRILL-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Diravka updated DRILL-5097: --- Description: Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works. The below query succeeds: {code} select c, convert_from(d, 'TIMESTAMP_IMPALA') from dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; {code} The below query fails: {code} 0: jdbc:drill:zk=10.10.100.190:5181> alter session set `store.parquet.reader.int96_as_timestamp` = true; +---+---+ | ok | summary | +---+---+ | true | store.parquet.reader.int96_as_timestamp updated. | +---+---+ 1 row selected (0.231 seconds) 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) Fragment 0:0 [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] (state=,code=0) {code} was: Need to change the default width of the timestamp vector from 8 byte to 12, since timestamp values can hold a new INT96 primitive type. Use case for it: Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works. The below query succeeds: {code} select c, convert_from(d, 'TIMESTAMP_IMPALA') from dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; {code} The below query fails: {code} 0: jdbc:drill:zk=10.10.100.190:5181> alter session set `store.parquet.reader.int96_as_timestamp` = true; +---+---+ | ok | summary | +---+---+ | true | store.parquet.reader.int96_as_timestamp updated. | +---+---+ 1 row selected (0.231 seconds) 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) Fragment 0:0 [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] (state=,code=0) {code} > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works > --- > > Key: DRILL-5097 > URL: https://issues.apache.org/jira/browse/DRILL-5097 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Codegen >Affects Versions: 1.9.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Labels: FreeMarker, TimestampVector > Fix For: Future > > Attachments: data.snappy.parquet > > > Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from > works. > The below query succeeds: > {code} > select c, convert_from(d, 'TIMESTAMP_IMPALA') from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > {code} > The below query fails: > {code} > 0: jdbc:drill:zk=10.10.100.190:5181> alter session set > `store.parquet.reader.int96_as_timestamp` = true; > +---+---+ > | ok | summary | > +---+---+ > | true | store.parquet.reader.int96_as_timestamp updated. | > +---+---+ > 1 row selected (0.231 seconds) > 0: jdbc:drill:zk=10.10.100.190:5181> select c, d from > dfs.`/drill/testdata/parquet_timestamp/spark_generated/d3`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: > 131076 (expected: 0 <= readerIndex <= writerIndex <= capacity(131072)) > Fragment 0:0 > [Error Id: bd94f477-7c01-420f-8920-06263212177b on qa-node190.qa.lab:31010] > (state=,code=0) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)