[jira] [Commented] (DRILL-2873) CTAS reports error when timestamp values in CSV file are quoted
[
https://issues.apache.org/jira/browse/DRILL-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015130#comment-17015130
]
Arina Ielchiieva commented on DRILL-2873:
-
{noformat}
apache drill (dfs.tmp)> create table t as select cast(columns[0] as int)
col_int, cast(columns[1] as bigint) col_bgint, cast(columns[2] as char(10))
col_char, cast(columns[3] as varchar(18)) col_vchar, cast(columns[4] as
timestamp) col_tmstmp, cast(columns[5] as date) col_date, cast(columns[6] as
boolean) col_boln, cast(columns[7] as double) col_dbl from dfs.tmp.`data.csv`;
+--+---+
| Fragment | Number of records written |
+--+---+
| 0_0 | 8 |
+--+---+
1 row selected (0.757 seconds)
apache drill (dfs.tmp)> select * from t;
++---+--+--+-++--+-+
| col_int | col_bgint | col_char |col_vchar |
col_tmstmp| col_date | col_boln | col_dbl |
++---+--+--+-++--+-+
| -225058309 | 44225657827296040 | QAhHUTNv | njEl0iAivVwLEbAg | 2015-04-23
23:47:00.124 | 2001-05-27 | true | 9.05562343765E8 |
| 112439 | 2211473083106365 | oBwtZmzK | WOLzjgzk5HgXO8l1 | 2015-04-23
23:47:00.124 | 1958-03-12 | true | 9.91522739327E7 |
| 1784506402 | 29351094148275324 | QlyTFtkw | SmP428hFKw5A085 | 2015-04-23
23:47:00.126 | 1990-07-21 | false| 7.5267099524E8 |
| 2012511944 | 53048515756157424 | BybVyYWH | cnDqVgMANMtJGbuv | 2015-04-23
23:47:00.127 | 1953-02-10 | false| 7.84335138726E8 |
| 1546241934 | 77079445473902384 | ZDxIxxLs | JHp2B9q0rJKyZ12K | 2015-04-23
23:47:00.127 | 1976-01-09 | false| 8.70192831047E8 |
| 1553741594 | 69736976577857208 | smtgHcaV | aJoVXdN9363arx1Y | 2015-04-23
23:47:00.127 | 1953-10-18 | true | 1.109816755E9 |
| 395345402 | 18812010265162496 | pNetevKF | IrXNHyRm4EY02Mv7 | 2015-04-23
23:47:00.127 | 1989-09-17 | false| 1.66747196389E8 |
| -478640426 | 71296213927402152 | jXsJbzuR | DJGy8xMZGEpHOEJh | 2015-04-23
23:47:00.128 | 2013-02-21 | false| 5.41750692166E8 |
++---+--+--+-++--+-+
{noformat}
> CTAS reports error when timestamp values in CSV file are quoted
> ---
>
> Key: DRILL-2873
> URL: https://issues.apache.org/jira/browse/DRILL-2873
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
>Affects Versions: 0.9.0
> Environment: 64e3ec52b93e9331aa5179e040eca19afece8317 | DRILL-2611:
> value vectors should report valid value count | 16.04.2015 @ 13:53:34 EDT
>Reporter: Khurram Faraaz
>Priority: Major
> Fix For: 1.17.0
>
>
> When timestamp values are quoted in quotes (") inside a CSV data file, CTAS
> statement reports error.
> Failing CTAS
> {code}
> 0: jdbc:drill:> create table prqFrmCSV02 as select cast(columns[0] as int)
> col_int, cast(columns[1] as bigint) col_bgint, cast(columns[2] as char(10))
> col_char, cast(columns[3] as varchar(18)) col_vchar, cast(columns[4] as
> timestamp) col_tmstmp, cast(columns[5] as date) col_date, cast(columns[6] as
> boolean) col_boln, cast(columns[7] as double) col_dbl from `csvToPrq.csv`;
> Query failed: SYSTEM ERROR: Invalid format: ""2015-04-23 23:47:00.124""
> [a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010]
> Error: exception while executing query: Failure while executing query.
> (state=,code=0)
> {code}
> Stack trace from drillbit.log
> {code}
> 2015-04-24 18:41:09,721 [2ac571ba-778f-f3d5-c60f-af2e536905a3:frag:0:0] ERROR
> o.a.drill.exec.ops.FragmentContext - Fragment Context received failure --
> Fragment: 0:0
> org.apache.drill.common.exceptions.DrillUserException: SYSTEM ERROR: Invalid
> format: ""2015-04-23 23:47:00.124""
> [a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010]
> at
> org.apache.drill.common.exceptions.DrillUserException$Builder.build(DrillUserException.java:115)
> ~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.common.exceptions.ErrorHelper.wrap(ErrorHelper.java:39)
> ~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.ops.FragmentContext.fail(FragmentContext.java:151)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:131)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
>
[jira] [Commented] (DRILL-2873) CTAS reports error when timestamp values in CSV file are quoted
[
https://issues.apache.org/jira/browse/DRILL-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14511791#comment-14511791
]
Khurram Faraaz commented on DRILL-2873:
---
This issue is dependent/related to DRILL-2760
CTAS reports error when timestamp values in CSV file are quoted
---
Key: DRILL-2873
URL: https://issues.apache.org/jira/browse/DRILL-2873
Project: Apache Drill
Issue Type: Bug
Components: Storage - Parquet
Affects Versions: 0.9.0
Environment: 64e3ec52b93e9331aa5179e040eca19afece8317 | DRILL-2611:
value vectors should report valid value count | 16.04.2015 @ 13:53:34 EDT
Reporter: Khurram Faraaz
Assignee: Steven Phillips
When timestamp values are quoted in quotes () inside a CSV data file, CTAS
statement reports error.
Failing CTAS
{code}
0: jdbc:drill: create table prqFrmCSV02 as select cast(columns[0] as int)
col_int, cast(columns[1] as bigint) col_bgint, cast(columns[2] as char(10))
col_char, cast(columns[3] as varchar(18)) col_vchar, cast(columns[4] as
timestamp) col_tmstmp, cast(columns[5] as date) col_date, cast(columns[6] as
boolean) col_boln, cast(columns[7] as double) col_dbl from `csvToPrq.csv`;
Query failed: SYSTEM ERROR: Invalid format: 2015-04-23 23:47:00.124
[a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010]
Error: exception while executing query: Failure while executing query.
(state=,code=0)
{code}
Stack trace from drillbit.log
{code}
2015-04-24 18:41:09,721 [2ac571ba-778f-f3d5-c60f-af2e536905a3:frag:0:0] ERROR
o.a.drill.exec.ops.FragmentContext - Fragment Context received failure --
Fragment: 0:0
org.apache.drill.common.exceptions.DrillUserException: SYSTEM ERROR: Invalid
format: 2015-04-23 23:47:00.124
[a601a66a-b305-4a92-9836-f39edcdc8fe8 on centos-02.qa.lab:31010]
at
org.apache.drill.common.exceptions.DrillUserException$Builder.build(DrillUserException.java:115)
~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.common.exceptions.ErrorHelper.wrap(ErrorHelper.java:39)
~[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.ops.FragmentContext.fail(FragmentContext.java:151)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:131)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:135)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:74)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:76)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:64)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:164)
~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
