[
https://issues.apache.org/jira/browse/DRILL-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinfeng Ni updated DRILL-2790:
------------------------------
Fix Version/s: (was: 1.2.0)
Future
> Implicit cast to numbers fails when Text data contains empty strings
> ---------------------------------------------------------------------
>
> Key: DRILL-2790
> URL: https://issues.apache.org/jira/browse/DRILL-2790
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 0.9.0
> Reporter: Abhishek Girish
> Assignee: Jinfeng Ni
> Fix For: Future
>
>
> When a column in a Text file (CSV) contains empty strings, any query which
> uses valid implicit casts fail to execute with NumberFormatException. Drill
> should ignore empty strings in such scenarios. If not, the error message must
> be improved to clearly indicate the same.
> *Text:*
> {code:sql}
> > select columns[4] from `store.dat` limit 10;
> +------------+
> | EXPR$0 |
> +------------+
> | 2451189 |
> | |
> | |
> | 2451044 |
> | 2450910 |
> | |
> | |
> | |
> | |
> | |
> +------------+
> 10 rows selected (0.154 seconds)
> > select * from `store.dat` where columns[4] = 2451189 limit 1;
> Query failed: RemoteRpcException: Failure while running fragment., [
> e5348e11-ec53-4332-981a-ff070253c19a on abhi6.qa.lab:31010 ]
> [ e5348e11-ec53-4332-981a-ff070253c19a on abhi6.qa.lab:31010 ]
> Error: exception while executing query: Failure while executing query.
> (state=,code=0)
> {code}
> Log snippet:
> {code}
> 2015-04-14 14:16:50,642 [2ad27c3c-8b36-a116-4d38-18410eff96d2:frag:0:0] ERROR
> o.a.drill.exec.ops.FragmentContext - Fragment Context received failure --
> Fragment: 0:0
> java.lang.NumberFormatException:
> at
> org.apache.drill.exec.expr.fn.impl.StringFunctionHelpers.nfeI(StringFunctionHelpers.java:97)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.expr.fn.impl.StringFunctionHelpers.varCharToInt(StringFunctionHelpers.java:103)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.test.generated.FiltererGen97.doEval(FilterTemplate2.java:37)
> ~[na:na]
> at
> org.apache.drill.exec.test.generated.FiltererGen97.filterBatchNoSV(FilterTemplate2.java:98)
> ~[na:na]
> at
> org.apache.drill.exec.test.generated.FiltererGen97.filterBatch(FilterTemplate2.java:71)
> ~[na:na]
> at
> org.apache.drill.exec.physical.impl.filter.FilterRecordBatch.doWork(FilterRecordBatch.java:82)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
> ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
> {code}
> The following query works:
> {code:sql}
> > select columns[4] from `store.dat` where columns[4] <>'' AND columns[4]=
> > 2451189 limit 1;
> +------------+
> | EXPR$0 |
> +------------+
> | 2451189 |
> +------------+
> 1 row selected (0.174 seconds)
> {code}
> *Parquet:*
> {code:sql}
> > select s_closed_date_sk from store where s_closed_date_sk = 2451189 limit 1;
> +------------------+
> | s_closed_date_sk |
> +------------------+
> | 2451189 |
> +------------------+
> 1 row selected (0.122 seconds)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
