[jira] [Commented] (DRILL-6937) sys.functions table needs a fix in the names column

2019-01-21 Thread Kunal Khatua (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748442#comment-16748442
 ] 

Kunal Khatua commented on DRILL-6937:
-

I think, everything is implemented as a function. So in this case, the function 
is 
{{bit Z = greater_than(bigint X, bigint Y)}}
However, the SQL language parser is (probably) providing us syntactic sugar by 
making it easier to right
{{Z = X > Y}}

Both options are available to the user, we just tend to use what is more 
intuitive.
{code}
0: jdbc:drill:drillbit=kk127> select 2 > 1 from (values(1));
+-+
| EXPR$0  |
+-+
| true|
+-+
1 row selected (0.862 seconds)
0: jdbc:drill:drillbit=kk127> select greater_than(2,1) from (values(1));
+-+
| EXPR$0  |
+-+
| true|
+-+
1 row selected (0.453 seconds)
{code}

> sys.functions table needs a fix in the names column
> ---
>
> Key: DRILL-6937
> URL: https://issues.apache.org/jira/browse/DRILL-6937
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Execution - Flow
>Affects Versions: 1.15.0
>Reporter: Khurram Faraaz
>Assignee: Kunal Khatua
>Priority: Minor
> Fix For: 1.16.0
>
>
> The function names in the name column of sys.functions in some cases, are the 
> operators, this is not the expected behavior, the name column should have 
> actual names and not the operators.
> I am on Drill 1.15.0 commit : 8743e8f1e8d5bca4d67c94d07a8560ad356ff2b6
> {noformat}
> Apache Drill 1.15.0
> "Data is the new oil. Ready to Drill some?"
> 0: jdbc:drill:schema=dfs.tmp> select count(*) from sys.functions;
> +-+
> | EXPR$0 |
> +-+
> | 2846 |
> +-+
> 1 row selected (0.327 seconds)
> 0: jdbc:drill:schema=dfs.tmp>
> {noformat}
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select distinct name from sys.functions limit 
> 12;
> ++
> | name |
> ++
> | != |
> | $sum0 |
> | && |
> | - |
> | /int |
> | < |
> | <= |
> | <> |
> | = |
> | == |
> | > |
> | >= |
> ++
> 12 rows selected (0.175 seconds)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6937) sys.functions table needs a fix in the names column

2019-01-21 Thread Khurram Faraaz (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748292#comment-16748292
 ] 

Khurram Faraaz commented on DRILL-6937:
---

One question is, why do we have two different entries in the sys.functions 
table, one with name being ">" and other with name being "greater_than", all 
other columns for the two functions seem to have identical values, except for 
the name.

{noformat}
| > | BIGINT-REQUIRED,BIGINT-REQUIRED | BIT | built-in | false |

| greater_than | BIGINT-REQUIRED,BIGINT-REQUIRED | BIT | built-in | false | 
{noformat}

> sys.functions table needs a fix in the names column
> ---
>
> Key: DRILL-6937
> URL: https://issues.apache.org/jira/browse/DRILL-6937
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Execution - Flow
>Affects Versions: 1.15.0
>Reporter: Khurram Faraaz
>Assignee: Kunal Khatua
>Priority: Minor
> Fix For: 1.16.0
>
>
> The function names in the name column of sys.functions in some cases, are the 
> operators, this is not the expected behavior, the name column should have 
> actual names and not the operators.
> I am on Drill 1.15.0 commit : 8743e8f1e8d5bca4d67c94d07a8560ad356ff2b6
> {noformat}
> Apache Drill 1.15.0
> "Data is the new oil. Ready to Drill some?"
> 0: jdbc:drill:schema=dfs.tmp> select count(*) from sys.functions;
> +-+
> | EXPR$0 |
> +-+
> | 2846 |
> +-+
> 1 row selected (0.327 seconds)
> 0: jdbc:drill:schema=dfs.tmp>
> {noformat}
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select distinct name from sys.functions limit 
> 12;
> ++
> | name |
> ++
> | != |
> | $sum0 |
> | && |
> | - |
> | /int |
> | < |
> | <= |
> | <> |
> | = |
> | == |
> | > |
> | >= |
> ++
> 12 rows selected (0.175 seconds)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6950) Row set-based scan framework

2019-01-21 Thread Paul Rogers (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Rogers updated DRILL-6950:
---
Description: 
Next step in the ongoing "Result Set Loader" saga. Merge the enhanced scan 
operator framework Into master. Includes:

* Projection add-ons for the "columns" column and file metadata columns.
* Mechanisms to orchestrate the result set loader, projection framework, scan 
node and reader code.
* Extensive unit tests.

Given the number of test files to review, pushed the following to the next PR:

* Extension to the "Easy" reader framework to handle the new structure.


  was:
Next step in the ongoing "Result Set Loader" saga. Merge the enhanced scan node 
framework Into master. Includes:

* Projection add-ons for the "columns" column and file metadata columns.
* Extension to the "Easy" reader framework to handle the new structure.
* Mechanisms to orchestrate the result set loader, projection framework, scan 
node and reader code. 


> Row set-based scan framework
> 
>
> Key: DRILL-6950
> URL: https://issues.apache.org/jira/browse/DRILL-6950
> Project: Apache Drill
>  Issue Type: Improvement
>Affects Versions: 1.15.0
>Reporter: Paul Rogers
>Assignee: Paul Rogers
>Priority: Major
> Fix For: 1.16.0
>
>
> Next step in the ongoing "Result Set Loader" saga. Merge the enhanced scan 
> operator framework Into master. Includes:
> * Projection add-ons for the "columns" column and file metadata columns.
> * Mechanisms to orchestrate the result set loader, projection framework, scan 
> node and reader code.
> * Extensive unit tests.
> Given the number of test files to review, pushed the following to the next PR:
> * Extension to the "Easy" reader framework to handle the new structure.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6950) Row set-based scan framework

2019-01-21 Thread Paul Rogers (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Rogers updated DRILL-6950:
---
Summary: Row set-based scan framework  (was: Pull request for row set-based 
scan framework)

> Row set-based scan framework
> 
>
> Key: DRILL-6950
> URL: https://issues.apache.org/jira/browse/DRILL-6950
> Project: Apache Drill
>  Issue Type: Improvement
>Affects Versions: 1.15.0
>Reporter: Paul Rogers
>Assignee: Paul Rogers
>Priority: Major
> Fix For: 1.16.0
>
>
> Next step in the ongoing "Result Set Loader" saga. Merge the enhanced scan 
> node framework Into master. Includes:
> * Projection add-ons for the "columns" column and file metadata columns.
> * Extension to the "Easy" reader framework to handle the new structure.
> * Mechanisms to orchestrate the result set loader, projection framework, scan 
> node and reader code. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (DRILL-6937) sys.functions table needs a fix in the names column

2019-01-21 Thread Kunal Khatua (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748280#comment-16748280
 ] 

Kunal Khatua edited comment on DRILL-6937 at 1/22/19 12:02 AM:
---

[~khfaraaz] the {{/int}} function name is correct. See 
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/DateIntervalFunctionTemplates/IntervalNumericArithmetic.java#L133

That said, I'm not sure if this is really a bug, since there have been other 
functions, like {{$sum0}} around as well:
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/SumZeroAggr.java#L48

Not all functions in the {{sys.functions}} table are necessarily utilized by 
users in their alphabetical representation, and are exposed to mathematical 
symbols as operators, but Drill implicitly transforms it into the appropriate 
function.

For example, the _equals_  , _less than_  or _greater than_ operator can be 
seen here in multiple forms.
{code}
0: jdbc:drill:drillbit=kk127> select * from sys.functions where returnType = 
'BIT' and signature = 'BIGINT-REQUIRED,BIGINT-REQUIRED'  limit 15;
+---+--+-+---+---+
|   name|signature | returnType  |  
source   | internal  |
+---+--+-+---+---+
| !=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| < | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <>| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| = | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| ==| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| > | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| >=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| equal | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| greater_than  | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| greater_than_or_equal_to  | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| less_than | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| less_than_or_equal_to | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| not_equal | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
+---+--+-+---+---+
14 rows selected (0.282 seconds)
{code}

So, I'm not sure this would qualify as a bug. 
[~arina] do you agree?


was (Author: kkhatua):
[~khfaraaz] the {{/int}} function name is correct. See 
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/DateIntervalFunctionTemplates/IntervalNumericArithmetic.java#L133

That said, I'm not sure if this is really a bug, since there have been other 
functions, like {{$sum0}} around as well:
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/SumZeroAggr.java#L48

Not all functions in the {{sys.functions}} table are necessarily utilized by 
users in their alphabetical representation, and are exposed to mathematical 
symbols as operators.

For example, the _less than_  or _greater than_ operator can be seen here in 
multiple forms.
{code}
0: jdbc:drill:drillbit=kk127> select * from sys.functions where returnType = 
'BIT' and signature = 'BIGINT-REQUIRED,BIGINT-REQUIRED'  limit 15;
+---+--+-+---+---+
|   name|signature | returnType  |  
source   | internal  |
+---+--+-+---+---+
| !=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| < | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <>| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| = | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| ==| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT

[jira] [Updated] (DRILL-6956) Maintain a single entry for Drill Version in the pom file

2019-01-21 Thread Kunal Khatua (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Khatua updated DRILL-6956:

Due Date: 25/Feb/19

> Maintain a single entry for Drill Version in the pom file
> -
>
> Key: DRILL-6956
> URL: https://issues.apache.org/jira/browse/DRILL-6956
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: Tools, Build  Test
>Affects Versions: 1.15.0
>Reporter: Kunal Khatua
>Assignee: Kunal Khatua
>Priority: Major
> Fix For: 1.16.0
>
>
> Currently, updating the version information for a Drill release involves 
> updating 30+ pom files.
> The right way would be to use the Multi Module Setup for Maven CI.
> https://maven.apache.org/maven-ci-friendly.html#Multi_Module_Setup



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6937) sys.functions table needs a fix in the names column

2019-01-21 Thread Kunal Khatua (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748280#comment-16748280
 ] 

Kunal Khatua commented on DRILL-6937:
-

[~khfaraaz] the {{/int}} function name is correct. See 
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/DateIntervalFunctionTemplates/IntervalNumericArithmetic.java#L133

That said, I'm not sure if this is really a bug, since there have been other 
functions, like {{$sum0}} around as well:
https://github.com/apache/drill/blame/master/exec/java-exec/src/main/codegen/templates/SumZeroAggr.java#L48

Not all functions in the {{sys.functions}} table are necessarily utilized by 
users in their alphabetical representation, and are exposed to mathematical 
symbols as operators.

For example, the _less than_  or _greater than_ operator can be seen here in 
multiple forms.
{code}
0: jdbc:drill:drillbit=kk127> select * from sys.functions where returnType = 
'BIT' and signature = 'BIGINT-REQUIRED,BIGINT-REQUIRED'  limit 15;
+---+--+-+---+---+
|   name|signature | returnType  |  
source   | internal  |
+---+--+-+---+---+
| !=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| < | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| <>| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| = | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| ==| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| > | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| >=| BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| equal | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| greater_than  | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| greater_than_or_equal_to  | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| less_than | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| less_than_or_equal_to | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
| not_equal | BIGINT-REQUIRED,BIGINT-REQUIRED  | BIT | 
built-in  | false |
+---+--+-+---+---+
14 rows selected (0.282 seconds)
{code}

So, I'm not sure this would qualify as a bug. 
[~arina] do you agree?

> sys.functions table needs a fix in the names column
> ---
>
> Key: DRILL-6937
> URL: https://issues.apache.org/jira/browse/DRILL-6937
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Execution - Flow
>Affects Versions: 1.15.0
>Reporter: Khurram Faraaz
>Assignee: Kunal Khatua
>Priority: Minor
> Fix For: 1.16.0
>
>
> The function names in the name column of sys.functions in some cases, are the 
> operators, this is not the expected behavior, the name column should have 
> actual names and not the operators.
> I am on Drill 1.15.0 commit : 8743e8f1e8d5bca4d67c94d07a8560ad356ff2b6
> {noformat}
> Apache Drill 1.15.0
> "Data is the new oil. Ready to Drill some?"
> 0: jdbc:drill:schema=dfs.tmp> select count(*) from sys.functions;
> +-+
> | EXPR$0 |
> +-+
> | 2846 |
> +-+
> 1 row selected (0.327 seconds)
> 0: jdbc:drill:schema=dfs.tmp>
> {noformat}
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select distinct name from sys.functions limit 
> 12;
> ++
> | name |
> ++
> | != |
> | $sum0 |
> | && |
> | - |
> | /int |
> | < |
> | <= |
> | <> |
> | = |
> | == |
> | > |
> | >= |
> ++
> 12 rows selected (0.175 seconds)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (DRILL-6990) IllegalStateException: The current reader doesn't support getting next information

2019-01-21 Thread Khurram Faraaz (JIRA)
Khurram Faraaz created DRILL-6990:
-

 Summary: IllegalStateException: The current reader doesn't support 
getting next information
 Key: DRILL-6990
 URL: https://issues.apache.org/jira/browse/DRILL-6990
 Project: Apache Drill
  Issue Type: Bug
Affects Versions: 1.14.0
Reporter: Khurram Faraaz
 Attachments: parqt_nestedArray.parquet.tar

Reading a parquet file created from Spark, returns IllegalStateException: The 
current reader doesn't support getting next information

Drill 1.14.0, parquet file created from Spark is attached here.

//Steps to create parquet file from Spark 2.3.1

[root@ba102-495 ~]# cd /opt/mapr/spark/spark-2.3.1
[root@ba102-495 spark-2.3.1]# cd bin
[root@ba102-495 bin]# ./spark-shell
19/01/21 22:57:05 WARN NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
Spark context Web UI available at http://qa102-45.qa.lab:4040
Spark context available as 'sc' (master = local[*], app id = 
local-1548111430809).
Spark session available as 'spark'.
Welcome to
  __
 / __/__ ___ _/ /__
 _\ \/ _ \/ _ `/ __/ '_/
 /___/ .__/\_,_/_/ /_/\_\ version 2.3.1-mapr-SNAPSHOT
 /_/

Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_191)
Type in expressions to have them evaluated.
Type :help for more information.

scala> import spark.implicits._
import spark.implicits._

scala> val df = spark.read.json("/apps/nestedDataJson.json")
df: org.apache.spark.sql.DataFrame = [id: bigint, nested_array: 
array>]

scala> df.write.parquet("/apps/parqt_nestedArray.parquet")

Data used in test

{noformat}
[root@ba102-495 ~]# cat nestedDataJson.json
{"id":19,"nested_array":[[1,2,3,4],[5,6,7,8],[9,10,12]]}
{"id":14121,"nested_array":[[1,3,4],[5,6,8],[9,11,12]]}
{"id":18894,"nested_array":[[1,3,4],[5,6,7,8],[9,10,11,12]]}
{"id":12499,"nested_array":[[1,4],[5,7,8],[9,11,12]]}
{"id":120,"nested_array":[[1,4],[5,7,8],[9,10,11,12]]}
{"id":12,"nested_array":[[1,2,3,4],[5,6,7,8],[11,12]]}
{"id":13,"nested_array":[[1,2,3,4],[5,8],[9,10,11,12]]}
{"id":14,"nested_array":[[1,2,3,4],[5,68],[9,10,11,12]]}
{"id":123,"nested_array":[[1,2,3,4],[5,8],[9,10,11,12]]}
{"id":124,"nested_array":[[1,2,4],[5,6,7,8],[9,10,11,12]]}
{"id":134,"nested_array":[[1,4],[5,8],[9,12]]}
{noformat}

>From drillbit.log

{noformat}
Query Failed: An Error Occurred
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: 
IllegalStateException: The current reader doesn't support getting next 
information. Fragment 0:0 [Error Id: c16c70dd-6565-463f-83a7-118ccd8442e2 on 
ba102-495.qa.lab:31010]
...
...
2019-01-21 23:08:11,268 [23b9af24-10b9-ad11-5583-ecc3e0c562e6:frag:0:0] ERROR 
o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: IllegalStateException: The 
current reader doesn't support getting next information.

Fragment 0:0

[Error Id: c16c70dd-6565-463f-83a7-118ccd8442e2 on ba102-495.qa.lab:31010]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: 
IllegalStateException: The current reader doesn't support getting next 
information.

Fragment 0:0

[Error Id: c16c70dd-6565-463f-83a7-118ccd8442e2 on ba102-495.qa.lab:31010]
 at 
org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633)
 ~[drill-common-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:361)
 [drill-java-exec-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:216)
 [drill-java-exec-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:327)
 [drill-java-exec-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) 
[drill-common-1.14.0-mapr.jar:1.14.0-mapr]
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[na:1.8.0_181]
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[na:1.8.0_181]
 at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
Caused by: java.lang.IllegalStateException: The current reader doesn't support 
getting next information.
 at 
org.apache.drill.exec.vector.complex.impl.AbstractBaseReader.next(AbstractBaseReader.java:64)
 ~[vector-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.exec.vector.complex.impl.SingleMapReaderImpl.next(SingleMapReaderImpl.java:31)
 ~[vector-1.14.0-mapr.jar:1.14.0-mapr]
 at 
org.apache.drill.exec.test.generated.ProjectorGen971.doEval(ProjectorTemplate.java:35)
 ~[na:na]
 at 
org.apache.drill.exec.test.generated.ProjectorGen971.projectRecords(ProjectorTemplate.java:67)
 ~[na:na]
 at 
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:231)
 ~[drill-java-exec-1.14.0-mapr.jar:1.14.0-mapr]
 at 

[jira] [Updated] (DRILL-6533) (type|sqlType|drillType|mode)Of functions fail when used with constants

2019-01-21 Thread Volodymyr Vysotskyi (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Volodymyr Vysotskyi updated DRILL-6533:
---
Fix Version/s: 1.16.0

> (type|sqlType|drillType|mode)Of functions fail when used with constants
> ---
>
> Key: DRILL-6533
> URL: https://issues.apache.org/jira/browse/DRILL-6533
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.14.0
>Reporter: Arina Ielchiieva
>Assignee: Volodymyr Vysotskyi
>Priority: Major
> Fix For: 1.16.0
>
>
> Affected functions: typeOf, sqlTypeOf, drillTypeOf, modeOf
> Example:
> {noformat}
> 0: jdbc:drill:drillbit=localhost> select typeOf(1) from (values(1));
> Error: SYSTEM ERROR: IllegalArgumentException: Can not set 
> org.apache.drill.exec.vector.complex.reader.FieldReader field 
> org.apache.drill.exec.expr.fn.impl.UnionFunctions$GetType.input to 
> org.apache.drill.exec.expr.holders.IntHolder
> [Error Id: 709cf2f7-7396-4034-8c5a-e94d78504297 on cv1:31010]
>   (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception 
> during fragment initialization: Error while applying rule 
> ReduceExpressionsRule(Project), args 
> [rel#3945:LogicalProject.NONE.ANY([]).[](input=rel#3944:Subset#0.NONE.ANY([]).[0],EXPR$0=TYPEOF(1))]
> org.apache.drill.exec.work.foreman.Foreman.run():294
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.RuntimeException) Error while applying rule 
> ReduceExpressionsRule(Project), args 
> [rel#3945:LogicalProject.NONE.ANY([]).[](input=rel#3944:Subset#0.NONE.ANY([]).[0],EXPR$0=TYPEOF(1))]
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():236
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
> org.apache.calcite.tools.Programs$RuleSetProgram.run():368
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():426
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():366
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():255
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():315
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():180
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
> org.apache.drill.exec.work.foreman.Foreman.runSQL():567
> org.apache.drill.exec.work.foreman.Foreman.run():266
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.RuntimeException) Error in evaluating function of 
> typeof
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator$EvalVisitor.visitFunctionHolderExpression():347
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator$EvalVisitor.visitFunctionHolderExpression():194
> org.apache.drill.common.expression.FunctionHolderExpression.accept():53
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator.evaluateConstantExpr():69
> org.apache.drill.exec.planner.logical.DrillConstExecutor.reduce():150
> 
> org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressionsInternal():620
> org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressions():540
> 
> org.apache.calcite.rel.rules.ReduceExpressionsRule$ProjectReduceExpressionsRule.onMatch():288
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():212
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
> org.apache.calcite.tools.Programs$RuleSetProgram.run():368
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():426
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():366
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():255
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():315
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():180
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
> org.apache.drill.exec.work.foreman.Foreman.runSQL():567
> org.apache.drill.exec.work.foreman.Foreman.run():266
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.IllegalArgumentException) Can not set 
> 

[jira] [Assigned] (DRILL-6533) (type|sqlType|drillType|mode)Of functions fail when used with constants

2019-01-21 Thread Volodymyr Vysotskyi (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Volodymyr Vysotskyi reassigned DRILL-6533:
--

Assignee: Volodymyr Vysotskyi

> (type|sqlType|drillType|mode)Of functions fail when used with constants
> ---
>
> Key: DRILL-6533
> URL: https://issues.apache.org/jira/browse/DRILL-6533
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.14.0
>Reporter: Arina Ielchiieva
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>
> Affected functions: typeOf, sqlTypeOf, drillTypeOf, modeOf
> Example:
> {noformat}
> 0: jdbc:drill:drillbit=localhost> select typeOf(1) from (values(1));
> Error: SYSTEM ERROR: IllegalArgumentException: Can not set 
> org.apache.drill.exec.vector.complex.reader.FieldReader field 
> org.apache.drill.exec.expr.fn.impl.UnionFunctions$GetType.input to 
> org.apache.drill.exec.expr.holders.IntHolder
> [Error Id: 709cf2f7-7396-4034-8c5a-e94d78504297 on cv1:31010]
>   (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception 
> during fragment initialization: Error while applying rule 
> ReduceExpressionsRule(Project), args 
> [rel#3945:LogicalProject.NONE.ANY([]).[](input=rel#3944:Subset#0.NONE.ANY([]).[0],EXPR$0=TYPEOF(1))]
> org.apache.drill.exec.work.foreman.Foreman.run():294
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.RuntimeException) Error while applying rule 
> ReduceExpressionsRule(Project), args 
> [rel#3945:LogicalProject.NONE.ANY([]).[](input=rel#3944:Subset#0.NONE.ANY([]).[0],EXPR$0=TYPEOF(1))]
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():236
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
> org.apache.calcite.tools.Programs$RuleSetProgram.run():368
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():426
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():366
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():255
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():315
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():180
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
> org.apache.drill.exec.work.foreman.Foreman.runSQL():567
> org.apache.drill.exec.work.foreman.Foreman.run():266
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.RuntimeException) Error in evaluating function of 
> typeof
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator$EvalVisitor.visitFunctionHolderExpression():347
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator$EvalVisitor.visitFunctionHolderExpression():194
> org.apache.drill.common.expression.FunctionHolderExpression.accept():53
> 
> org.apache.drill.exec.expr.fn.interpreter.InterpreterEvaluator.evaluateConstantExpr():69
> org.apache.drill.exec.planner.logical.DrillConstExecutor.reduce():150
> 
> org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressionsInternal():620
> org.apache.calcite.rel.rules.ReduceExpressionsRule.reduceExpressions():540
> 
> org.apache.calcite.rel.rules.ReduceExpressionsRule$ProjectReduceExpressionsRule.onMatch():288
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():212
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
> org.apache.calcite.tools.Programs$RuleSetProgram.run():368
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():426
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():366
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():255
> 
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():315
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():180
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
> org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
> org.apache.drill.exec.work.foreman.Foreman.runSQL():567
> org.apache.drill.exec.work.foreman.Foreman.run():266
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748
>   Caused By (java.lang.IllegalArgumentException) Can not set 
> org.apache.drill.exec.vector.complex.reader.FieldReader field 

[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Description: 
*For documentation*
{{drill-embedded.bat}} was added as handy script to Start Drill on Windows 
without passing any params.
Please updated the following section: 
https://drill.apache.org/docs/starting-drill-on-windows/

Other issues covered in this Jira:

{{sqlline.bat}} fails for the next cases:
 1. Specified file in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
2. Specified file path that contains spaces:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
q.sql""=="test" was unexpected at this time.
{noformat}
3. Specified query in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * from 
sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
* was unexpected at this time.
{noformat}
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
from sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
'a' was unexpected at this time.
{noformat}
4. Specified custom config location:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" --config=/tmp/conf
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
5. Specified custom config location with spaces in the path:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
--config="/tmp/conf test"
DRILL_ARGS - " -u jdbc:drill:zk=local"
test"" was unexpected at this time.
{noformat}
6. Sqlline was run from non-bin directory:
{noformat}
apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}

  was:
*For documentation*
{{drill-embedded.bat}} was added as handy script to Start Drill on Windows 
without passing any params.
Please updated the following section: 
https://drill.apache.org/docs/starting-drill-on-windows/

{{sqlline.bat}} fails for the next cases:
 1. Specified file in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
2. Specified file path that contains spaces:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
q.sql""=="test" was unexpected at this time.
{noformat}
3. Specified query in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * from 
sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
* was unexpected at this time.
{noformat}
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
from sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
'a' was unexpected at this time.
{noformat}
4. Specified custom config location:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" --config=/tmp/conf
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
5. Specified custom config location with spaces in the path:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
--config="/tmp/conf test"
DRILL_ARGS - " -u jdbc:drill:zk=local"
test"" was unexpected at this time.
{noformat}
6. Sqlline was run from non-bin directory:
{noformat}
apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}


> Fix sqlline.bat issues on 

[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Description: 
*For documentation*
{{drill-embedded.bat}} was added as handy script to Start Drill on Windows 
without passing any params.
Please updated the following section: 
https://drill.apache.org/docs/starting-drill-on-windows/

{{sqlline.bat}} fails for the next cases:
 1. Specified file in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
2. Specified file path that contains spaces:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
q.sql""=="test" was unexpected at this time.
{noformat}
3. Specified query in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * from 
sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
* was unexpected at this time.
{noformat}
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
from sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
'a' was unexpected at this time.
{noformat}
4. Specified custom config location:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" --config=/tmp/conf
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
5. Specified custom config location with spaces in the path:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
--config="/tmp/conf test"
DRILL_ARGS - " -u jdbc:drill:zk=local"
test"" was unexpected at this time.
{noformat}
6. Sqlline was run from non-bin directory:
{noformat}
apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}

  was:
{{sqlline.bat}} fails for the next cases:
 1. Specified file in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
2. Specified file path that contains spaces:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
q.sql""=="test" was unexpected at this time.
{noformat}
3. Specified query in the argument:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * from 
sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
* was unexpected at this time.
{noformat}
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
from sys.version"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
'a' was unexpected at this time.
{noformat}
4. Specified custom config location:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" --config=/tmp/conf
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}
5. Specified custom config location with spaces in the path:
{noformat}
apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
--config="/tmp/conf test"
DRILL_ARGS - " -u jdbc:drill:zk=local"
test"" was unexpected at this time.
{noformat}
6. Sqlline was run from non-bin directory:
{noformat}
apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Error: Could not find or load main class sqlline.SqlLine
{noformat}


> Fix sqlline.bat issues on Windows
> -
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.15.0
> 

[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows and add drill-embedded.bat

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Issue Type: Improvement  (was: Bug)

> Fix sqlline.bat issues on Windows and add drill-embedded.bat
> 
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Improvement
>Affects Versions: 1.15.0
> Environment: Windows 10
>Reporter: Volodymyr Vysotskyi
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: doc-impacting, ready-to-commit
> Fix For: 1.16.0
>
>
> *For documentation*
> {{drill-embedded.bat}} was added as handy script to Start Drill on Windows 
> without passing any params.
> Please updated the following section: 
> https://drill.apache.org/docs/starting-drill-on-windows/
> Other issues covered in this Jira:
> {{sqlline.bat}} fails for the next cases:
>  1. Specified file in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 2. Specified file path that contains spaces:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> q.sql""=="test" was unexpected at this time.
> {noformat}
> 3. Specified query in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> * was unexpected at this time.
> {noformat}
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> 'a' was unexpected at this time.
> {noformat}
> 4. Specified custom config location:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config=/tmp/conf
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 5. Specified custom config location with spaces in the path:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config="/tmp/conf test"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> test"" was unexpected at this time.
> {noformat}
> 6. Sqlline was run from non-bin directory:
> {noformat}
> apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows and add drill-embedded.bat

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Summary: Fix sqlline.bat issues on Windows and add drill-embedded.bat  
(was: Fix sqlline.bat issues on Windows)

> Fix sqlline.bat issues on Windows and add drill-embedded.bat
> 
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.15.0
> Environment: Windows 10
>Reporter: Volodymyr Vysotskyi
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: doc-impacting, ready-to-commit
> Fix For: 1.16.0
>
>
> *For documentation*
> {{drill-embedded.bat}} was added as handy script to Start Drill on Windows 
> without passing any params.
> Please updated the following section: 
> https://drill.apache.org/docs/starting-drill-on-windows/
> Other issues covered in this Jira:
> {{sqlline.bat}} fails for the next cases:
>  1. Specified file in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 2. Specified file path that contains spaces:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> q.sql""=="test" was unexpected at this time.
> {noformat}
> 3. Specified query in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> * was unexpected at this time.
> {noformat}
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> 'a' was unexpected at this time.
> {noformat}
> 4. Specified custom config location:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config=/tmp/conf
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 5. Specified custom config location with spaces in the path:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config="/tmp/conf test"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> test"" was unexpected at this time.
> {noformat}
> 6. Sqlline was run from non-bin directory:
> {noformat}
> apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Labels: doc-impacting ready-to-commit  (was: ready-to-commit)

> Fix sqlline.bat issues on Windows
> -
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.15.0
> Environment: Windows 10
>Reporter: Volodymyr Vysotskyi
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: doc-impacting, ready-to-commit
> Fix For: 1.16.0
>
>
> {{sqlline.bat}} fails for the next cases:
>  1. Specified file in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 2. Specified file path that contains spaces:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> q.sql""=="test" was unexpected at this time.
> {noformat}
> 3. Specified query in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> * was unexpected at this time.
> {noformat}
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> 'a' was unexpected at this time.
> {noformat}
> 4. Specified custom config location:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config=/tmp/conf
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 5. Specified custom config location with spaces in the path:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config="/tmp/conf test"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> test"" was unexpected at this time.
> {noformat}
> 6. Sqlline was run from non-bin directory:
> {noformat}
> apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6980) --run regression - error when empty line or command at end of the file

2019-01-21 Thread Volodymyr Vysotskyi (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748033#comment-16748033
 ] 

Volodymyr Vysotskyi commented on DRILL-6980:


[~benj641], the problem is in SqlLine: 
[https://github.com/julianhyde/sqlline/issues/232.] It was fixed there and it 
will be fixed for Drill after upgrade to SqlLine 1.7.0

> --run regression - error when empty line or command at end of the file
> --
>
> Key: DRILL-6980
> URL: https://issues.apache.org/jira/browse/DRILL-6980
> Project: Apache Drill
>  Issue Type: Bug
>  Components: SQL Parser
>Affects Versions: 1.15.0
>Reporter: benj
>Priority: Minor
>
> When using --run like
> {code:java}
> bin/drill-embedded --run="myfile.req"
> {code}
> If "myfile.req" contains extra lines (empty or comment) after the last SQL 
> DRILL request, an error appear.
> {code:java}
> Error: PARSE ERROR: Encountered "" at line 1, column 4.
> {code}
> Note that empty lines or comment lines in the middle of the file (ie between 
> 2 DRILL requests or at the beginning of the file) don't make any problem.
> This problem appeared in 1.15.0 did not exists in 1.14.0
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (DRILL-6989) Upgrade to SqlLine 1.7.0

2019-01-21 Thread Arina Ielchiieva (JIRA)
Arina Ielchiieva created DRILL-6989:
---

 Summary: Upgrade to SqlLine 1.7.0
 Key: DRILL-6989
 URL: https://issues.apache.org/jira/browse/DRILL-6989
 Project: Apache Drill
  Issue Type: Task
Affects Versions: 1.15.0
Reporter: Arina Ielchiieva
 Fix For: 1.16.0


Upgrade to SqlLine 1.7.0 after its officially released.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6987) sqlline - simple semicolon ";" with no command produce error

2019-01-21 Thread Arina Ielchiieva (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748026#comment-16748026
 ] 

Arina Ielchiieva commented on DRILL-6987:
-

[~benj641] you should mind that SqlLine is a framework that Drill uses. If you 
find bugs in SqlLine, it's better to report them to SqlLine community rather 
than to Drill project.
Link to issues in SqlLine - https://github.com/julianhyde/sqlline/issues

> sqlline - simple semicolon ";" with no command produce error
> 
>
> Key: DRILL-6987
> URL: https://issues.apache.org/jira/browse/DRILL-6987
> Project: Apache Drill
>  Issue Type: Bug
>  Components: SQL Parser
>Affects Versions: 1.15.0
>Reporter: benj
>Priority: Minor
>
> In sqlline, a single semicolon (or space(s) followed by semicolon) - "*[ 
> ]*;*" - produce an error
> {code:java}
> ;
> Error: PARSE ERROR: Encountered "" at line 0, column 0.
> {code}
> It's not necessary a real bug, but I think it can produce "too much" error 
> for nothing.
> Don't need/want an error for an empty command.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (DRILL-6988) Utility of the too long error message when syntax error

2019-01-21 Thread benj (JIRA)
benj created DRILL-6988:
---

 Summary: Utility of the too long error message when syntax error
 Key: DRILL-6988
 URL: https://issues.apache.org/jira/browse/DRILL-6988
 Project: Apache Drill
  Issue Type: Improvement
  Components: SQL Parser
Affects Versions: 1.15.0
Reporter: benj


When executing query with syntax error, the too long and useless error message 
pollute log/screen and doesn't give any useful information.

Maybe a more concise error message (1-3 line max) should be enough.
{code:java}
SELECT FROM (VALUES(1));
Error: PARSE ERROR: Encountered "FROM" at line 1, column 8.
Was expecting one of:
    "UNION" ...
    "INTERSECT" ...
    "EXCEPT" ...
    "MINUS" ...
    "ORDER" ...
    "LIMIT" ...
    "OFFSET" ...
    "FETCH" ...
    "STREAM" ...
    "DISTINCT" ...
    "ALL" ...
    "*" ...
    "+" ...
    "-" ...
    "NOT" ...
    "EXISTS" ...
     ...
     ...
     ...
     ...
     ...
     ...
     ...
    "TRUE" ...
    "FALSE" ...
    "UNKNOWN" ...
    "NULL" ...
     ...
     ...
     ...
    "DATE" ...
    "TIME" ...
    "TIMESTAMP" ...
    "INTERVAL" ...
    "?" ...
    "CAST" ...
    "EXTRACT" ...
    "POSITION" ...
    "CONVERT" ...
    "TRANSLATE" ...
    "OVERLAY" ...
    "FLOOR" ...
    "CEIL" ...
    "CEILING" ...
    "SUBSTRING" ...
    "TRIM" ...
    "CLASSIFIER" ...
    "MATCH_NUMBER" ...
    "RUNNING" ...
    "PREV" ...
    "NEXT" ...
     ...
    "MULTISET" ...
    "ARRAY" ...
    "PERIOD" ...
    "SPECIFIC" ...
     ...
     ...
     ...
     ...
     ...
    "ABS" ...
    "AVG" ...
    "CARDINALITY" ...
    "CHAR_LENGTH" ...
    "CHARACTER_LENGTH" ...
    "COALESCE" ...
    "COLLECT" ...
    "COVAR_POP" ...
    "COVAR_SAMP" ...
    "CUME_DIST" ...
    "COUNT" ...
    "CURRENT_DATE" ...
    "CURRENT_TIME" ...
    "CURRENT_TIMESTAMP" ...
    "DENSE_RANK" ...
    "ELEMENT" ...
    "EXP" ...
    "FIRST_VALUE" ...
    "FUSION" ...
    "GROUPING" ...
    "HOUR" ...
    "LAG" ...
    "LEAD" ...
    "LAST_VALUE" ...
    "LN" ...
    "LOCALTIME" ...
    "LOCALTIMESTAMP" ...
    "LOWER" ...
    "MAX" ...
    "MIN" ...
    "MINUTE" ...
    "MOD" ...
    "MONTH" ...
    "NTH_VALUE" ...
    "NTILE" ...
    "NULLIF" ...
    "OCTET_LENGTH" ...
    "PERCENT_RANK" ...
    "POWER" ...
    "RANK" ...
    "REGR_SXX" ...
    "REGR_SYY" ...
    "ROW_NUMBER" ...
    "SECOND" ...
    "SQRT" ...
    "STDDEV_POP" ...
    "STDDEV_SAMP" ...
    "SUM" ...
    "UPPER" ...
    "TRUNCATE" ...
    "USER" ...
    "VAR_POP" ...
    "VAR_SAMP" ...
    "YEAR" ...
    "CURRENT_CATALOG" ...
    "CURRENT_DEFAULT_TRANSFORM_GROUP" ...
    "CURRENT_PATH" ...
    "CURRENT_ROLE" ...
    "CURRENT_SCHEMA" ...
    "CURRENT_USER" ...
    "SESSION_USER" ...
    "SYSTEM_USER" ...
    "NEW" ...
    "CASE" ...
    "CURRENT" ...
    "CURSOR" ...
    "ROW" ...
    "(" ...
    

SQL Query SELECT FROM VALUES(1)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (DRILL-6987) sqlline - simple semicolon ";" with no command produce error

2019-01-21 Thread benj (JIRA)
benj created DRILL-6987:
---

 Summary: sqlline - simple semicolon ";" with no command produce 
error
 Key: DRILL-6987
 URL: https://issues.apache.org/jira/browse/DRILL-6987
 Project: Apache Drill
  Issue Type: Bug
  Components: SQL Parser
Affects Versions: 1.15.0
Reporter: benj


In sqlline, a single semicolon (or space(s) followed by semicolon) - "*[ ]*;*" 
- produce an error
{code:java}
;
Error: PARSE ERROR: Encountered "" at line 0, column 0.
{code}
It's not necessary a real bug, but I think it can produce "too much" error for 
nothing.

Don't need/want an error for an empty command.

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6973) Improve --run (ability to run query and get result in a good format from command line)

2019-01-21 Thread benj (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747988#comment-16747988
 ] 

benj commented on DRILL-6973:
-

Yes, I have missed this new option of 1.15.0 
(https://drill.apache.org/docs/apache-drill-1-15-0-release-notes/). Thanks.

With
{code:java}
ALTER SESSION SET `exec.query.return_result_set_for_ddl` = false;
{code}
and
{code:java}
bin/sqlline -u "..." --run="..." --silent=true --showHeader=false 
--outputformat=csv
{code}
There are still the quote to manage but It already improves the possibilities 
and potential.

 

> Improve --run  (ability to run query and get result in a good format from 
> command line)
> ---
>
> Key: DRILL-6973
> URL: https://issues.apache.org/jira/browse/DRILL-6973
> Project: Apache Drill
>  Issue Type: Wish
>Affects Versions: 1.15.0
>Reporter: benj
>Priority: Major
>
> For a more flexible and minimalist use of DRILL, it would be useful/practical 
> to have more "options" on the --run part.
>  * The formatting of the output : the vertical/csv/json/table/xml... are cool 
> but not simple enough to be simply piped in a shell
>  * The possibility to display only the last query in the output, or at least 
> the possibility to not display the output of command like ALTER 
> SESSION/SYSTEM... 
>  * The formatting of the csv should allow NO QuoteCharacter (in 
> --csvQuoteCharacter) and why not a possibility to allow QuoteCharacter in 
> terms of the type or even of the data itself
> {noformat}
> Currently :
> '1','foo','Drill,baby,drill'
> Still currently (we can change the QuoteCharacter)
> @1@,@foo@,@Drill,baby,drill@
> NEW option 1 - With not quote
> 1,foo,Drill,baby,drill => Ok the third field is problematic here a problem 
> but it's the responsibility of the user and he can use this option when it's 
> appropriate
> NEW option 2 - function of the type 
> 1,'foo','Drill,baby,drill'
> NEW option 3 - function of the data
> 1,foo,'Drill,baby,drill' => (foo doesn't need quote because it does not 
> contain a separator or endofline, but the third field contain separator)
> {noformat}
>  * Maybe some other ideas could be taken up from tools like psql
> Few improvements of the --run would allow more practical use case in a simple 
> way



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (DRILL-6986) Table function improvements / issues (UMBRELLA JIRA)

2019-01-21 Thread Arina Ielchiieva (JIRA)
Arina Ielchiieva created DRILL-6986:
---

 Summary: Table function improvements / issues (UMBRELLA JIRA)
 Key: DRILL-6986
 URL: https://issues.apache.org/jira/browse/DRILL-6986
 Project: Apache Drill
  Issue Type: Task
Reporter: Arina Ielchiieva


Umbrella Jira to keep track of all table function improvements / issues.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (DRILL-3698) Expose Show Files Command As SQL for sorting/filtering

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva reassigned DRILL-3698:
---

Assignee: Arina Ielchiieva

> Expose Show Files Command As SQL for sorting/filtering
> --
>
> Key: DRILL-3698
> URL: https://issues.apache.org/jira/browse/DRILL-3698
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: SQL Parser
>Affects Versions: Future
> Environment: All
>Reporter: John Omernik
>Assignee: Arina Ielchiieva
>Priority: Major
>  Labels: features
> Fix For: 1.15.0
>
>
> When using drill, I had a workspace setup, and I found myself using the show 
> files command often to find my directories etc. The thing is, the return of 
> show files is not ordered.  And when looking at file system data there are 
> many possible ways to order the results for efficiency as a user.  
> Consider the ls command in unix; the ability to specify different sorting is 
> built in there.  I checked out 
> http://drill.apache.org/docs/show-files-command/ as well as tried the 
> "obvious" show files order by name and that didn't work nor did I see how I 
> could in the documentation. 
> Based on a mailing list discussion there is no way to do that currently in 
> Drill, hence this JIRA I think just adding ORDER BY SQL methodology would be 
> perfect here, you have 8 fields (seen below) and ordering by any one of them, 
> or group of them, with ASC/DESC just like standard SQL order by would be a 
> huge win.  
> I suppose one could potentially ask for WHERE clause (filtering)too, and 
> maybe a select (which fieldsto display) however I am more concerned with the 
> order, but if I had to implement all there I could see examples below:
> (All Three, select, where, and order) (I.e. after "Files" if the token isn't 
> WHERE  or ORDER then check for the fields, if it's not a valid field list 
> error)
> SHOW FILES name, accessTime WHERE name like '%.csv' ORDER BY name;
> (Where clause and order, note the token after FILES is WHERE)
> SHOW FILES WHERE name like '%.csv' ORDER BY length ASC, name DESC;
> (Only Order, ORDER Is the first token after FILES)
> SHOW FILES ORDER BY length ASC, name DESC
> I don't think we have to grant full SQL functionality here (i.e. aggregates), 
> just the ability to display various fields, filter on criteria, and ordering. 
> If you wanted to get fancy, I suppose you could take the table and make it a 
> full on table, i.e. take the results make it a quick inmemory table and then 
> utilize the whole drill stack on it.  Lots of options.  I just wanted to get 
> this down in an email/JIRA as it was something I found myself wishing I had 
> over and over during data exploration. 
> Fields Currently Returned:
> |name| isDirectory|isFile|length|owner 
> group|permissions|accessTime|modificationTime|



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (DRILL-3698) Expose Show Files Command As SQL for sorting/filtering

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva resolved DRILL-3698.
-
Resolution: Fixed

Implemented in the scope of DRILL-6858.

> Expose Show Files Command As SQL for sorting/filtering
> --
>
> Key: DRILL-3698
> URL: https://issues.apache.org/jira/browse/DRILL-3698
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: SQL Parser
>Affects Versions: Future
> Environment: All
>Reporter: John Omernik
>Assignee: Arina Ielchiieva
>Priority: Major
>  Labels: features
> Fix For: 1.15.0
>
>
> When using drill, I had a workspace setup, and I found myself using the show 
> files command often to find my directories etc. The thing is, the return of 
> show files is not ordered.  And when looking at file system data there are 
> many possible ways to order the results for efficiency as a user.  
> Consider the ls command in unix; the ability to specify different sorting is 
> built in there.  I checked out 
> http://drill.apache.org/docs/show-files-command/ as well as tried the 
> "obvious" show files order by name and that didn't work nor did I see how I 
> could in the documentation. 
> Based on a mailing list discussion there is no way to do that currently in 
> Drill, hence this JIRA I think just adding ORDER BY SQL methodology would be 
> perfect here, you have 8 fields (seen below) and ordering by any one of them, 
> or group of them, with ASC/DESC just like standard SQL order by would be a 
> huge win.  
> I suppose one could potentially ask for WHERE clause (filtering)too, and 
> maybe a select (which fieldsto display) however I am more concerned with the 
> order, but if I had to implement all there I could see examples below:
> (All Three, select, where, and order) (I.e. after "Files" if the token isn't 
> WHERE  or ORDER then check for the fields, if it's not a valid field list 
> error)
> SHOW FILES name, accessTime WHERE name like '%.csv' ORDER BY name;
> (Where clause and order, note the token after FILES is WHERE)
> SHOW FILES WHERE name like '%.csv' ORDER BY length ASC, name DESC;
> (Only Order, ORDER Is the first token after FILES)
> SHOW FILES ORDER BY length ASC, name DESC
> I don't think we have to grant full SQL functionality here (i.e. aggregates), 
> just the ability to display various fields, filter on criteria, and ordering. 
> If you wanted to get fancy, I suppose you could take the table and make it a 
> full on table, i.e. take the results make it a quick inmemory table and then 
> utilize the whole drill stack on it.  Lots of options.  I just wanted to get 
> this down in an email/JIRA as it was something I found myself wishing I had 
> over and over during data exploration. 
> Fields Currently Returned:
> |name| isDirectory|isFile|length|owner 
> group|permissions|accessTime|modificationTime|



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-3698) Expose Show Files Command As SQL for sorting/filtering

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-3698:

Fix Version/s: (was: Future)
   1.15.0

> Expose Show Files Command As SQL for sorting/filtering
> --
>
> Key: DRILL-3698
> URL: https://issues.apache.org/jira/browse/DRILL-3698
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: SQL Parser
>Affects Versions: Future
> Environment: All
>Reporter: John Omernik
>Priority: Major
>  Labels: features
> Fix For: 1.15.0
>
>
> When using drill, I had a workspace setup, and I found myself using the show 
> files command often to find my directories etc. The thing is, the return of 
> show files is not ordered.  And when looking at file system data there are 
> many possible ways to order the results for efficiency as a user.  
> Consider the ls command in unix; the ability to specify different sorting is 
> built in there.  I checked out 
> http://drill.apache.org/docs/show-files-command/ as well as tried the 
> "obvious" show files order by name and that didn't work nor did I see how I 
> could in the documentation. 
> Based on a mailing list discussion there is no way to do that currently in 
> Drill, hence this JIRA I think just adding ORDER BY SQL methodology would be 
> perfect here, you have 8 fields (seen below) and ordering by any one of them, 
> or group of them, with ASC/DESC just like standard SQL order by would be a 
> huge win.  
> I suppose one could potentially ask for WHERE clause (filtering)too, and 
> maybe a select (which fieldsto display) however I am more concerned with the 
> order, but if I had to implement all there I could see examples below:
> (All Three, select, where, and order) (I.e. after "Files" if the token isn't 
> WHERE  or ORDER then check for the fields, if it's not a valid field list 
> error)
> SHOW FILES name, accessTime WHERE name like '%.csv' ORDER BY name;
> (Where clause and order, note the token after FILES is WHERE)
> SHOW FILES WHERE name like '%.csv' ORDER BY length ASC, name DESC;
> (Only Order, ORDER Is the first token after FILES)
> SHOW FILES ORDER BY length ASC, name DESC
> I don't think we have to grant full SQL functionality here (i.e. aggregates), 
> just the ability to display various fields, filter on criteria, and ordering. 
> If you wanted to get fancy, I suppose you could take the table and make it a 
> full on table, i.e. take the results make it a quick inmemory table and then 
> utilize the whole drill stack on it.  Lots of options.  I just wanted to get 
> this down in an email/JIRA as it was something I found myself wishing I had 
> over and over during data exploration. 
> Fields Currently Returned:
> |name| isDirectory|isFile|length|owner 
> group|permissions|accessTime|modificationTime|



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (DRILL-4408) re-written query projecting an aggregate on a boolean not supported by Postgres

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-4408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva reassigned DRILL-4408:
---

Assignee: (was: Taras Supyk)

> re-written query projecting an aggregate on a boolean not supported by 
> Postgres
> ---
>
> Key: DRILL-4408
> URL: https://issues.apache.org/jira/browse/DRILL-4408
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Storage - JDBC
>Affects Versions: 1.5.0
>Reporter: N Campbell
>Priority: Major
>
> select rnum, c1, c2 from postgres.public.tset1 as t1 where exists ( select c1 
> from postgres.public.tset2 where c1 = t1.c1 )
> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the 
> SQL query. 
> sql SELECT *
> FROM "public"."tset1"
> INNER JOIN (SELECT "c10", MIN("$f0") AS "$f1"
> FROM (SELECT "t0"."c1" AS "c10", TRUE AS "$f0"
> FROM "public"."tset2"
> INNER JOIN (SELECT "c1"
> FROM (SELECT "c1"
> FROM "public"."tset1") AS "t"
> GROUP BY "c1") AS "t0" ON "tset2"."c1" = "t0"."c1") AS "t1"
> GROUP BY "c10") AS "t2" ON "tset1"."c1" = "t2"."c10"
> plugin postgres
> Fragment 0:0
> [Error Id: a00cd446-f168-463c-b2b9-bb3d6b43e729 on centos1:31010]
>   (org.postgresql.util.PSQLException) ERROR: function min(boolean) does not 
> exist
>   Hint: No function matches the given name and argument types. You might need 
> to add explicit type casts.
>   Position: 58
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse():2182
> org.postgresql.core.v3.QueryExecutorImpl.processResults():1911
> org.postgresql.core.v3.QueryExecutorImpl.execute():173
> org.postgresql.jdbc.PgStatement.execute():622
> org.postgresql.jdbc.PgStatement.executeWithFlags():458
> org.postgresql.jdbc.PgStatement.executeQuery():374
> org.apache.commons.dbcp.DelegatingStatement.executeQuery():208
> org.apache.commons.dbcp.DelegatingStatement.executeQuery():208
> org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177
> org.apache.drill.exec.physical.impl.ScanBatch.():108
> org.apache.drill.exec.physical.impl.ScanBatch.():136
> org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40
> org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():147
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren():170
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():127
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren():170
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():127
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren():170
> org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():101
> org.apache.drill.exec.physical.impl.ImplCreator.getExec():79
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():230
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1142
> java.util.concurrent.ThreadPoolExecutor$Worker.run():617
> java.lang.Thread.run():745
> SQLState:  null
> ErrorCode: 0
> create table TSET1 (RNUM integer   not null , C1 integer, C2 char(3));
> create table TSET2 (RNUM integer   not null , C1 integer, C2 char(3));



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6973) Improve --run (ability to run query and get result in a good format from command line)

2019-01-21 Thread Arina Ielchiieva (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747926#comment-16747926
 ] 

Arina Ielchiieva commented on DRILL-6973:
-

{quote}
The possibility to display only the last query in the output, or at least the 
possibility to not display the output of command like ALTER SESSION/SYSTEM...
{quote}
Output for DML commands can be controlled via 
{{exec.query.return_result_set_for_ddl}} option.

> Improve --run  (ability to run query and get result in a good format from 
> command line)
> ---
>
> Key: DRILL-6973
> URL: https://issues.apache.org/jira/browse/DRILL-6973
> Project: Apache Drill
>  Issue Type: Wish
>Affects Versions: 1.15.0
>Reporter: benj
>Priority: Major
>
> For a more flexible and minimalist use of DRILL, it would be useful/practical 
> to have more "options" on the --run part.
>  * The formatting of the output : the vertical/csv/json/table/xml... are cool 
> but not simple enough to be simply piped in a shell
>  * The possibility to display only the last query in the output, or at least 
> the possibility to not display the output of command like ALTER 
> SESSION/SYSTEM... 
>  * The formatting of the csv should allow NO QuoteCharacter (in 
> --csvQuoteCharacter) and why not a possibility to allow QuoteCharacter in 
> terms of the type or even of the data itself
> {noformat}
> Currently :
> '1','foo','Drill,baby,drill'
> Still currently (we can change the QuoteCharacter)
> @1@,@foo@,@Drill,baby,drill@
> NEW option 1 - With not quote
> 1,foo,Drill,baby,drill => Ok the third field is problematic here a problem 
> but it's the responsibility of the user and he can use this option when it's 
> appropriate
> NEW option 2 - function of the type 
> 1,'foo','Drill,baby,drill'
> NEW option 3 - function of the data
> 1,foo,'Drill,baby,drill' => (foo doesn't need quote because it does not 
> contain a separator or endofline, but the third field contain separator)
> {noformat}
>  * Maybe some other ideas could be taken up from tools like psql
> Few improvements of the --run would allow more practical use case in a simple 
> way



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6974) SET/SHOW

2019-01-21 Thread Arina Ielchiieva (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747923#comment-16747923
 ] 

Arina Ielchiieva commented on DRILL-6974:
-

I think more common use case would be to have set syntax (similar as done in 
SqlLine):
set `drill.exec.hashagg.fallback.enabled` -> shows current value
set `drill.exec.hashagg.fallback.enabled` = true -> updates property value

> SET/SHOW
> 
>
> Key: DRILL-6974
> URL: https://issues.apache.org/jira/browse/DRILL-6974
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: SQL Parser
>Affects Versions: 1.15.0
>Reporter: benj
>Priority: Major
>
> It's currently possible to define options with the SQL command SET
> {code:java}
> ALTER SESSION SET `drill.exec.hashagg.fallback.enabled` = true;
> {code}
> But it's not possible to simply visualize the current value of one option 
> with SHOW, we have to query like
> {code:java}
> SELECT * FROM sys.options WHERE `name` = 
> 'drill.exec.hashagg.fallback.enabled';
> {code}
> Why not allow a simple
> {code:java}
> SHOW 'drill.exec.hashagg.fallback.enabled';
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6963) create/aggregate/work with array

2019-01-21 Thread benj (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747905#comment-16747905
 ] 

benj commented on DRILL-6963:
-

Sure, for example, PostgreSQL has these kind of functionality
 * Work with array : [https://www.postgresql.org/docs/11/arrays.html]
 * Aggregate in array => array_agg(exp) : 
[https://www.postgresql.org/docs/11/functions-aggregate.html]
 * Some array function and operators : 
[https://www.postgresql.org/docs/9.1/functions-array.html]
 * Some other functions like :
 ** {{regexp_split_to_array}}(text, pattern, flags) : 
[https://www.postgresql.org/docs/current/functions-string.html]

array_agg() is useful, particularly when you group by an item and would like to 
keep some information from another that has variable length / number of line 
concerned in the original table is different for each group.

Example :
{code:java}
With table records
alice;1
alice;2
bob;1
bob;2
bob;3
charles;5

SELECT firstname, array_agg(DISTINCT score ORDER BY score) AS dist_scores
FROM records
GROUP BY firstname;

firstname | dist_score
- | --
alice | {1,2}
bob   | {1,2,3}
charles   | {5}

{code}
 

 

> create/aggregate/work with array
> 
>
> Key: DRILL-6963
> URL: https://issues.apache.org/jira/browse/DRILL-6963
> Project: Apache Drill
>  Issue Type: Wish
>  Components: Functions - Drill
>Reporter: benj
>Priority: Major
>
> * Add the possibility to build array (like : SELECT array[a1,a2,a3...]) - 
> ideally work with all types
>  * Add a default array_agg (like : SELECT col1, array_agg(col2), 
> array_agg(DISTINCT col2) FROM ... GROUP BY col1) ;  - ideally work with all 
> types
>  * Add function/facilities/operator to work with array



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6972) Error: Could not find or load main class sqlline.SqlLine

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6972:

Fix Version/s: 1.16.0

> Error: Could not find or load main class sqlline.SqlLine
> 
>
> Key: DRILL-6972
> URL: https://issues.apache.org/jira/browse/DRILL-6972
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Functions - Drill
>Affects Versions: 1.15.0
> Environment: Windows 10 Education
> 64-bit OS
>Reporter: Elena Campean
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: apache, drill, start
> Fix For: 1.16.0
>
>
> I am running in cmd, the command: sqlline.bat -u "jdbc:drill:zk=local", in 
> order to start drill, but I get the result:
> _DRILL_ARGS - " -u jdbc:drill:zk=local"_
> _The system cannot find the path specified._
> _HADOOP_HOME not detected..._
> _HBASE_HOME not detected..._
> _Calculating Drill classpath..._
> _Error: Could not find or load main class sqlline.SqlLine_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Reviewer: Arina Ielchiieva

> Fix sqlline.bat issues on Windows
> -
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.15.0
> Environment: Windows 10
>Reporter: Volodymyr Vysotskyi
>Assignee: Volodymyr Vysotskyi
>Priority: Major
> Fix For: 1.16.0
>
>
> {{sqlline.bat}} fails for the next cases:
>  1. Specified file in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 2. Specified file path that contains spaces:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> q.sql""=="test" was unexpected at this time.
> {noformat}
> 3. Specified query in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> * was unexpected at this time.
> {noformat}
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> 'a' was unexpected at this time.
> {noformat}
> 4. Specified custom config location:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config=/tmp/conf
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 5. Specified custom config location with spaces in the path:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config="/tmp/conf test"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> test"" was unexpected at this time.
> {noformat}
> 6. Sqlline was run from non-bin directory:
> {noformat}
> apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6962) Function coalesce returns an Error when none of the columns in coalesce exist in a parquet file

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6962:

Reviewer: Volodymyr Vysotskyi

> Function coalesce returns an Error when none of the columns in coalesce exist 
> in a parquet file
> ---
>
> Key: DRILL-6962
> URL: https://issues.apache.org/jira/browse/DRILL-6962
> Project: Apache Drill
>  Issue Type: Improvement
>Affects Versions: 1.13.0
>Reporter: Bohdan Kazydub
>Assignee: Bohdan Kazydub
>Priority: Major
> Fix For: 1.16.0
>
>
> As Drill is schema-free, COALESCE function is expected to return a result and 
> not error out even if none of the columns being referred to exists in files 
> being queried.
> Here is an example for 2 columns, `unk_col` and `unk_col2`, which do not 
> exist in the parquet files
> {code:java}
> select coalesce(unk_col, unk_col2) from dfs.`/tmp/parquetfiles`;
> java.lang.IndexOutOfBoundsException: index (0) must be less than size (0)
> at 
> org.apache.drill.shaded.guava.com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:1196)
> Fragment 1:0
> [Error Id: 7b9193fb-289b-4fbf-a52a-2b93b01f0cd0 on dkvm2c:31010] 
> (state=,code=0)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (DRILL-6985) Fix sqlline.bat issues on Windows

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-6985:

Labels: ready-to-commit  (was: )

> Fix sqlline.bat issues on Windows
> -
>
> Key: DRILL-6985
> URL: https://issues.apache.org/jira/browse/DRILL-6985
> Project: Apache Drill
>  Issue Type: Bug
>Affects Versions: 1.15.0
> Environment: Windows 10
>Reporter: Volodymyr Vysotskyi
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: ready-to-commit
> Fix For: 1.16.0
>
>
> {{sqlline.bat}} fails for the next cases:
>  1. Specified file in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f /tmp/q.sql
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 2. Specified file path that contains spaces:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -f "/tmp/q q.sql"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> q.sql""=="test" was unexpected at this time.
> {noformat}
> 3. Specified query in the argument:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -e "select * 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> * was unexpected at this time.
> {noformat}
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" -q "select 'a' 
> from sys.version"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> 'a' was unexpected at this time.
> {noformat}
> 4. Specified custom config location:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config=/tmp/conf
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}
> 5. Specified custom config location with spaces in the path:
> {noformat}
> apache-drill-1.15.0\bin>sqlline.bat -u "jdbc:drill:zk=local" 
> --config="/tmp/conf test"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> test"" was unexpected at this time.
> {noformat}
> 6. Sqlline was run from non-bin directory:
> {noformat}
> apache-drill-1.15.0>bin\sqlline.bat -u "jdbc:drill:zk=local"
> DRILL_ARGS - " -u jdbc:drill:zk=local"
> HADOOP_HOME not detected...
> HBASE_HOME not detected...
> Calculating Drill classpath...
> Error: Could not find or load main class sqlline.SqlLine
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (DRILL-6972) Error: Could not find or load main class sqlline.SqlLine

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva reassigned DRILL-6972:
---

Assignee: Arina Ielchiieva  (was: Volodymyr Vysotskyi)

> Error: Could not find or load main class sqlline.SqlLine
> 
>
> Key: DRILL-6972
> URL: https://issues.apache.org/jira/browse/DRILL-6972
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Functions - Drill
>Affects Versions: 1.15.0
> Environment: Windows 10 Education
> 64-bit OS
>Reporter: Elena Campean
>Assignee: Arina Ielchiieva
>Priority: Major
>  Labels: apache, drill, start
> Fix For: 1.16.0
>
>
> I am running in cmd, the command: sqlline.bat -u "jdbc:drill:zk=local", in 
> order to start drill, but I get the result:
> _DRILL_ARGS - " -u jdbc:drill:zk=local"_
> _The system cannot find the path specified._
> _HADOOP_HOME not detected..._
> _HBASE_HOME not detected..._
> _Calculating Drill classpath..._
> _Error: Could not find or load main class sqlline.SqlLine_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (DRILL-6972) Error: Could not find or load main class sqlline.SqlLine

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva reassigned DRILL-6972:
---

Assignee: Volodymyr Vysotskyi  (was: Arina Ielchiieva)

> Error: Could not find or load main class sqlline.SqlLine
> 
>
> Key: DRILL-6972
> URL: https://issues.apache.org/jira/browse/DRILL-6972
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Functions - Drill
>Affects Versions: 1.15.0
> Environment: Windows 10 Education
> 64-bit OS
>Reporter: Elena Campean
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: apache, drill, start
> Fix For: 1.16.0
>
>
> I am running in cmd, the command: sqlline.bat -u "jdbc:drill:zk=local", in 
> order to start drill, but I get the result:
> _DRILL_ARGS - " -u jdbc:drill:zk=local"_
> _The system cannot find the path specified._
> _HADOOP_HOME not detected..._
> _HBASE_HOME not detected..._
> _Calculating Drill classpath..._
> _Error: Could not find or load main class sqlline.SqlLine_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (DRILL-6972) Error: Could not find or load main class sqlline.SqlLine

2019-01-21 Thread Arina Ielchiieva (JIRA)


[ 
https://issues.apache.org/jira/browse/DRILL-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747735#comment-16747735
 ] 

Arina Ielchiieva commented on DRILL-6972:
-

We need to fix Windows bat script be able to run from any directory.

> Error: Could not find or load main class sqlline.SqlLine
> 
>
> Key: DRILL-6972
> URL: https://issues.apache.org/jira/browse/DRILL-6972
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Functions - Drill
>Affects Versions: 1.15.0
> Environment: Windows 10 Education
> 64-bit OS
>Reporter: Elena Campean
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: apache, drill, start
> Fix For: 1.16.0
>
>
> I am running in cmd, the command: sqlline.bat -u "jdbc:drill:zk=local", in 
> order to start drill, but I get the result:
> _DRILL_ARGS - " -u jdbc:drill:zk=local"_
> _The system cannot find the path specified._
> _HADOOP_HOME not detected..._
> _HBASE_HOME not detected..._
> _Calculating Drill classpath..._
> _Error: Could not find or load main class sqlline.SqlLine_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Reopened] (DRILL-6972) Error: Could not find or load main class sqlline.SqlLine

2019-01-21 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva reopened DRILL-6972:
-
  Assignee: Volodymyr Vysotskyi

> Error: Could not find or load main class sqlline.SqlLine
> 
>
> Key: DRILL-6972
> URL: https://issues.apache.org/jira/browse/DRILL-6972
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Functions - Drill
>Affects Versions: 1.15.0
> Environment: Windows 10 Education
> 64-bit OS
>Reporter: Elena Campean
>Assignee: Volodymyr Vysotskyi
>Priority: Major
>  Labels: apache, drill, start
>
> I am running in cmd, the command: sqlline.bat -u "jdbc:drill:zk=local", in 
> order to start drill, but I get the result:
> _DRILL_ARGS - " -u jdbc:drill:zk=local"_
> _The system cannot find the path specified._
> _HADOOP_HOME not detected..._
> _HBASE_HOME not detected..._
> _Calculating Drill classpath..._
> _Error: Could not find or load main class sqlline.SqlLine_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)