[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60516825
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60517037
  
  [Test build #22244 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22244/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60517844
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22244/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60517842
  
  [Test build #22244 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22244/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60518234
  
  [Test build #22246 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22246/consoleFull)
 for   PR 2816 at commit 
[`8c07bc7`](https://github.com/apache/spark/commit/8c07bc763827f873bc3192d50bda88c786754c9f).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60519191
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22246/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60519189
  
  [Test build #22246 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22246/consoleFull)
 for   PR 2816 at commit 
[`8c07bc7`](https://github.com/apache/spark/commit/8c07bc763827f873bc3192d50bda88c786754c9f).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread sarutak
GitHub user sarutak opened a pull request:

https://github.com/apache/spark/pull/2949

[SPARK-3959][SPARK-3960][SQL] SqlParser fails to parse literal 
-9223372036854775808 (Long.MinValue). / We can apply unary minus only to 
literal.

SqlParser fails to parse -9223372036854775808 (Long.MinValue) so we cannot 
write queries such like as follows.

SELECT value FROM someTable WHERE value  -9223372036854775808

Additionally, because of the wrong syntax definition, we cannot apply unary 
minus only to literal. So, we cannot write such expressions.

-(value1 + value2) // Parenthesized expressions
-column // Columns
-MAX(column) // Functions

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sarutak/spark spark-sql-dsl-improvement2-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/2949.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2949


commit 8f67b633cae3d8b017b5a4ae35ae8ec589a2e322
Author: Kousuke Saruta saru...@oss.nttdata.co.jp
Date:   2014-10-26T19:48:47Z

Fixed SPARK-3959 and SPARK-3960




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2949#issuecomment-60529652
  
  [Test build #22252 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22252/consoleFull)
 for   PR 2949 at commit 
[`8f67b63`](https://github.com/apache/spark/commit/8f67b633cae3d8b017b5a4ae35ae8ec589a2e322).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2949#issuecomment-60530799
  
  [Test build #22252 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22252/consoleFull)
 for   PR 2949 at commit 
[`8f67b63`](https://github.com/apache/spark/commit/8f67b633cae3d8b017b5a4ae35ae8ec589a2e322).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2949#issuecomment-60530806
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22252/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread sarutak
Github user sarutak closed the pull request at:

https://github.com/apache/spark/pull/2949


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-6053
  
  [Test build #22256 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22256/consoleFull)
 for   PR 2816 at commit 
[`c2bab5e`](https://github.com/apache/spark/commit/c2bab5ebbcdc3c7ed1d66e9b719109f66b326e58).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60533154
  
  [Test build #454 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/454/consoleFull)
 for   PR 2816 at commit 
[`c2bab5e`](https://github.com/apache/spark/commit/c2bab5ebbcdc3c7ed1d66e9b719109f66b326e58).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60533346
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22256/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60533343
  
  [Test build #22256 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22256/consoleFull)
 for   PR 2816 at commit 
[`c2bab5e`](https://github.com/apache/spark/commit/c2bab5ebbcdc3c7ed1d66e9b719109f66b326e58).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60533657
  
  [Test build #22259 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22259/consoleFull)
 for   PR 2816 at commit 
[`32a5005`](https://github.com/apache/spark/commit/32a5005cc9100ad16580a09c218b96b3cdd04636).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60534496
  
  [Test build #454 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/454/consoleFull)
 for   PR 2816 at commit 
[`c2bab5e`](https://github.com/apache/spark/commit/c2bab5ebbcdc3c7ed1d66e9b719109f66b326e58).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60535201
  
  [Test build #463 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/463/consoleFull)
 for   PR 2816 at commit 
[`32a5005`](https://github.com/apache/spark/commit/32a5005cc9100ad16580a09c218b96b3cdd04636).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60536785
  
  [Test build #22259 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22259/consoleFull)
 for   PR 2816 at commit 
[`32a5005`](https://github.com/apache/spark/commit/32a5005cc9100ad16580a09c218b96b3cdd04636).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60536788
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22259/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60536997
  
  [Test build #463 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/463/consoleFull)
 for   PR 2816 at commit 
[`32a5005`](https://github.com/apache/spark/commit/32a5005cc9100ad16580a09c218b96b3cdd04636).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread marmbrus
Github user marmbrus commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60537666
  
Awesome, thanks for doing this and for all the test cases!  Merged to 
master.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-26 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/2816


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60474895
  
  [Test build #22204 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22204/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60475563
  
  [Test build #22204 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22204/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class SparkContext(config: SparkConf) extends SparkStatusAPI with 
Logging `
  * `  class JobUIData(`
  * `public final class JavaStatusAPIDemo `
  * `  public static final class IdentityWithDelayT implements 
FunctionT, T `



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60475566
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22204/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60475704
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60475848
  
  [Test build #22213 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22213/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60476545
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22213/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60476543
  
  [Test build #22213 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22213/consoleFull)
 for   PR 2816 at commit 
[`13b78fe`](https://github.com/apache/spark/commit/13b78fe18e5646c9680f1d655c1ecc10247961b8).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-24 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60381288
  
/CC @marmbrus 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-22 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60049213
  
@yhuai I could fix what you pointed. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-22 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60049567
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22029/consoleFull)
 for   PR 2816 at commit 
[`58be459`](https://github.com/apache/spark/commit/58be459c9d9cd69aa3d9007b102dddf83237f034).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-22 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60055358
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22029/consoleFull)
 for   PR 2816 at commit 
[`58be459`](https://github.com/apache/spark/commit/58be459c9d9cd69aa3d9007b102dddf83237f034).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60055364
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22029/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-21 Thread yhuai
Github user yhuai commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60027697
  
@sarutak Can you also move [this related 
test](https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/json/JsonSuite.scala#L421)
 out of `ignore`? Thank you:)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-21 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-60035199
  
@yhuai Thanks for pointing. Actually we cannot still move it out from 
ignore because 92233720368547758061.2 is BigDecimal type but num_str + 1.2 is 
Double type so comparing fails.
In Spark SQL, floating-point-number literal is represented as Double type 
and arithmetic operation one of which operand is String results Double type.
I think we need another discussion for the type of floating-point-number 
literal and implicit cast.
I'll open another PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59724233
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21913/consoleFull)
 for   PR 2816 at commit 
[`a580dd4`](https://github.com/apache/spark/commit/a580dd436d007265ed6cdba9666f9d27e3025f57).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59732528
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21913/consoleFull)
 for   PR 2816 at commit 
[`a580dd4`](https://github.com/apache/spark/commit/a580dd436d007265ed6cdba9666f9d27e3025f57).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59732530
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21913/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59857250
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21938/consoleFull)
 for   PR 2816 at commit 
[`025374c`](https://github.com/apache/spark/commit/025374cc90790278e7d10cb06cc7976fd177a941).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59857548
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21938/consoleFull)
 for   PR 2816 at commit 
[`025374c`](https://github.com/apache/spark/commit/025374cc90790278e7d10cb06cc7976fd177a941).
 * This patch **fails to build**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59857551
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21938/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59860458
  
retest this please.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread marmbrus
Github user marmbrus commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59860616
  
ok to test


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59861153
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21942/consoleFull)
 for   PR 2816 at commit 
[`025374c`](https://github.com/apache/spark/commit/025374cc90790278e7d10cb06cc7976fd177a941).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59865472
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21942/consoleFull)
 for   PR 2816 at commit 
[`025374c`](https://github.com/apache/spark/commit/025374cc90790278e7d10cb06cc7976fd177a941).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59865477
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21942/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59649582
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21890/consoleFull)
 for   PR 2816 at commit 
[`5c847ac`](https://github.com/apache/spark/commit/5c847aca4e7d618dee7b8c647bdca6f845d328e3).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59650495
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21890/consoleFull)
 for   PR 2816 at commit 
[`5c847ac`](https://github.com/apache/spark/commit/5c847aca4e7d618dee7b8c647bdca6f845d328e3).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59650498
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21890/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59650806
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59650907
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21892/consoleFull)
 for   PR 2816 at commit 
[`5c847ac`](https://github.com/apache/spark/commit/5c847aca4e7d618dee7b8c647bdca6f845d328e3).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59652376
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21892/consoleFull)
 for   PR 2816 at commit 
[`5c847ac`](https://github.com/apache/spark/commit/5c847aca4e7d618dee7b8c647bdca6f845d328e3).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59652379
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21892/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-17 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59470604
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21846/consoleFull)
 for   PR 2816 at commit 
[`96cfcbb`](https://github.com/apache/spark/commit/96cfcbb8c7b3c5de4eae599f92c5c0d659b22ab7).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59470610
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21846/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59342873
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21802/consoleFull)
 for   PR 2816 at commit 
[`037a948`](https://github.com/apache/spark/commit/037a9488ef36bd8971f90556663b31456e628314).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59345860
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21802/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59345856
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21802/consoleFull)
 for   PR 2816 at commit 
[`037a948`](https://github.com/apache/spark/commit/037a9488ef36bd8971f90556663b31456e628314).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59346655
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21803/consoleFull)
 for   PR 2816 at commit 
[`735c1fe`](https://github.com/apache/spark/commit/735c1fed46c14158698d4c2434d7c5f2e3e24213).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59351094
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21803/consoleFull)
 for   PR 2816 at commit 
[`735c1fe`](https://github.com/apache/spark/commit/735c1fed46c14158698d4c2434d7c5f2e3e24213).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59351102
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21803/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18952642
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
--- End diff --

Same as above.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18952637
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
--- End diff --

Please keep the naming convention consistent, either use `numericLit` or 
rename all `xxxLit` to `xxxLiteral`.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18952768
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
--- End diff --

Sorry, just found out that `numericLit` is a member of `StdTokenParsers`. 
Then this naming is alright.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18952827
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
 )
 
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral | floatLit ^^ { f = 
Literal(f.toDouble) }
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+sign ~ numericLit  ^^ { case s ~ l = Literal(getProperTypeInt(s + l)) 
}
--- End diff --

Sign should be optional:

```scala
sign.? ~ numericLit ^^
{ case s ~ l = Literal(getProperTypeInt(s.getOrElse() + l)) }
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18952854
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
 )
 
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral | floatLit ^^ { f = 
Literal(f.toDouble) }
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+sign ~ numericLit  ^^ { case s ~ l = Literal(getProperTypeInt(s + l)) 
}
+
+
+  protected lazy val unsignedNumericLiteral: Parser[Literal] =
+numericLit ^^ { n = Literal(getProperTypeInt(n)) }
+
+
+  private val longMax = BigDecimal(s${Long.MaxValue})
+  private val longMin = BigDecimal(s${Long.MinValue})
+  private val intMax = BigDecimal(s${Int.MaxValue})
+  private val intMin = BigDecimal(s${Int.MinValue})
+
+  private def getProperTypeInt(value: String) = {
+val bigIntValue = BigDecimal(value)
+
+if (value.startsWith(-)) {
+  if (bigIntValue  intMin) {
+if (bigIntValue  longMin) {
+  bigIntValue
+} else {
+  value.toLong
+}
+  } else {
+value.toInt
+  }
+} else {
+  if (bigIntValue  intMax) {
+if (bigIntValue  longMax) {
+  bigIntValue
+} else {
+  value.toLong
+}
+  } else {
+value.toInt
+  }
+}
+  }
+
   protected lazy val floatLit: Parser[String] =
-elem(decimal, _.isInstanceOf[lexical.FloatLit]) ^^ (_.chars)
+( opt(sign) ~ . ~ unsignedNumericLiteral ^^ {
--- End diff --

I'd prefer the `sign.?` syntax here.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18953268
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -323,11 +373,11 @@ class SqlParser extends AbstractSparkSQLParser {
 | cast
 | ( ~ expression ~ )
 | function
-| - ~ literal ^^ UnaryMinus
 | dotExpressionHeader
 | ident ^^ UnresolvedAttribute
 | * ^^^ Star(None)
 | literal
+| sign ~ expression ^^ { case s ~ e = if (s == -) UnaryMinus(e) 
else e }
--- End diff --

Sign should be optional. Also I think it would be better to move this rule 
to the last alternative of `comparisonExpression`, namely from:

```scala
| termExpression
```

to

```scala
| sign.? ~ termExpression ^^ {
case Some(-) ~ e = UnaryMinus(e)
case _ = e
  }
```

The reason is that the type of `termExpression` is guaranteed to be numeric.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18953527
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
 )
 
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral | floatLit ^^ { f = 
Literal(f.toDouble) }
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+sign ~ numericLit  ^^ { case s ~ l = Literal(getProperTypeInt(s + l)) 
}
+
+
+  protected lazy val unsignedNumericLiteral: Parser[Literal] =
+numericLit ^^ { n = Literal(getProperTypeInt(n)) }
+
+
+  private val longMax = BigDecimal(s${Long.MaxValue})
+  private val longMin = BigDecimal(s${Long.MinValue})
+  private val intMax = BigDecimal(s${Int.MaxValue})
+  private val intMin = BigDecimal(s${Int.MinValue})
+
+  private def getProperTypeInt(value: String) = {
--- End diff --

How about `toNarrowestNumericType`?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18953740
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
 )
 
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral | floatLit ^^ { f = 
Literal(f.toDouble) }
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+sign ~ numericLit  ^^ { case s ~ l = Literal(getProperTypeInt(s + l)) 
}
+
+
+  protected lazy val unsignedNumericLiteral: Parser[Literal] =
+numericLit ^^ { n = Literal(getProperTypeInt(n)) }
+
+
+  private val longMax = BigDecimal(s${Long.MaxValue})
+  private val longMin = BigDecimal(s${Long.MinValue})
+  private val intMax = BigDecimal(s${Int.MaxValue})
+  private val intMin = BigDecimal(s${Int.MinValue})
+
+  private def getProperTypeInt(value: String) = {
+val bigIntValue = BigDecimal(value)
+
+if (value.startsWith(-)) {
+  if (bigIntValue  intMin) {
+if (bigIntValue  longMin) {
+  bigIntValue
+} else {
+  value.toLong
+}
+  } else {
+value.toInt
+  }
+} else {
+  if (bigIntValue  intMax) {
+if (bigIntValue  longMax) {
+  bigIntValue
+} else {
+  value.toLong
+}
+  } else {
+value.toInt
+  }
+}
--- End diff --

How about this:

```scala
bigIntValue match {
  case v if v  longMin || v  longMax = v
  case v if v  intMin  || v  intMax  = v.toLong
  case v   = v.toInt
}
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18953909
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,17 +301,67 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+( numericLiteral
 | NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
 )
 
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral | floatLit ^^ { f = 
Literal(f.toDouble) }
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+sign ~ numericLit  ^^ { case s ~ l = Literal(getProperTypeInt(s + l)) 
}
--- End diff --

Ah, I see, you made signed and unsigned numerics into two branches.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59392306
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21809/consoleFull)
 for   PR 2816 at commit 
[`938ba13`](https://github.com/apache/spark/commit/938ba13757b0979fd93185f901f1ebc26efb9caf).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59399435
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21809/consoleFull)
 for   PR 2816 at commit 
[`938ba13`](https://github.com/apache/spark/commit/938ba13757b0979fd93185f901f1ebc26efb9caf).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59399446
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21809/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18993345
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,33 +301,78 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
-| NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+(  signedLiteral
+|unsignedNumericLiteral
--- End diff --

Indentation is off in these two lines.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18993402
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,33 +301,78 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
-| NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+(  signedLiteral
+|unsignedNumericLiteral
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
+| NULL ^^^ Literal(null, NullType)
+)
+
+  protected lazy val signedLiteral: Parser[Literal] =
--- End diff --

Seems that this rule is redundant?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread liancheng
Github user liancheng commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59458384
  
LGTM except for minor styling issues. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59460731
  
@liancheng Thanks for your advice!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59461663
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21836/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59461721
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59462076
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21840/consoleFull)
 for   PR 2816 at commit 
[`56817b1`](https://github.com/apache/spark/commit/56817b196136447f26c26c2b4088c408acd66cdc).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59464602
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21840/consoleFull)
 for   PR 2816 at commit 
[`56817b1`](https://github.com/apache/spark/commit/56817b196136447f26c26c2b4088c408acd66cdc).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59464604
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21840/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r19001459
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,33 +301,75 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
-| NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+( signedNumericLiteral
+| unsignedNumericLiteral
--- End diff --

We could just use `numericLiteral` here to replace above 2 lines.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r19001491
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,33 +301,75 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
-| NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+( signedNumericLiteral
+| unsignedNumericLiteral
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
+| NULL ^^^ Literal(null, NullType)
+)
+
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+( sign ~ numericLit  ^^ { case s ~ l = 
Literal(toNarrowestIntegerType(s + l)) }
+| sign ~ floatLit ^^ { case s ~ f = Literal((s + f).toDouble) }
+)
+
+  protected lazy val unsignedNumericLiteral: Parser[Literal] =
+( numericLit ^^ { n = Literal(toNarrowestIntegerType(n)) }
+| floatLit ^^ { f = Literal(f.toDouble) }
 )
 
+  private val longMax = BigDecimal(s${Long.MaxValue})
+  private val longMin = BigDecimal(s${Long.MinValue})
+  private val intMax = BigDecimal(s${Int.MaxValue})
+  private val intMin = BigDecimal(s${Int.MinValue})
+
+  private def toNarrowestIntegerType(value: String) = {
+val bigIntValue = BigDecimal(value)
+
+bigIntValue match {
+  case v if v  longMin || v  longMax = v
+  case v if v  intMin || v  intMax = v.toLong
+  case v = v.toInt
+}
+  }
+
   protected lazy val floatLit: Parser[String] =
-elem(decimal, _.isInstanceOf[lexical.FloatLit]) ^^ (_.chars)
+( . ~ unsignedNumericLiteral ^^ { u = 0. + u }
+| elem(decimal, _.isInstanceOf[lexical.FloatLit]) ^^ (_.chars)
+)
 
   protected lazy val baseExpression: PackratParser[Expression] =
-( expression ~ ([ ~ expression ~ ]) ^^
+( * ^^^ Star(None)
+| primary
+| signedPrimary
--- End diff --

I think we don't need this line here, as `primary` include `signedPrimary`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r19001551
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -301,33 +301,75 @@ class SqlParser extends AbstractSparkSQLParser {
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
   protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
-| NULL ^^^ Literal(null, NullType)
-| floatLit ^^ {case f = Literal(f.toDouble) }
+( signedNumericLiteral
+| unsignedNumericLiteral
+| booleanLiteral
 | stringLit ^^ {case s = Literal(s, StringType) }
+| NULL ^^^ Literal(null, NullType)
+)
+
+  protected lazy val booleanLiteral: Parser[Literal] =
+( TRUE ^^^ Literal(true, BooleanType)
+| FALSE ^^^ Literal(false, BooleanType)
+)
+
+  protected lazy val numericLiteral: Parser[Literal] =
+signedNumericLiteral | unsignedNumericLiteral
+
+  protected lazy val sign: Parser[String] =
++ | -
+
+  protected lazy val signedNumericLiteral: Parser[Literal] =
+( sign ~ numericLit  ^^ { case s ~ l = 
Literal(toNarrowestIntegerType(s + l)) }
+| sign ~ floatLit ^^ { case s ~ f = Literal((s + f).toDouble) }
+)
+
+  protected lazy val unsignedNumericLiteral: Parser[Literal] =
+( numericLit ^^ { n = Literal(toNarrowestIntegerType(n)) }
+| floatLit ^^ { f = Literal(f.toDouble) }
 )
 
+  private val longMax = BigDecimal(s${Long.MaxValue})
+  private val longMin = BigDecimal(s${Long.MinValue})
+  private val intMax = BigDecimal(s${Int.MaxValue})
+  private val intMin = BigDecimal(s${Int.MinValue})
+
+  private def toNarrowestIntegerType(value: String) = {
+val bigIntValue = BigDecimal(value)
+
+bigIntValue match {
+  case v if v  longMin || v  longMax = v
+  case v if v  intMin || v  intMax = v.toLong
+  case v = v.toInt
+}
+  }
+
   protected lazy val floatLit: Parser[String] =
-elem(decimal, _.isInstanceOf[lexical.FloatLit]) ^^ (_.chars)
+( . ~ unsignedNumericLiteral ^^ { u = 0. + u }
+| elem(decimal, _.isInstanceOf[lexical.FloatLit]) ^^ (_.chars)
+)
 
   protected lazy val baseExpression: PackratParser[Expression] =
--- End diff --

Now the `baseExpression` don't have recursion explicitly, we can define it 
as normal `Parser`, and define `primary` as `PackratParser`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59466816
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21845/consoleFull)
 for   PR 2816 at commit 
[`96cfcbb`](https://github.com/apache/spark/commit/96cfcbb8c7b3c5de4eae599f92c5c0d659b22ab7).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59467174
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21844/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread sarutak
Github user sarutak commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59467617
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59467818
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21846/consoleFull)
 for   PR 2816 at commit 
[`96cfcbb`](https://github.com/apache/spark/commit/96cfcbb8c7b3c5de4eae599f92c5c0d659b22ab7).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59469454
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21845/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-16 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59469449
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21845/consoleFull)
 for   PR 2816 at commit 
[`96cfcbb`](https://github.com/apache/spark/commit/96cfcbb8c7b3c5de4eae599f92c5c0d659b22ab7).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread sarutak
GitHub user sarutak opened a pull request:

https://github.com/apache/spark/pull/2816

[SPARK-3959][SPARK-3960][SQL] SqlParser fails to parse literal 
-9223372036854775808 (Long.MinValue). / We can apply unary minus only to 
literal.

SqlParser fails to parse -9223372036854775808 (Long.MinValue) so we cannot 
write queries such like as follows.

SELECT value FROM someTable WHERE value  -9223372036854775808

Additionally, because of the wrong syntax definition, we cannot apply unary 
minus only to literal. So, we cannot write such expressions.

-(value1 + value2) // Parenthesized expressions
-column // Columns
-MAX(column) // Functions

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sarutak/spark spark-sql-dsl-improvement2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/2816.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2816


commit 6e0b6d7361b630994219d4efea66c8c38e90531a
Author: Kousuke Saruta saru...@oss.nttdata.co.jp
Date:   2014-10-15T11:06:21Z

WIP

commit 54b12a1de6d89caeec5efe54d3a1c7e738c82e9a
Author: Kousuke Saruta saru...@oss.nttdata.co.jp
Date:   2014-10-15T21:25:51Z

Added some more tests to SQLQuerySuite




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59281039
  
  [QA tests have 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21778/consoleFull)
 for   PR 2816 at commit 
[`54b12a1`](https://github.com/apache/spark/commit/54b12a1de6d89caeec5efe54d3a1c7e738c82e9a).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59287331
  
  [QA tests have 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21778/consoleFull)
 for   PR 2816 at commit 
[`54b12a1`](https://github.com/apache/spark/commit/54b12a1de6d89caeec5efe54d3a1c7e738c82e9a).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/2816#issuecomment-59287338
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21778/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18933714
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -300,11 +300,15 @@ class SqlParser extends AbstractSparkSQLParser {
   protected lazy val cast: Parser[Expression] =
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
-  protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+  protected lazy val generalLiteral: Parser[Literal] =
+( unsignedNumericLiteral ^^ {
+  case n =
--- End diff --

why not follow the origin format `case i if i.toLong  Int.MaxValue = 
Literal(i.toLong)` which looks compact.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-3959][SPARK-3960][SQL] SqlParser fails ...

2014-10-15 Thread sarutak
Github user sarutak commented on a diff in the pull request:

https://github.com/apache/spark/pull/2816#discussion_r18933954
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala ---
@@ -300,11 +300,15 @@ class SqlParser extends AbstractSparkSQLParser {
   protected lazy val cast: Parser[Expression] =
 CAST ~ ( ~ expression ~ (AS ~ dataType) ~ ) ^^ { case exp ~ t 
= Cast(exp, t) }
 
-  protected lazy val literal: Parser[Literal] =
-( numericLit ^^ {
-case i if i.toLong  Int.MaxValue = Literal(i.toLong)
-case i = Literal(i.toInt)
-  }
+  protected lazy val generalLiteral: Parser[Literal] =
+( unsignedNumericLiteral ^^ {
+  case n =
--- End diff --

In the original code, variable i is always unsigned numeric expressed as 
String. If i is 9223372036854775808, i.toLong should fail because Long is 
between -9223372036854775808 and 9223372036854775807.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



  1   2   >