[jira] [Created] (SPARK-23275) hive/tests have been failing when run locally on the laptop (Mac) with OOM

2018-01-30 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-23275: Summary: hive/tests have been failing when run locally on the laptop (Mac) with OOM Key: SPARK-23275 URL: https://issues.apache.org/jira/browse/SPARK-23275 Project

[jira] [Updated] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

2018-01-16 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-23095: - Description: The following SQL involving scalar correlated query returns a map exception

[jira] [Updated] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

2018-01-16 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-23095: - Description: The following SQL involving scalar correlated query returns a map exception

[jira] [Created] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

2018-01-16 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-23095: Summary: Decorrelation of scalar subquery fails with java.util.NoSuchElementException. Key: SPARK-23095 URL: https://issues.apache.org/jira/browse/SPARK-23095

Re: Welcoming Tejas Patil as a Spark committer

2017-10-03 Thread Dilip Biswal
Congratulations , Tejas!   -- Dilip     - Original message -From: Suresh Thalamati To: "dev@spark.apache.org" Cc:Subject: Re: Welcoming Tejas Patil as a Spark committerDate: Tue, Oct 3, 2017 12:01 PM  Congratulations , Tejas!-suresh> On Sep

Re: Welcoming Saisai (Jerry) Shao as a committer

2017-08-29 Thread Dilip Biswal
Congratulations, Jerry!   Regards,Dilip Biswal      - Original message -From: Takuya UESHIN <ues...@happy-camper.st>To: Saisai Shao <sai.sai.s...@gmail.com>Cc: dev <dev@spark.apache.org>Subject: Re: Welcoming Saisai (Jerry) Shao as a committerDate: Mon, Aug

[jira] [Created] (SPARK-21599) Collecting column statistics for datasource tables may fail with java.util.NoSuchElementException

2017-08-01 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-21599: Summary: Collecting column statistics for datasource tables may fail with java.util.NoSuchElementException Key: SPARK-21599 URL: https://issues.apache.org/jira/browse/SPARK-21599

[jira] [Commented] (SPARK-20417) Move error reporting for subquery from Analyzer to CheckAnalysis

2017-04-20 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977286#comment-15977286 ] Dilip Biswal commented on SPARK-20417: -- Currently waiting on [pr 17636|https://github.com/apache

[jira] [Created] (SPARK-20417) Move error reporting for subquery from Analyzer to CheckAnalysis

2017-04-20 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-20417: Summary: Move error reporting for subquery from Analyzer to CheckAnalysis Key: SPARK-20417 URL: https://issues.apache.org/jira/browse/SPARK-20417 Project: Spark

[jira] [Commented] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-18 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973929#comment-15973929 ] Dilip Biswal commented on SPARK-20356: -- [~viirya] Did you try from spark-shell or from one of our

[jira] [Comment Edited] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-18 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973455#comment-15973455 ] Dilip Biswal edited comment on SPARK-20356 at 4/18/17 8:47 PM: --- [~viirya

[jira] [Comment Edited] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-18 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973455#comment-15973455 ] Dilip Biswal edited comment on SPARK-20356 at 4/18/17 8:46 PM: --- [~viirya

[jira] [Commented] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-18 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973455#comment-15973455 ] Dilip Biswal commented on SPARK-20356: -- [~viirya] [~hvanhovell] [~cloud_fan] [~smilegator] I took

[jira] [Created] (SPARK-20334) Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references

2017-04-13 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-20334: Summary: Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references Key: SPARK-20334 URL: https

[jira] [Created] (SPARK-19993) Caching logical plans containing subquery expressions does not work.

2017-03-17 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-19993: Summary: Caching logical plans containing subquery expressions does not work. Key: SPARK-19993 URL: https://issues.apache.org/jira/browse/SPARK-19993 Project: Spark

Re: welcoming Takuya Ueshin as a new Apache Spark committer

2017-02-13 Thread Dilip Biswal
Congratulations, Takuya!   Regards,Dilip BiswalTel: 408-463-4980dbis...@us.ibm.com     - Original message -From: Takeshi Yamamuro To: dev Cc:Subject: Re: welcoming Takuya Ueshin as a new Apache Spark committerDate: Mon, Feb 13, 2017 2:14 PM 

[jira] [Created] (SPARK-18533) Raise correct error upon specification of schema for datasource tables created through CTAS

2016-11-21 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-18533: Summary: Raise correct error upon specification of schema for datasource tables created through CTAS Key: SPARK-18533 URL: https://issues.apache.org/jira/browse/SPARK-18533

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609295#comment-15609295 ] Dilip Biswal commented on SPARK-18009: -- [~martha.solarte] Not sure [~smilegator] Sean, do we back

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607343#comment-15607343 ] Dilip Biswal commented on SPARK-18009: -- [~smilegator][~jerryjung] [~martha.solarte] Thanks. I am

[jira] [Created] (SPARK-17860) SHOW COLUMN's database conflict check should use case sensitive compare.

2016-10-10 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-17860: Summary: SHOW COLUMN's database conflict check should use case sensitive compare. Key: SPARK-17860 URL: https://issues.apache.org/jira/browse/SPARK-17860 Project

[jira] [Updated] (SPARK-17860) SHOW COLUMN's database conflict check should respect case sensitivity setting

2016-10-10 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-17860: - Summary: SHOW COLUMN's database conflict check should respect case sensitivity setting

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Dilip Biswal
Hi Xiao, Congratulations Xiao !! This is indeed very well deserved !! Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Reynold Xin <r...@databricks.com> To: "dev@spark.apache.org" <dev@spark.apache.org>, Xiao Li <gatorsm...@gmail.com>

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-10-03 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543141#comment-15543141 ] Dilip Biswal commented on SPARK-17709: -- @ashrowty Hi Ashish, in your example, the column

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-10-03 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543046#comment-15543046 ] Dilip Biswal commented on SPARK-17709: -- Hi Ashish, Thanks a lot.. will try and get back. > sp

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537336#comment-15537336 ] Dilip Biswal commented on SPARK-17709: -- [~ashrowty] Hmmn.. and your join keys are companyid

[jira] [Comment Edited] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537205#comment-15537205 ] Dilip Biswal edited comment on SPARK-17709 at 9/30/16 10:07 PM: @ashrowty

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537205#comment-15537205 ] Dilip Biswal commented on SPARK-17709: -- @ashrowty Hi Ashish, is it possible for you to post explain

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536464#comment-15536464 ] Dilip Biswal commented on SPARK-17709: -- [~ashrowty] Ashish, you have the same column name as regular

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-29 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534434#comment-15534434 ] Dilip Biswal commented on SPARK-17709: -- [~smilegator] Sure. > spark 2.0 join - column resolut

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-29 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534417#comment-15534417 ] Dilip Biswal commented on SPARK-17709: -- [~smilegator] Hi Sean, I tried it on my master branch

[jira] [Commented] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511267#comment-15511267 ] Dilip Biswal commented on SPARK-17620: -- fix it now. Thanks! > hive.default.fileformat=orc d

[jira] [Commented] (SPARK-16423) Inconsistent settings on the first day of a week

2016-07-09 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15369006#comment-15369006 ] Dilip Biswal commented on SPARK-16423: -- [~yhuai] [~smilegator] Just wanted to quickly share

[jira] [Updated] (SPARK-16195) Allow users to specify empty over clause in window expressions through dataset API

2016-06-24 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-16195: - Description: In SQL, its allowed to specify an empty OVER clause in the window expression

[jira] [Created] (SPARK-16195) Allow users to specify empty over clause in window expressions through dataset API

2016-06-24 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-16195: Summary: Allow users to specify empty over clause in window expressions through dataset API Key: SPARK-16195 URL: https://issues.apache.org/jira/browse/SPARK-16195

[jira] [Commented] (SPARK-15634) SQL repl is bricked if a function is registered with a non-existent jar

2016-05-27 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305143#comment-15305143 ] Dilip Biswal commented on SPARK-15634: -- I would like to work on this issue. > SQL repl is bric

[jira] [Comment Edited] (SPARK-15557) expression ((cast(99 as decimal) + '3') * '2.3' ) return null

2016-05-27 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304782#comment-15304782 ] Dilip Biswal edited comment on SPARK-15557 at 5/27/16 9:09 PM: --- I am

[jira] [Commented] (SPARK-15557) expression ((cast(99 as decimal) + '3') * '2.3' ) return null

2016-05-27 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304782#comment-15304782 ] Dilip Biswal commented on SPARK-15557: -- I am looking into this issue. > expression ((cast

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-10 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279229#comment-15279229 ] Dilip Biswal commented on SPARK-15114: -- Going to submit a PR for this tonight. > Column n

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271972#comment-15271972 ] Dilip Biswal commented on SPARK-15114: -- [~yhuai] Sure Yin. I will give it a try. > Column n

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-04 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271351#comment-15271351 ] Dilip Biswal commented on SPARK-15114: -- [~yhuai] Currently we use the sql representation

[jira] [Commented] (SPARK-14947) Showtable Command - Can't List Tables Using JDBC Connector

2016-04-27 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259692#comment-15259692 ] Dilip Biswal commented on SPARK-14947: -- [~raymond.honderd...@sizmek.com] Hi Raymond, could you

[jira] [Commented] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-04-18 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246796#comment-15246796 ] Dilip Biswal commented on SPARK-13698: -- [~cloud_fan] Hi Wenchen, Can you please help to fix

[jira] [Commented] (SPARK-14121) Show commands (Native)

2016-04-06 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228932#comment-15228932 ] Dilip Biswal commented on SPARK-14121: -- I will submit a pull request for SHOW COLUMNS and SHOW

[jira] [Updated] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-02 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-14348: - Summary: Support native execution of SHOW TBLPROPERTIES command (was: Support native execution

[jira] [Created] (SPARK-14348) Support native execution of SHOW DATABASE command

2016-04-02 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-14348: Summary: Support native execution of SHOW DATABASE command Key: SPARK-14348 URL: https://issues.apache.org/jira/browse/SPARK-14348 Project: Spark Issue Type

[jira] [Commented] (SPARK-14121) Show commands (Native)

2016-03-27 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213743#comment-15213743 ] Dilip Biswal commented on SPARK-14121: -- Just submitted a PR for SHOW TABLES and SHOW DATABASES

[jira] [Created] (SPARK-14184) Support native execution of SHOW DATABASE command and fix SHOW TABLE to use table identifier pattern

2016-03-27 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-14184: Summary: Support native execution of SHOW DATABASE command and fix SHOW TABLE to use table identifier pattern Key: SPARK-14184 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199097#comment-15199097 ] Dilip Biswal commented on SPARK-13859: -- I have looked into this issue. After changing the query

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199136#comment-15199136 ] Dilip Biswal commented on SPARK-13865: -- [~smilegator] Quick update on this .. This also seems

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200465#comment-15200465 ] Dilip Biswal commented on SPARK-13859: -- Hello, Just checked the original spec for this query from

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-19 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201828#comment-15201828 ] Dilip Biswal commented on SPARK-13821: -- [~roycecil] Thanks Roy !! > TPC-DS Query 20 fa

[jira] [Comment Edited] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-15 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196464#comment-15196464 ] Dilip Biswal edited comment on SPARK-13821 at 3/16/16 4:41 AM: --- [~roycecil

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-15 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196464#comment-15196464 ] Dilip Biswal commented on SPARK-13821: -- [~roycecil] Just tried the original query no. 20 against

[jira] [Created] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-03-05 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13698: Summary: Fix Analysis Exceptions when Using Backticks in Generate Key: SPARK-13698 URL: https://issues.apache.org/jira/browse/SPARK-13698 Project: Spark

[jira] [Created] (SPARK-13651) Generator outputs are not resolved correctly resulting in runtime error

2016-03-03 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13651: Summary: Generator outputs are not resolved correctly resulting in runtime error Key: SPARK-13651 URL: https://issues.apache.org/jira/browse/SPARK-13651 Project

[jira] [Created] (SPARK-13427) Support USING clause in JOIN

2016-02-21 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13427: Summary: Support USING clause in JOIN Key: SPARK-13427 URL: https://issues.apache.org/jira/browse/SPARK-13427 Project: Spark Issue Type: Improvement

Re: Welcoming two new committers

2016-02-08 Thread Dilip Biswal
Congratulations Wenchen and Herman !! Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Xiao Li <gatorsm...@gmail.com> To: Corey Nolet <cjno...@gmail.com> Cc: Ted Yu <yuzhih...@gmail.com>, Matei Zaharia <matei.zaha...@gmail.com>, dev <dev@s

[jira] [Comment Edited] (SPARK-12988) Can't drop columns that contain dots

2016-02-02 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128902#comment-15128902 ] Dilip Biswal edited comment on SPARK-12988 at 2/2/16 7:56 PM: -- The subtle

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

2016-02-02 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128902#comment-15128902 ] Dilip Biswal commented on SPARK-12988: -- The shuttle difference between column path and column name

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

2016-01-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118775#comment-15118775 ] Dilip Biswal commented on SPARK-12988: -- [~marmbrus][~rxin] Thanks for your input. > Can't d

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

2016-01-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117509#comment-15117509 ] Dilip Biswal commented on SPARK-12988: -- I would like to work on this one. > Can't drop colu

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

2016-01-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118319#comment-15118319 ] Dilip Biswal commented on SPARK-12988: -- [~marmbrus] Hi Michael, need your input on the semantics

[jira] [Comment Edited] (SPARK-12988) Can't drop columns that contain dots

2016-01-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118319#comment-15118319 ] Dilip Biswal edited comment on SPARK-12988 at 1/27/16 12:02 AM

[jira] [Commented] (SPARK-12558) AnalysisException when multiple functions applied in GROUP BY clause

2015-12-29 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074508#comment-15074508 ] Dilip Biswal commented on SPARK-12558: -- I would like to work on this one. > AnalysisException w

[jira] [Commented] (SPARK-12458) Add ExpressionDescription to datetime functions

2015-12-21 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067278#comment-15067278 ] Dilip Biswal commented on SPARK-12458: -- I would like to work on this one. >

[jira] [Commented] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

2015-12-17 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062527#comment-15062527 ] Dilip Biswal commented on SPARK-12398: -- [~rxin] Hi Reynold, are you working on this ? If not, i

[jira] [Created] (SPARK-12359) Add showString() to DataSet API.

2015-12-15 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-12359: Summary: Add showString() to DataSet API. Key: SPARK-12359 URL: https://issues.apache.org/jira/browse/SPARK-12359 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12257) Non partitioned insert into a partitioned Hive table doesn't fail

2015-12-10 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050319#comment-15050319 ] Dilip Biswal commented on SPARK-12257: -- Was able to reproduce this issue. Looking into it. >

[jira] [Commented] (SPARK-11949) Query on DataFrame from cube gives wrong results

2015-11-28 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030718#comment-15030718 ] Dilip Biswal commented on SPARK-11949: -- I would like to work on this issue. > Query on DataFr

[jira] [Commented] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028334#comment-15028334 ] Dilip Biswal commented on SPARK-11997: -- I would like to work on this issue. > NPE when s

[jira] [Comment Edited] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028334#comment-15028334 ] Dilip Biswal edited comment on SPARK-11997 at 11/26/15 8:32 AM: I would

[jira] [Created] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

2015-11-19 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11863: Summary: Unable to resolve order by if it contains mixture of aliases and real columns. Key: SPARK-11863 URL: https://issues.apache.org/jira/browse/SPARK-11863

[jira] [Commented] (SPARK-11584) The attribute of temporay table shows false

2015-11-09 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997265#comment-14997265 ] Dilip Biswal commented on SPARK-11584: -- I would like to work on this issue. > The attrib

[jira] [Created] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11577: Summary: Suppress stacktraces in bin/spark-sql for AnalysisExceptions Key: SPARK-11577 URL: https://issues.apache.org/jira/browse/SPARK-11577 Project: Spark

[jira] [Updated] (SPARK-11577) Handle code review comments for SPARK-11188

2015-11-08 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-11577: - Summary: Handle code review comments for SPARK-11188 (was: Suppress stacktraces in bin/spark

[jira] [Commented] (SPARK-11544) sqlContext doesn't use PathFilter

2015-11-07 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995476#comment-14995476 ] Dilip Biswal commented on SPARK-11544: -- I am looking into this issue. > sqlContext doesn't

[jira] [Comment Edited] (SPARK-11544) sqlContext doesn't use PathFilter

2015-11-07 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995476#comment-14995476 ] Dilip Biswal edited comment on SPARK-11544 at 11/8/15 4:52 AM: --- I would

Re: Master build fails ?

2015-11-05 Thread Dilip Biswal
Hello, I am getting the same build error about not being able to find com.google.common.hash.HashCodes. Is there a solution to this ? Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Jean-Baptiste Onofré <j...@nanthrax.net> To: Ted Yu <yuzhih...@gmail.com>

Re: Master build fails ?

2015-11-05 Thread Dilip Biswal
command up until recently. I think i have stared to have problem after SPARK-11073 where the HashCodes import was added. Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Ted Yu <yuzhih...@gmail.com> To: Dilip Biswal/Oakland/IBM@IBMUS Cc: Jean-Baptiste Ono

Re: SPARK SQL Error

2015-10-15 Thread Dilip Biswal
nts on why the --files option may be redundant in your case. Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Giri <giridhar.madduk...@gmail.com> To: user@spark.apache.org Date: 10/15/2015 02:44 AM Subject:Re: SPARK SQL Error Hi Ritchard, Thank you so much

[jira] [Commented] (SPARK-10943) NullType Column cannot be written to Parquet

2015-10-14 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958109#comment-14958109 ] Dilip Biswal commented on SPARK-10943: -- Hi Jason, >From the parquet format page , here are the d

[jira] [Created] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

2015-10-09 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11024: Summary: Optimize NULL in by folding it to Literal(null) Key: SPARK-11024 URL: https://issues.apache.org/jira/browse/SPARK-11024 Project: Spark Issue Type

[jira] [Commented] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

2015-10-09 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950124#comment-14950124 ] Dilip Biswal commented on SPARK-11024: -- I am currently working on a PR for this issue. > Optim

[jira] [Commented] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944462#comment-14944462 ] Dilip Biswal commented on SPARK-10534: -- I would like to work on this. > ORDER BY clause allows o

[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-09-29 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934731#comment-14934731 ] Dilip Biswal commented on SPARK-8654: - I would like to work on this issue.. > Analysis except

<    1   2   3