[jira] [Commented] (SPARK-8246) string function: get_json_object

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579918#comment-14579918 ] Cheng Hao commented on SPARK-8246: -- I'll take this one. string function:

[jira] [Commented] (SPARK-8251) string function: alias upper / ucase

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579922#comment-14579922 ] Cheng Hao commented on SPARK-8251: -- I'll take this one. string function: alias upper /

[jira] [Commented] (SPARK-8259) string function: rpad

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579931#comment-14579931 ] Cheng Hao commented on SPARK-8259: -- I'll take this one. string function: rpad

[jira] [Commented] (SPARK-8261) string function: space

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579933#comment-14579933 ] Cheng Hao commented on SPARK-8261: -- I'll take this one. string function: space

[jira] [Commented] (SPARK-8255) string function: regexp_extract

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579927#comment-14579927 ] Cheng Hao commented on SPARK-8255: -- I'll take this one. string function: regexp_extract

[jira] [Commented] (SPARK-8262) string function: split

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579935#comment-14579935 ] Cheng Hao commented on SPARK-8262: -- I'll take this one. string function: split

[jira] [Commented] (SPARK-8270) string function: levenshtein

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579941#comment-14579941 ] Cheng Hao commented on SPARK-8270: -- I'll take this one. string function: levenshtein

[jira] [Commented] (SPARK-8266) string function: translate

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579938#comment-14579938 ] Cheng Hao commented on SPARK-8266: -- I'll take this one. string function: translate

[jira] [Commented] (SPARK-8229) conditional function: isnotnull

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579905#comment-14579905 ] Cheng Hao commented on SPARK-8229: -- I'll take this one. conditional function: isnotnull

[jira] [Commented] (SPARK-8240) string function: concat

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579912#comment-14579912 ] Cheng Hao commented on SPARK-8240: -- I'll take this one. string function: concat

[jira] [Commented] (SPARK-8231) complex function: array_contains

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579908#comment-14579908 ] Cheng Hao commented on SPARK-8231: -- I'll take this one. complex function:

[jira] [Commented] (SPARK-8238) string function: ascii

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579910#comment-14579910 ] Cheng Hao commented on SPARK-8238: -- I'll take this one. string function: ascii

[jira] [Commented] (SPARK-8230) complex function: size

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579906#comment-14579906 ] Cheng Hao commented on SPARK-8230: -- I'll take this one. complex function: size

[jira] [Commented] (SPARK-8239) string function: base64

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579911#comment-14579911 ] Cheng Hao commented on SPARK-8239: -- I'll take this one. string function: base64

[jira] [Commented] (SPARK-8232) complex function: sort_array

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579909#comment-14579909 ] Cheng Hao commented on SPARK-8232: -- I'll take this one. complex function: sort_array

[jira] [Commented] (SPARK-8243) string function: encode

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579915#comment-14579915 ] Cheng Hao commented on SPARK-8243: -- I'll take this one. string function: encode

[jira] [Commented] (SPARK-8245) string function: format_number

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579917#comment-14579917 ] Cheng Hao commented on SPARK-8245: -- I'll take this one. string function: format_number

[jira] [Commented] (SPARK-8241) string function: concat_ws

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579913#comment-14579913 ] Cheng Hao commented on SPARK-8241: -- I'll take this one. string function: concat_ws

[jira] [Commented] (SPARK-8249) string function: locate

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579920#comment-14579920 ] Cheng Hao commented on SPARK-8249: -- I'll take this one. string function: locate

[jira] [Commented] (SPARK-8250) string function: alias lower/lcase

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579921#comment-14579921 ] Cheng Hao commented on SPARK-8250: -- I'll take this one. string function: alias

[jira] [Commented] (SPARK-8247) string function: instr

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579919#comment-14579919 ] Cheng Hao commented on SPARK-8247: -- I'll take this one. string function: instr

[jira] [Commented] (SPARK-8254) string function: printf

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579926#comment-14579926 ] Cheng Hao commented on SPARK-8254: -- I'll take this one. string function: printf

[jira] [Commented] (SPARK-8252) string function: lpad

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579923#comment-14579923 ] Cheng Hao commented on SPARK-8252: -- I'll take this one. string function: lpad

[jira] [Commented] (SPARK-8253) string function: ltrim

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579925#comment-14579925 ] Cheng Hao commented on SPARK-8253: -- I'll take this one. string function: ltrim

[jira] [Commented] (SPARK-8271) string function: soundex

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579942#comment-14579942 ] Cheng Hao commented on SPARK-8271: -- I'll take this one. string function: soundex

[jira] [Commented] (SPARK-8258) string function: reverse

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579930#comment-14579930 ] Cheng Hao commented on SPARK-8258: -- I'll take this one. string function: reverse

[jira] [Commented] (SPARK-8263) string function: substr/substring should also support binary type

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579936#comment-14579936 ] Cheng Hao commented on SPARK-8263: -- I'll take this one. string function:

[jira] [Commented] (SPARK-8257) string function: repeat

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579929#comment-14579929 ] Cheng Hao commented on SPARK-8257: -- I'll take this one. string function: repeat

[jira] [Commented] (SPARK-8260) string function: rtrim

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579932#comment-14579932 ] Cheng Hao commented on SPARK-8260: -- I'll take this one. string function: rtrim

[jira] [Commented] (SPARK-8256) string function: regexp_replace

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579928#comment-14579928 ] Cheng Hao commented on SPARK-8256: -- I'll take this one. string function: regexp_replace

[jira] [Commented] (SPARK-8264) string function: substring_index

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579937#comment-14579937 ] Cheng Hao commented on SPARK-8264: -- I'll take this one. string function:

[jira] [Commented] (SPARK-8268) string function: unbase64

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579939#comment-14579939 ] Cheng Hao commented on SPARK-8268: -- I'll take this one. string function: unbase64

[jira] [Commented] (SPARK-8269) string function: initcap

2015-06-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579940#comment-14579940 ] Cheng Hao commented on SPARK-8269: -- I'll take this one. string function: initcap

[jira] [Created] (SPARK-8653) Add constraint for Children expression for data type

2015-06-26 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-8653: Summary: Add constraint for Children expression for data type Key: SPARK-8653 URL: https://issues.apache.org/jira/browse/SPARK-8653 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

2015-06-10 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581315#comment-14581315 ] Cheng Hao commented on SPARK-7550: -- I will start working on this today, sorry for the

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

2015-05-26 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560450#comment-14560450 ] Cheng Hao commented on SPARK-7550: -- Similar issue with SPARK-6923 Support setting the

[jira] [Comment Edited] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

2015-05-26 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560450#comment-14560450 ] Cheng Hao edited comment on SPARK-7550 at 5/27/15 5:48 AM: ---

[jira] [Created] (SPARK-7915) Support specifying the column list for target table in CTAS

2015-05-28 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-7915: Summary: Support specifying the column list for target table in CTAS Key: SPARK-7915 URL: https://issues.apache.org/jira/browse/SPARK-7915 Project: Spark Issue

[jira] [Created] (SPARK-8791) Make a better hashcode for InternalRow

2015-07-02 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-8791: Summary: Make a better hashcode for InternalRow Key: SPARK-8791 URL: https://issues.apache.org/jira/browse/SPARK-8791 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-07-02 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612728#comment-14612728 ] Cheng Hao commented on SPARK-8159: -- Will that possible to add all of the expressions

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-07-01 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609627#comment-14609627 ] Cheng Hao commented on SPARK-8653: -- Yes, I agree that we cannot make a clear cut, as

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-07-01 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609609#comment-14609609 ] Cheng Hao commented on SPARK-8653: -- For most of the Mathematical expressions, we can get

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-07-01 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609629#comment-14609629 ] Cheng Hao commented on SPARK-8653: -- What do you think [~rxin]? Add constraint for

[jira] [Created] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-7853: Summary: ClassNotFoundException for SparkSQL Key: SPARK-7853 URL: https://issues.apache.org/jira/browse/SPARK-7853 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558321#comment-14558321 ] Cheng Hao commented on SPARK-7853: -- ClassNotFound is actually I got after

[jira] [Commented] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558332#comment-14558332 ] Cheng Hao commented on SPARK-7853: -- And it seems the bug introduced by

[jira] [Commented] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558363#comment-14558363 ] Cheng Hao commented on SPARK-7853: -- Update the description, seesm 'TestSerDe` is not a

[jira] [Updated] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-7853: - Description: Reproduce steps: {code} bin/spark-sql --jars

[jira] [Commented] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558697#comment-14558697 ] Cheng Hao commented on SPARK-7727: -- As we probably don't want to change the

[jira] [Created] (SPARK-7859) Collect_SET behaves different under different version of JDK

2015-05-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-7859: Summary: Collect_SET behaves different under different version of JDK Key: SPARK-7859 URL: https://issues.apache.org/jira/browse/SPARK-7859 Project: Spark Issue

[jira] [Updated] (SPARK-7859) Collect_SET behaves different under different version of JDK

2015-05-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-7859: - Description: To reproduce {code} JAVA_HOME=/home/hcheng/Java/jdk1.8.0_45 | build/sbt -Phadoop-2.3 -Phive

[jira] [Commented] (SPARK-4233) Simplify the Aggregation Function implementation

2015-05-22 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557060#comment-14557060 ] Cheng Hao commented on SPARK-4233: -- The interface changes is for scalability and

[jira] [Created] (SPARK-7871) Improve the outputPartitioning for HashOuterJoin(full outer join)

2015-05-26 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-7871: Summary: Improve the outputPartitioning for HashOuterJoin(full outer join) Key: SPARK-7871 URL: https://issues.apache.org/jira/browse/SPARK-7871 Project: Spark

[jira] [Created] (SPARK-8867) Show the UDF usage for user.

2015-07-07 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-8867: Summary: Show the UDF usage for user. Key: SPARK-8867 URL: https://issues.apache.org/jira/browse/SPARK-8867 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9879: Summary: OOM in CTAS with LIMIT Key: SPARK-9879 URL: https://issues.apache.org/jira/browse/SPARK-9879 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-9879) OOM in LIMIT clause with large number

2015-08-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9879: - Summary: OOM in LIMIT clause with large number (was: OOM in CTAS with LIMIT) OOM in LIMIT clause with

[jira] [Updated] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9879: - Description: {code} create table spark.tablsetest as select * from dpa_ord_bill_tf order by member_id

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704311#comment-14704311 ] Cheng Hao commented on SPARK-9357: -- JoinedRow does increase the overhead by adding layer

[jira] [Comment Edited] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704311#comment-14704311 ] Cheng Hao edited comment on SPARK-9357 at 8/20/15 5:28 AM: ---

[jira] [Comment Edited] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704311#comment-14704311 ] Cheng Hao edited comment on SPARK-9357 at 8/20/15 5:29 AM: ---

[jira] [Commented] (SPARK-10130) type coercion for IF should have children resolved first

2015-08-20 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704513#comment-14704513 ] Cheng Hao commented on SPARK-10130: --- Can you change the fix version to 1.5? Lots of

[jira] [Created] (SPARK-10134) Improve the performance of Binary Comparison

2015-08-20 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-10134: - Summary: Improve the performance of Binary Comparison Key: SPARK-10134 URL: https://issues.apache.org/jira/browse/SPARK-10134 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702603#comment-14702603 ] Cheng Hao commented on SPARK-9357: -- JoinedRow is probably in high efficiency for case

[jira] [Commented] (SPARK-7218) Create a real iterator with open/close for Spark SQL

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702584#comment-14702584 ] Cheng Hao commented on SPARK-7218: -- Can you give some BKM for this task? Create a real

[jira] [Created] (SPARK-10044) AnalysisException in resolving reference for sorting with aggregation

2015-08-16 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-10044: - Summary: AnalysisException in resolving reference for sorting with aggregation Key: SPARK-10044 URL: https://issues.apache.org/jira/browse/SPARK-10044 Project: Spark

[jira] [Updated] (SPARK-10134) Improve the performance of Binary Comparison

2015-08-23 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-10134: -- Priority: Minor (was: Major) Improve the performance of Binary Comparison

[jira] [Updated] (SPARK-10134) Improve the performance of Binary Comparison

2015-08-23 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-10134: -- Fix Version/s: (was: 1.6.0) Improve the performance of Binary Comparison

[jira] [Commented] (SPARK-10134) Improve the performance of Binary Comparison

2015-08-23 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708766#comment-14708766 ] Cheng Hao commented on SPARK-10134: --- We can improve that by enable the comparison every

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-06-29 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607195#comment-14607195 ] Cheng Hao commented on SPARK-8653: -- [~rxin] I'll agree that we need to rename the trait.

[jira] [Commented] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-08-03 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652892#comment-14652892 ] Cheng Hao commented on SPARK-7119: -- [~marmbrus] This is actually a bug fixing, and it

[jira] [Commented] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661359#comment-14661359 ] Cheng Hao commented on SPARK-9689: -- After investigation, the root cause for the failure,

[jira] [Updated] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9689: - Description: {code:title=example|borderStyle=solid} // create a HadoopFsRelation based table

[jira] [Created] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-07 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9735: Summary: Auto infer partition schema of HadoopFsRelation should should respected the user specified one Key: SPARK-9735 URL: https://issues.apache.org/jira/browse/SPARK-9735

[jira] [Commented] (SPARK-8240) string function: concat

2015-08-13 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696471#comment-14696471 ] Cheng Hao commented on SPARK-8240: -- It's probably very difficult to define the function

[jira] [Commented] (SPARK-8240) string function: concat

2015-08-13 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696469#comment-14696469 ] Cheng Hao commented on SPARK-8240: -- It works for me like: {code} sql(select concat('a',

[jira] [Commented] (SPARK-9879) OOM in LIMIT clause with large number

2015-08-13 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696338#comment-14696338 ] Cheng Hao commented on SPARK-9879: -- I create a new physical operator called LargeLimit,

[jira] [Updated] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9879: - Description: {code} create table spark.tablsetest as select * from dpa_ord_bill_tf order by member_id

[jira] [Created] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9689: Summary: Cache doesn't refresh for HadoopFsRelation based table Key: SPARK-9689 URL: https://issues.apache.org/jira/browse/SPARK-9689 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9381) Migrate JSON data source to the new partitioning data source

2015-07-27 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9381: Summary: Migrate JSON data source to the new partitioning data source Key: SPARK-9381 URL: https://issues.apache.org/jira/browse/SPARK-9381 Project: Spark Issue

[jira] [Commented] (SPARK-9374) [Spark SQL] Throw out erorr of AnalysisException: nondeterministic expressions are only allowed in Project or Filter during the spark sql parse phase

2015-07-27 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642706#comment-14642706 ] Cheng Hao commented on SPARK-9374: -- [~cloud_fan]] Can you also take look at this failure?

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-23 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638276#comment-14638276 ] Cheng Hao commented on SPARK-9239: -- [~yhuai] are you working on this now? Or I can take

[jira] [Commented] (SPARK-8230) complex function: size

2015-07-15 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629107#comment-14629107 ] Cheng Hao commented on SPARK-8230: -- [~pedrorodriguez], actually [~TarekAuel] set a good

[jira] [Commented] (SPARK-10371) Optimize sequential projections

2015-10-29 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981650#comment-14981650 ] Cheng Hao commented on SPARK-10371: --- Eliminating the common sub expression within the projection? >

[jira] [Comment Edited] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-27 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977600#comment-14977600 ] Cheng Hao edited comment on SPARK-11330 at 10/28/15 2:28 AM: - Hi,

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-27 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977600#comment-14977600 ] Cheng Hao commented on SPARK-11330: --- Hi, [~saif.a.ellafi], I've tried the code like below: {code} case

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-28 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979646#comment-14979646 ] Cheng Hao commented on SPARK-11330: --- [~saif.a.ellafi] I've checked that with 1.5.0 and it's confirmed

[jira] [Comment Edited] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-28 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979699#comment-14979699 ] Cheng Hao edited comment on SPARK-11330 at 10/29/15 2:48 AM: - OK, seems it's

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-28 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979699#comment-14979699 ] Cheng Hao commented on SPARK-11330: --- OK, seems it's solved in

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-11-11 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001423#comment-15001423 ] Cheng Hao commented on SPARK-10865: --- 1.5.2 is released, I am not sure whether part of it now or not. >

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-11-11 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001422#comment-15001422 ] Cheng Hao commented on SPARK-10865: --- We actually follow the criteria of Hive, and actually I tested it

[jira] [Created] (SPARK-11512) Bucket Join

2015-11-04 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-11512: - Summary: Bucket Join Key: SPARK-11512 URL: https://issues.apache.org/jira/browse/SPARK-11512 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-11512) Bucket Join

2015-11-04 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990867#comment-14990867 ] Cheng Hao commented on SPARK-11512: --- Oh, yes, but SPARK-5292 is only about to support the Hive bucket,

[jira] [Commented] (SPARK-11512) Bucket Join

2015-11-04 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990868#comment-14990868 ] Cheng Hao commented on SPARK-11512: --- We need to support the "bucket" for DataSource API. > Bucket Join

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-10-15 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958524#comment-14958524 ] Cheng Hao commented on SPARK-4226: -- [~nadenf] Actually I am working on it right now, and the first PR is

[jira] [Updated] (SPARK-10992) Partial Aggregation Support for Hive UDAF

2015-10-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-10992: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Partial Aggregation Support for

[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-10-20 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9735: - Description: This code is copied from the hadoopFsRelationSuite.scala {code} partitionedTestDF = (for {

[jira] [Closed] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao closed SPARK-11041. - Resolution: Duplicate > Add (NOT) IN / EXISTS support for predicates >

[jira] [Created] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-11041: - Summary: Add (NOT) IN / EXISTS support for predicates Key: SPARK-11041 URL: https://issues.apache.org/jira/browse/SPARK-11041 Project: Spark Issue Type:

[jira] [Created] (SPARK-11076) Decimal Support for Ceil/Floor

2015-10-12 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-11076: - Summary: Decimal Support for Ceil/Floor Key: SPARK-11076 URL: https://issues.apache.org/jira/browse/SPARK-11076 Project: Spark Issue Type: Improvement

[jira] [Issue Comment Deleted] (SPARK-8864) Date/time function and data type design

2015-07-08 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-8864: - Comment: was deleted (was: Thanks for explanation. The design looks good to me now.) Date/time function

<    1   2   3   4   >