[jira] [Comment Edited] (SPARK-13141) Dataframe created from Hive partitioned tables using HiveContext returns wrong results

2016-03-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174895#comment-15174895 ] zhichao-li edited comment on SPARK-13141 at 3/2/16 2:29 AM: Just try, but

[jira] [Commented] (SPARK-13141) Dataframe created from Hive partitioned tables using HiveContext returns wrong results

2016-03-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174895#comment-15174895 ] zhichao-li commented on SPARK-13141: Just try, but this cannot be reproduced from the master version

[jira] [Created] (SPARK-12820) Resolve column with full qualified names: db.table.column

2016-01-13 Thread zhichao-li (JIRA)
zhichao-li created SPARK-12820: -- Summary: Resolve column with full qualified names: db.table.column Key: SPARK-12820 URL: https://issues.apache.org/jira/browse/SPARK-12820 Project: Spark Issue

[jira] [Created] (SPARK-12789) Support order by index

2016-01-12 Thread zhichao-li (JIRA)
zhichao-li created SPARK-12789: -- Summary: Support order by index Key: SPARK-12789 URL: https://issues.apache.org/jira/browse/SPARK-12789 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-11517) Calc partitions in parallel for multiple partitions table

2015-11-04 Thread zhichao-li (JIRA)
zhichao-li created SPARK-11517: -- Summary: Calc partitions in parallel for multiple partitions table Key: SPARK-11517 URL: https://issues.apache.org/jira/browse/SPARK-11517 Project: Spark Issue

[jira] [Created] (SPARK-11121) Incorrect TaskLocation type

2015-10-14 Thread zhichao-li (JIRA)
zhichao-li created SPARK-11121: -- Summary: Incorrect TaskLocation type Key: SPARK-11121 URL: https://issues.apache.org/jira/browse/SPARK-11121 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9626) Add python api for base64, crc32, pmod, factorial and conv functions

2015-08-04 Thread zhichao-li (JIRA)
zhichao-li created SPARK-9626: - Summary: Add python api for base64, crc32, pmod, factorial and conv functions Key: SPARK-9626 URL: https://issues.apache.org/jira/browse/SPARK-9626 Project: Spark

[jira] [Closed] (SPARK-9626) Add python api for base64, crc32, pmod, factorial and conv functions

2015-08-04 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li closed SPARK-9626. - Resolution: Duplicate duplicated with SPARK-9513 Add python api for base64, crc32, pmod, factorial and

[jira] [Created] (SPARK-9238) two extra useless entries for bytesOfCodePointInUTF8

2015-07-21 Thread zhichao-li (JIRA)
zhichao-li created SPARK-9238: - Summary: two extra useless entries for bytesOfCodePointInUTF8 Key: SPARK-9238 URL: https://issues.apache.org/jira/browse/SPARK-9238 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8227) math function: unhex

2015-06-16 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587694#comment-14587694 ] zhichao-li commented on SPARK-8227: --- typo. pls ignore this one. math function: unhex

[jira] [Commented] (SPARK-8206) math function: round

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579943#comment-14579943 ] zhichao-li commented on SPARK-8206: --- I will take this one math function: round

[jira] [Commented] (SPARK-8220) math function: positive

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579961#comment-14579961 ] zhichao-li commented on SPARK-8220: --- I will take this one math function: positive

[jira] [Commented] (SPARK-8221) math function: pmod

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579962#comment-14579962 ] zhichao-li commented on SPARK-8221: --- I will take this one math function: pmod

[jira] [Commented] (SPARK-8219) math function: negative

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579959#comment-14579959 ] zhichao-li commented on SPARK-8219: --- I will take this one math function: negative

[jira] [Commented] (SPARK-8222) math function: alias power / pow

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579963#comment-14579963 ] zhichao-li commented on SPARK-8222: --- I will take this one math function: alias power /

[jira] [Commented] (SPARK-8209) math function: conv

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579945#comment-14579945 ] zhichao-li commented on SPARK-8209: --- I will take this one math function: conv

[jira] [Commented] (SPARK-8208) math function: ceiling

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579944#comment-14579944 ] zhichao-li commented on SPARK-8208: --- I will take this one math function: ceiling

[jira] [Commented] (SPARK-8211) math function: radians

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579947#comment-14579947 ] zhichao-li commented on SPARK-8211: --- I will take this one math function: radians

[jira] [Commented] (SPARK-8213) math function: factorial

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579948#comment-14579948 ] zhichao-li commented on SPARK-8213: --- I will take this one math function: factorial

[jira] [Commented] (SPARK-8214) math function: hex

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579949#comment-14579949 ] zhichao-li commented on SPARK-8214: --- I will take this one math function: hex

[jira] [Commented] (SPARK-8210) math function: degrees

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579946#comment-14579946 ] zhichao-li commented on SPARK-8210: --- I will take this one math function: degrees

[jira] [Commented] (SPARK-8216) math function: rename log - ln

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579952#comment-14579952 ] zhichao-li commented on SPARK-8216: --- I will take this one math function: rename log -

[jira] [Commented] (SPARK-8224) math function: shiftright

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579965#comment-14579965 ] zhichao-li commented on SPARK-8224: --- I will take this one math function: shiftright

[jira] [Commented] (SPARK-8223) math function: shiftleft

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579964#comment-14579964 ] zhichao-li commented on SPARK-8223: --- I will take this one math function: shiftleft

[jira] [Commented] (SPARK-8227) math function: unhex

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579969#comment-14579969 ] zhichao-li commented on SPARK-8227: --- I will take this one math function: unhex

[jira] [Commented] (SPARK-8226) math function: shiftrightunsigned

2015-06-09 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579968#comment-14579968 ] zhichao-li commented on SPARK-8226: --- I will take this one math function:

[jira] [Issue Comment Deleted] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-06-04 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li updated SPARK-7119: -- Comment: was deleted (was: This workaround query can be executed correctly and there's a simple fix

[jira] [Commented] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-06-04 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573889#comment-14573889 ] zhichao-li commented on SPARK-7119: --- This workaround query can be executed correctly and

[jira] [Commented] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-06-04 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573888#comment-14573888 ] zhichao-li commented on SPARK-7119: --- This workaround query can be executed correctly and

[jira] [Updated] (SPARK-7862) Query would hang when the using script has error output in SparkSQL

2015-05-26 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li updated SPARK-7862: -- Description: Steps to reproduce: val data = (1 to 10).map { i = (i, i, i) } data.toDF(d1, d2,

[jira] [Created] (SPARK-7862) Query would hang when the using script has error output in SparkSQL

2015-05-26 Thread zhichao-li (JIRA)
zhichao-li created SPARK-7862: - Summary: Query would hang when the using script has error output in SparkSQL Key: SPARK-7862 URL: https://issues.apache.org/jira/browse/SPARK-7862 Project: Spark

[jira] [Closed] (SPARK-6897) Remove volatile from BlockingGenerator.currentBuffer

2015-04-14 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li closed SPARK-6897. - Resolution: Won't Fix May not have too much benefit for removing the volatile Remove volatile from

[jira] [Created] (SPARK-6762) Fix potential resource leaks

2015-04-07 Thread zhichao-li (JIRA)
zhichao-li created SPARK-6762: - Summary: Fix potential resource leaks Key: SPARK-6762 URL: https://issues.apache.org/jira/browse/SPARK-6762 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-6762) Fix potential resource leaks in CheckPoint CheckpointWriter and CheckpointReader

2015-04-07 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li updated SPARK-6762: -- Summary: Fix potential resource leaks in CheckPoint CheckpointWriter and CheckpointReader (was: Fix

[jira] [Updated] (SPARK-6762) Fix potential resource leaks in CheckPoint CheckpointWriter and CheckpointReader

2015-04-07 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li updated SPARK-6762: -- Description: The close action should be placed within finally block to avoid the potential resource

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-04-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390221#comment-14390221 ] zhichao-li commented on SPARK-6613: --- [~msoutier] , have you found any solution for this

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-04-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392102#comment-14392102 ] zhichao-li commented on SPARK-6613: --- Just trying to understand the issue but it cann't

[jira] [Commented] (SPARK-6077) Multiple spark streaming tabs on UI when reuse the same sparkcontext

2015-03-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342595#comment-14342595 ] zhichao-li commented on SPARK-6077: --- Yeah. It would fix the SPARK-2463 as well. Almost

[jira] [Created] (SPARK-6077) Multiple spark streaming tabs on UI when reuse the same sparkcontext

2015-02-27 Thread zhichao-li (JIRA)
zhichao-li created SPARK-6077: - Summary: Multiple spark streaming tabs on UI when reuse the same sparkcontext Key: SPARK-6077 URL: https://issues.apache.org/jira/browse/SPARK-6077 Project: Spark