[jira] [Created] (SPARK-31737) SparkSQL can't recognize the modified length of Hive varchar

Kevin Zhang created SPARK-31737: --- Summary: SparkSQL can't recognize the modified length of Hive varchar Key: SPARK-31737 URL: https://issues.apache.org/jira/browse/SPARK-31737 Project: Spark

[jira] [Commented] (SPARK-24036) Stateful operators in continuous processing

[ https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894323#comment-16894323 ] Kevin Zhang commented on SPARK-24036: - Hi [~joseph.torres], is there any update on this work? Will

[jira] [Issue Comment Deleted] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-24630: Comment: was deleted (was: thanks [~Jackey Lee] So I'm wondering what's blocking the pr of this

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818598#comment-16818598 ] Kevin Zhang commented on SPARK-24630: - thanks [~Jackey Lee] So I'm wondering what's blocking the pr

[jira] [Updated] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

[ https://issues.apache.org/jira/browse/SPARK-27340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-27340: Description: When we use data api to write a structured streaming query job we usually specify a

[jira] [Updated] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

[ https://issues.apache.org/jira/browse/SPARK-27340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-27340: Description: When we use data api to write a structured streaming query job we usually specify a

[jira] [Created] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

Kevin Zhang created SPARK-27340: --- Summary: Alias on TimeWIndow expression may cause watermark metadata lost Key: SPARK-27340 URL: https://issues.apache.org/jira/browse/SPARK-27340 Project: Spark

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804535#comment-16804535 ] Kevin Zhang commented on SPARK-24630: - Hi, is there any update about the progress? > SPIP: Support

[jira] [Updated] (SPARK-26350) Allow the user to override the group id of the Kafka's consumer

[ https://issues.apache.org/jira/browse/SPARK-26350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-26350: Attachment: Permalink.url > Allow the user to override the group id of the Kafka's consumer >

[jira] [Commented] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519994#comment-16519994 ] Kevin Zhang commented on SPARK-20295: - Still hit this bug in spark 2.3.0 > when

[jira] [Commented] (SPARK-14974) spark sql job create too many files in HDFS when doing insert overwrite hive table

[ https://issues.apache.org/jira/browse/SPARK-14974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380126#comment-16380126 ] Kevin Zhang commented on SPARK-14974: - I encountered the same problem with [~ussraf] in spark 2.2 and

[jira] [Commented] (SPARK-23498) Accuracy problem in comparison with string and integer

[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379753#comment-16379753 ] Kevin Zhang commented on SPARK-23498: - yes, thanks. But when we use spark sql to run existing hive

[jira] [Updated] (SPARK-23498) Accuracy problem in comparison with string and integer

[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-23498: Description: While comparing a string column with integer value, spark sql will automatically

[jira] [Created] (SPARK-23498) Accuracy problem in comparison with string and integer

Kevin Zhang created SPARK-23498: --- Summary: Accuracy problem in comparison with string and integer Key: SPARK-23498 URL: https://issues.apache.org/jira/browse/SPARK-23498 Project: Spark Issue

[jira] [Commented] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288608#comment-16288608 ] Kevin Zhang commented on SPARK-22755: - [~ksunitha] Thanks, it helps a lot > Expression

[jira] [Comment Edited] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286961#comment-16286961 ] Kevin Zhang edited comment on SPARK-22755 at 12/12/17 2:03 AM: --- Thanks for

[jira] [Comment Edited] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286961#comment-16286961 ] Kevin Zhang edited comment on SPARK-22755 at 12/12/17 1:58 AM: --- Thanks for

[jira] [Commented] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286961#comment-16286961 ] Kevin Zhang commented on SPARK-22755: - Thanks for reply. In hive and presto the result is supposed to

[jira] [Created] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

Kevin Zhang created SPARK-22755: --- Summary: Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results Key: SPARK-22755 URL: https://issues.apache.org/jira/browse/SPARK-22755

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158948#comment-16158948 ] Kevin Zhang commented on SPARK-21944: - [~mgaido] Do you mean the following way by saying "define the

[jira] [Comment Edited] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158055#comment-16158055 ] Kevin Zhang edited comment on SPARK-21944 at 9/8/17 2:51 AM: - I found the

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158055#comment-16158055 ] Kevin Zhang commented on SPARK-21944: - I found the problem when I use kafka source consuming our

[jira] [Created] (SPARK-21944) Watermark on window column is wrong

Kevin Zhang created SPARK-21944: --- Summary: Watermark on window column is wrong Key: SPARK-21944 URL: https://issues.apache.org/jira/browse/SPARK-21944 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120924#comment-16120924 ] Kevin Zhang commented on SPARK-21590: - Thanks, I'd like to work on this. I agree the requirement

[jira] [Comment Edited] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117900#comment-16117900 ] Kevin Zhang edited comment on SPARK-21590 at 8/8/17 6:15 AM: - [~brkyvz]

[jira] [Comment Edited] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117900#comment-16117900 ] Kevin Zhang edited comment on SPARK-21590 at 8/8/17 6:05 AM: - [~brkyvz]

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117900#comment-16117900 ] Kevin Zhang commented on SPARK-21590: - [~brkyvz] Thanks for your advice, but I believe you don't

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112274#comment-16112274 ] Kevin Zhang commented on SPARK-21590: - [~brkyvz] I don' t know the test you illustrated, but

[jira] [Commented] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112146#comment-16112146 ] Kevin Zhang commented on SPARK-21546: - [~zsxwing] in my case I hope to use a watermark to expire the

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110209#comment-16110209 ] Kevin Zhang commented on SPARK-21590: - I think the only problem is the non-negative check of window

[jira] [Updated] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-21590: Description: I want to calculate (unique) daily access count using structured streaming (2.2.0).

[jira] [Created] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

Kevin Zhang created SPARK-21590: --- Summary: Structured Streaming window start time should support negative values to adjust time zone Key: SPARK-21590 URL: https://issues.apache.org/jira/browse/SPARK-21590

[jira] [Comment Edited] (SPARK-12221) Add CPU time metric to TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500750#comment-15500750 ] Kevin Zhang edited comment on SPARK-12221 at 9/18/16 10:35 AM: --- hi, is

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500750#comment-15500750 ] Kevin Zhang commented on SPARK-12221: - hi, is there any plan to put this to trunk?? > Add CPU time

[jira] [Commented] (SPARK-13514) Spark Shuffle Service 1.6.0 issue in Yarn

[ https://issues.apache.org/jira/browse/SPARK-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383437#comment-15383437 ] Kevin Zhang commented on SPARK-13514: - yes file:// does exsit and this is definitely a work around.