[jira] [Updated] (SPARK-30952) Grouped pandas_udf crashed when a group returned an empty DataFrame

2020-02-25 Thread bruce_zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce_zhao updated SPARK-30952: --- Description: We are trying to apply three-sigma rule in grouped data to detect anomaly data. We fou

[jira] [Created] (SPARK-30952) Grouped pandas_udf crashed when a group returned an empty DataFrame

2020-02-25 Thread bruce_zhao (Jira)
bruce_zhao created SPARK-30952: -- Summary: Grouped pandas_udf crashed when a group returned an empty DataFrame Key: SPARK-30952 URL: https://issues.apache.org/jira/browse/SPARK-30952 Project: Spark

[jira] [Updated] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException

2018-07-30 Thread bruce_zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce_zhao updated SPARK-24970: --- Description:   We're using Spark streaming to consume Kinesis data, and found that it reads  more d

[jira] [Updated] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException

2018-07-30 Thread bruce_zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce_zhao updated SPARK-24970: --- Description:   We're using Spark streaming to consume Kinesis data, and found that it reads  more d

[jira] [Updated] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException

2018-07-30 Thread bruce_zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce_zhao updated SPARK-24970: --- Description:   We're using Spark streaming to consume Kinesis data, and found that it reads  more d

[jira] [Created] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException

2018-07-30 Thread bruce_zhao (JIRA)
bruce_zhao created SPARK-24970: -- Summary: Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException Key: SPARK-24970 URL: https://issues.apache.org/j

[jira] [Commented] (SPARK-18620) Spark Streaming + Kinesis : Receiver MaxRate is violated

2018-05-10 Thread bruce_zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470069#comment-16470069 ] bruce_zhao commented on SPARK-18620: This PR makes the input rate flat, but the limit