Alex Mikhailau created SPARK-22200:
--------------------------------------

             Summary: Kinesis Receivers stops if Kinesis stream was re-sharded
                 Key: SPARK-22200
                 URL: https://issues.apache.org/jira/browse/SPARK-22200
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.2.0
            Reporter: Alex Mikhailau
            Priority: Critical


Seeing 

Cannot find the shard given the shardId shardId-000000004454

Cannot get the shard for this ProcessTask, so duplicate KPL user records in the 
event of resharding will not be dropped during deaggregation of Amazon Kinesis 
records.

after Kinesis stream re-sharding and receivers stop working altogether.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to