[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim closed SPARK-11613.
Resolution: Fixed
> Kinesis ASL should allow caller to set ClientConfiguration for socket
> timeouts and o
Heji Kim created SPARK-18506:
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest
will only read from a single partition on a multi partition topic
Key: SPARK-18506
URL: https://issues.apache.org/jira/brows
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
0.10.1.0/spark-streaming-kafka-0-10_2.11
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
0.10.1.0/spark-streaming-kafka-0-10_2.11
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
0.10.1.0/spark-streaming-kafka-0-10_2.11
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15679667#comment-15679667
]
Heji Kim commented on SPARK-18506:
--
We have spent two weeks trying different configurati
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684844#comment-15684844
]
Heji Kim commented on SPARK-18506:
--
Firstly thank you Cody for the quick response. Our i
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684995#comment-15684995
]
Heji Kim commented on SPARK-18506:
--
Just confirming that when I use ConsumerStrategy.Ass
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim resolved SPARK-18506.
--
Resolution: Workaround
I was able to replicate the single partition only problem in AWS with both YARN
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691582#comment-15691582
]
Heji Kim commented on SPARK-18506:
--
My ansible automation just downloads the official di
[
https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876747#comment-15876747
]
Heji Kim commented on SPARK-19677:
--
Thank you for reporting this issue! I just wanted t
Heji Kim created SPARK-11613:
Summary: Kinesis ASL should allow caller to set
ClientConfiguration for socket timeouts and other connection settings
Key: SPARK-11613
URL: https://issues.apache.org/jira/browse/SPARK-116
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of connection settings
on AmazonKine
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of connection settings
on AmazonKine
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of Kinesis settings such
as maxRecor
[
https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739578#comment-14739578
]
Heji Kim commented on SPARK-8939:
-
I was trying to upgrade to 1.5 today and could not subm
[
https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739578#comment-14739578
]
Heji Kim edited comment on SPARK-8939 at 9/15/15 3:14 AM:
--
I was
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703328#comment-15703328
]
Heji Kim commented on SPARK-18506:
--
Hi Cody,
I am putting one last ditch effort into ge
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim reopened SPARK-18506:
--
My team has asked me to reopen this issue to see if there can be any more
progress. We have implemented a
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709430#comment-15709430
]
Heji Kim commented on SPARK-18506:
--
Hi Cody.
I have tried roughly a similar configurati
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only
read from a single partition on
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713476#comment-15713476
]
Heji Kim commented on SPARK-18506:
--
Breaking news I finally found the source of the
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only
read from a single partition on
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim resolved SPARK-18506.
--
Resolution: Not A Problem
Just another library incompatibilty issue. We just downgraded the kafka-clien
24 matches
Mail list logo