[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762756#comment-15762756
]
Michael Armbrust commented on SPARK-17344:
--
[KAFKA-4462] aims to give us backwar
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17344:
-
Target Version/s: 2.1.1
> Kafka 0.8 support for Structured Streaming
> --
[
https://issues.apache.org/jira/browse/SPARK-18908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18908:
-
Target Version/s: 2.1.1
> It's hard for the user to see the failure if StreamExecution fa
Michael Armbrust created SPARK-18932:
Summary: Partial aggregation for collect_set / collect_list
Key: SPARK-18932
URL: https://issues.apache.org/jira/browse/SPARK-18932
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752929#comment-15752929
]
Michael Armbrust commented on SPARK-5632:
-
Hmm, I agree that error is confusing.
[
https://issues.apache.org/jira/browse/SPARK-18084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18084:
-
Target Version/s: 2.2.0
> write.partitionBy() does not recognize nested columns that sele
Michael Armbrust created SPARK-18891:
Summary: Support for specific collection types
Key: SPARK-18891
URL: https://issues.apache.org/jira/browse/SPARK-18891
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752771#comment-15752771
]
Michael Armbrust commented on SPARK-5632:
-
If you expand the commit you'll see its
[
https://issues.apache.org/jira/browse/SPARK-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-12777.
--
Resolution: Fixed
Fix Version/s: 2.1.0
This works in 2.1:
https://databricks-pr
[
https://issues.apache.org/jira/browse/SPARK-17890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749860#comment-15749860
]
Michael Armbrust commented on SPARK-17890:
--
If I had to guess, I would guess tha
[
https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17689:
-
Target Version/s: 2.2.0
Description:
Steps to reproduce:
1) Start a streaming j
[
https://issues.apache.org/jira/browse/SPARK-18272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18272:
-
Issue Type: Test (was: Bug)
> Test topic addition for subscribePattern on Kafka DStream
[
https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18790:
-
Target Version/s: 2.1.0
> Keep a general offset history of stream batches
> -
[
https://issues.apache.org/jira/browse/SPARK-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18796:
-
Target Version/s: 2.1.0
> StreamingQueryManager should not hold a lock when starting a qu
Michael Armbrust created SPARK-18791:
Summary: Stream-Stream Joins
Key: SPARK-18791
URL: https://issues.apache.org/jira/browse/SPARK-18791
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-17890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729905#comment-15729905
]
Michael Armbrust commented on SPARK-17890:
--
Can you reproduce this with 2.1? If
[
https://issues.apache.org/jira/browse/SPARK-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-16902.
--
Resolution: Not A Problem
The encoder that is used is picked by scala's implicit resolu
[
https://issues.apache.org/jira/browse/SPARK-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18754:
-
Target Version/s: 2.1.0
> Rename recentProgresses to recentProgress
> ---
Michael Armbrust created SPARK-18754:
Summary: Rename recentProgresses to recentProgress
Key: SPARK-18754
URL: https://issues.apache.org/jira/browse/SPARK-18754
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust closed SPARK-18749.
Resolution: Invalid
> CLONE - checkpointLocation being set in memory streams fail after res
Michael Armbrust created SPARK-18749:
Summary: CLONE - checkpointLocation being set in memory streams
fail after restart. Should fail fast
Key: SPARK-18749
URL: https://issues.apache.org/jira/browse/SPARK-1874
[
https://issues.apache.org/jira/browse/SPARK-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust closed SPARK-17921.
Resolution: Won't Fix
> checkpointLocation being set in memory streams fail after restart.
[
https://issues.apache.org/jira/browse/SPARK-18234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18234:
-
Target Version/s: 2.2.0
> Update mode in structured streaming
> -
Michael Armbrust created SPARK-18682:
Summary: Batch Source for Kafka
Key: SPARK-18682
URL: https://issues.apache.org/jira/browse/SPARK-18682
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-18122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reopened SPARK-18122:
--
I'm going to reopen this. I think the benefits outweigh the compatibility
concerns.
> Fa
[
https://issues.apache.org/jira/browse/SPARK-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17939:
-
Target Version/s: 2.1.0
> Spark-SQL Nullability: Optimizations vs. Enforcement Clarificat
[
https://issues.apache.org/jira/browse/SPARK-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17939:
-
Target Version/s: 2.2.0 (was: 2.1.0)
> Spark-SQL Nullability: Optimizations vs. Enforcem
Michael Armbrust created SPARK-18657:
Summary: Persist UUID across query restart
Key: SPARK-18657
URL: https://issues.apache.org/jira/browse/SPARK-18657
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18588:
-
Target Version/s: 2.1.0
> KafkaSourceStressForDontFailOnDataLossSuite is flaky
>
[
https://issues.apache.org/jira/browse/SPARK-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-16545.
--
Resolution: Later
> Structured Streaming : foreachSink creates the Physical Plan multip
[
https://issues.apache.org/jira/browse/SPARK-18655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18655:
-
Fix Version/s: (was: 2.1.0)
> Ignore Structured Streaming 2.0.2 logs in history serve
[
https://issues.apache.org/jira/browse/SPARK-18655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18655:
-
Target Version/s: 2.1.0
> Ignore Structured Streaming 2.0.2 logs in history server
>
[
https://issues.apache.org/jira/browse/SPARK-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18516.
--
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15954
[htt
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reopened SPARK-18475:
--
> Be able to provide higher parallelization for StructuredStreaming Kafka Source
>
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15706692#comment-15706692
]
Michael Armbrust commented on SPARK-18475:
--
I think that this suggestion was clo
[
https://issues.apache.org/jira/browse/SPARK-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18498.
--
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15924
[htt
[
https://issues.apache.org/jira/browse/SPARK-18541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703146#comment-15703146
]
Michael Armbrust commented on SPARK-18541:
--
I don't think you can use {{as}} in
[
https://issues.apache.org/jira/browse/SPARK-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18498:
-
Target Version/s: 2.1.0 (was: 2.2.0)
> Clean up HDFSMetadataLog API for better testing
>
Michael Armbrust created SPARK-18530:
Summary: Kafka timestamp should be TimestampType
Key: SPARK-18530
URL: https://issues.apache.org/jira/browse/SPARK-18530
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18339:
-
Priority: Critical (was: Major)
> Don't push down current_timestamp for filters in Struc
[
https://issues.apache.org/jira/browse/SPARK-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18513:
-
Priority: Blocker (was: Major)
> Record and recover watermark
>
[
https://issues.apache.org/jira/browse/SPARK-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18513:
-
Target Version/s: 2.1.0
> Record and recover watermark
>
>
>
Michael Armbrust created SPARK-18529:
Summary: Timeouts shouldn't be AssertionErrors
Key: SPARK-18529
URL: https://issues.apache.org/jira/browse/SPARK-18529
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18516:
-
Description:
There are two types of information that you want to be able to extract from
[
https://issues.apache.org/jira/browse/SPARK-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18516:
-
Description:
There are two types of information that you want to be able to extract from
Michael Armbrust created SPARK-18516:
Summary: Separate instantaneous state from progress performance
statistics
Key: SPARK-18516
URL: https://issues.apache.org/jira/browse/SPARK-18516
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18339:
-
Assignee: Tyson Condie
> Don't push down current_timestamp for filters in StructuredStrea
[
https://issues.apache.org/jira/browse/SPARK-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18339:
-
Target Version/s: 2.1.0 (was: 2.2.0)
> Don't push down current_timestamp for filters in
[
https://issues.apache.org/jira/browse/SPARK-18497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18497:
-
Target Version/s: 2.1.0
> ForeachSink fails with "assertion failed: No plan for EventTime
[
https://issues.apache.org/jira/browse/SPARK-18497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18497:
-
Priority: Critical (was: Major)
> ForeachSink fails with "assertion failed: No plan for
[
https://issues.apache.org/jira/browse/SPARK-18461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18461.
--
Resolution: Fixed
Issue resolved by pull request 15897
[https://github.com/apache/spark
[
https://issues.apache.org/jira/browse/SPARK-17977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671287#comment-15671287
]
Michael Armbrust commented on SPARK-17977:
--
No, they were actually the same clas
[
https://issues.apache.org/jira/browse/SPARK-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18440.
--
Resolution: Fixed
Issue resolved by pull request 15885
[https://github.com/apache/spark
[
https://issues.apache.org/jira/browse/SPARK-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18407:
-
Description:
[This
assertion|https://github.com/apache/spark/blob/16eaad9daed0b633e6a714
Michael Armbrust created SPARK-18407:
Summary: Inferred partition columns cause assertion error
Key: SPARK-18407
URL: https://issues.apache.org/jira/browse/SPARK-18407
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652723#comment-15652723
]
Michael Armbrust commented on SPARK-17691:
--
I think that should be able to use m
[
https://issues.apache.org/jira/browse/SPARK-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18388:
-
Component/s: (was: Spark Core)
SQL
> Running aggregation on many col
[
https://issues.apache.org/jira/browse/SPARK-18211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reassigned SPARK-18211:
Assignee: Michael Armbrust
> Spark SQL ignores split.size
> --
[
https://issues.apache.org/jira/browse/SPARK-18211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18211.
--
Resolution: Not A Problem
As of Spark 2.0 we do our own splitting/bin-packing of files
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-10816:
-
Target Version/s: (was: 2.2.0)
> EventTime based sessionization
> -
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17937:
-
Target Version/s: (was: 2.1.0)
> Clarify Kafka offset semantics for Structured Streamin
[
https://issues.apache.org/jira/browse/SPARK-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-17879.
--
Resolution: Not A Problem
> Don't compact metadata logs constantly into a single compac
[
https://issues.apache.org/jira/browse/SPARK-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15651778#comment-15651778
]
Michael Armbrust edited comment on SPARK-18227 at 11/9/16 7:12 PM:
[
https://issues.apache.org/jira/browse/SPARK-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15651778#comment-15651778
]
Michael Armbrust commented on SPARK-18227:
--
The {{_spark_metadata}} directory ho
[
https://issues.apache.org/jira/browse/SPARK-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18227.
--
Resolution: Not A Problem
> Parquet file stream sink create a hidden directory "_spark_
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-15406.
--
Resolution: Done
Fix Version/s: 2.1.0
> Structured streaming support for consumi
[
https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18371:
-
Component/s: (was: Structured Streaming)
DStreams
> Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17815:
-
Issue Type: New Feature (was: Sub-task)
Parent: (was: SPARK-15406)
> Report
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17344:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-15406)
> Kafka 0
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18057:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-15406)
> Update
[
https://issues.apache.org/jira/browse/SPARK-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18373:
-
Target Version/s: 2.1.0
> Make KafkaSource's failOnDataLoss=false work with Spark jobs
>
[
https://issues.apache.org/jira/browse/SPARK-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18339:
-
Labels: (was: correctness)
> Don't push down current_timestamp for filters in Structure
[
https://issues.apache.org/jira/browse/SPARK-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1564#comment-1564
]
Michael Armbrust commented on SPARK-17691:
--
+1
> Add aggregate function to coll
[
https://issues.apache.org/jira/browse/SPARK-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18339:
-
Target Version/s: 2.2.0
> Don't push down current_timestamp for filters in StructuredStre
[
https://issues.apache.org/jira/browse/SPARK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18295.
--
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15792
[htt
[
https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-15044:
-
Target Version/s: 2.2.0
> spark-sql will throw "input path does not exist" exception if i
[
https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reopened SPARK-15044:
--
I've actually heard this complaint from several different large hive users.
Some times it
[
https://issues.apache.org/jira/browse/SPARK-18277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637622#comment-15637622
]
Michael Armbrust commented on SPARK-18277:
--
We've been talking about better supp
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637595#comment-15637595
]
Michael Armbrust commented on SPARK-18258:
--
What sort of failures are you antici
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637491#comment-15637491
]
Michael Armbrust commented on SPARK-18258:
--
I agree that we don't want to lock p
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18258:
-
Target Version/s: 2.2.0
> Sinks need access to offset representation
> --
[
https://issues.apache.org/jira/browse/SPARK-18260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18260:
-
Target Version/s: 2.1.0
Priority: Blocker (was: Major)
> from_json can throw
[
https://issues.apache.org/jira/browse/SPARK-18260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634766#comment-15634766
]
Michael Armbrust commented on SPARK-18260:
--
We should return null if the input i
[
https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18212:
-
Assignee: Cody Koeninger
> Flaky test: org.apache.spark.sql.kafka010.KafkaSourceSuite.ass
[
https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-18212.
--
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15737
[htt
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18254:
-
Target Version/s: 2.1.0
> UDFs don't see aliased column names
> -
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634122#comment-15634122
]
Michael Armbrust commented on SPARK-18254:
--
Is this yet another bug caused by th
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17937:
-
Priority: Critical (was: Major)
> Clarify Kafka offset semantics for Structured Streamin
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17937:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-15406)
> Clarify
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17937:
-
Target Version/s: 2.1.0
> Clarify Kafka offset semantics for Structured Streaming
> -
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634061#comment-15634061
]
Michael Armbrust commented on SPARK-17937:
--
I'm going to pull this out from the
Michael Armbrust created SPARK-18234:
Summary: Update mode
Key: SPARK-18234
URL: https://issues.apache.org/jira/browse/SPARK-18234
Project: Spark
Issue Type: New Feature
Compone
[
https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628170#comment-15628170
]
Michael Armbrust commented on SPARK-18212:
--
+1 to upping the timeout. We run wit
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17937:
-
Component/s: Structured Streaming
> Clarify Kafka offset semantics for Structured Streami
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-18057:
-
Component/s: Structured Streaming
> Update structured streaming kafka from 10.0.1 to 10.1
[
https://issues.apache.org/jira/browse/SPARK-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17343:
-
Component/s: (was: DStreams)
Structured Streaming
> Prerequisites fo
[
https://issues.apache.org/jira/browse/SPARK-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17837:
-
Component/s: Structured Streaming
> Disaster recovery of offsets from WAL
> -
[
https://issues.apache.org/jira/browse/SPARK-17834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17834:
-
Component/s: (was: SQL)
Structured Streaming
> Fetch the earliest of
[
https://issues.apache.org/jira/browse/SPARK-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17346:
-
Component/s: (was: DStreams)
Structured Streaming
> Kafka 0.10 suppo
[
https://issues.apache.org/jira/browse/SPARK-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-17345:
-
Component/s: (was: DStreams)
Structured Streaming
> Prerequisites fo
201 - 300 of 3953 matches
Mail list logo