[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622932#comment-16622932
]
Reynold Xin commented on SPARK-23715:
-
we can't fail queries in 2.x.
> from_utc_timestamp
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622807#comment-16622807
]
Reynold Xin edited comment on SPARK-10816 at 9/20/18 10:30 PM:
---
I will let
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622807#comment-16622807
]
Reynold Xin commented on SPARK-10816:
-
I will let [~marmbrus] chime in ... As the initial person
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622802#comment-16622802
]
Reynold Xin commented on SPARK-23715:
-
Great discussions. Since you don't mind, let's revert the
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622599#comment-16622599
]
Reynold Xin commented on SPARK-10816:
-
So I've actually run this idea by a lot of users, and almost
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621405#comment-16621405
]
Reynold Xin commented on SPARK-23715:
-
Also I reject the notion that the old behavior was
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621395#comment-16621395
]
Reynold Xin commented on SPARK-23715:
-
[~bersprockets] i think we should revert the change while we
[
https://issues.apache.org/jira/browse/SPARK-19724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-19724.
-
Resolution: Fixed
Assignee: Gengliang Wang
Fix Version/s: 2.4.0
> create a
[
https://issues.apache.org/jira/browse/SPARK-24626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-24626.
-
Resolution: Fixed
Assignee: Reynold Xin
Fix Version/s: 2.4.0
> Parallelize size
[
https://issues.apache.org/jira/browse/SPARK-24626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-24626:
Summary: Parallelize size calculation in Analyze Table command (was:
Improve Analyze Table
[
https://issues.apache.org/jira/browse/SPARK-19489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610810#comment-16610810
]
Reynold Xin commented on SPARK-19489:
-
We can close this now.
> Stable serialization format for
[
https://issues.apache.org/jira/browse/SPARK-25331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609892#comment-16609892
]
Reynold Xin commented on SPARK-25331:
-
Yes I would rely on idempotency here. Retries upon failure +
[
https://issues.apache.org/jira/browse/SPARK-23580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609787#comment-16609787
]
Reynold Xin commented on SPARK-23580:
-
90% or 100%?
> Interpreted mode fallback should be
[
https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589050#comment-16589050
]
Reynold Xin commented on SPARK-25196:
-
Can we rework the interface so the two are not separate code
[
https://issues.apache.org/jira/browse/SPARK-25127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin reassigned SPARK-25127:
---
Assignee: Reynold Xin
> DataSourceV2: Remove SupportsPushDownCatalystFilters
>
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568454#comment-16568454
]
Reynold Xin commented on SPARK-24924:
-
I like the improved error message (I didn't read the earlier
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567383#comment-16567383
]
Reynold Xin commented on SPARK-14220:
-
This is awesome! Congrats!
> Build and test Spark against
[
https://issues.apache.org/jira/browse/SPARK-24982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin reassigned SPARK-24982:
---
Assignee: Reynold Xin
> UDAF resolution should not throw java.lang.AssertionError
>
[
https://issues.apache.org/jira/browse/SPARK-24982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-24982:
Description:
See udaf.sql.out:
{code:java}
– !query 3
SELECT default.myDoubleAvg(int_col1, 3)
Reynold Xin created SPARK-24982:
---
Summary: UDAF resolution should not throw java.lang.AssertionError
Key: SPARK-24982
URL: https://issues.apache.org/jira/browse/SPARK-24982
Project: Spark
Reynold Xin created SPARK-24951:
---
Summary: Table valued functions should throw AnalysisException
instead of IllegalArgumentException
Key: SPARK-24951
URL: https://issues.apache.org/jira/browse/SPARK-24951
[
https://issues.apache.org/jira/browse/SPARK-24874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556241#comment-16556241
]
Reynold Xin commented on SPARK-24874:
-
Do we really need this? Seems like an uncommon use case.
[
https://issues.apache.org/jira/browse/SPARK-24865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-24865:
Affects Version/s: 2.3.0
> Remove AnalysisBarrier
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-24865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-24865:
Description:
AnalysisBarrier was introduced in SPARK-20392 to improve analysis speed (don't
Reynold Xin created SPARK-24865:
---
Summary: Remove AnalysisBarrier
Key: SPARK-24865
URL: https://issues.apache.org/jira/browse/SPARK-24865
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549724#comment-16549724
]
Reynold Xin commented on SPARK-15689:
-
Is there an umbrella ticket on improving the dsv2 api? If
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545446#comment-16545446
]
Reynold Xin edited comment on SPARK-23901 at 7/16/18 4:31 PM:
--
I actually
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545446#comment-16545446
]
Reynold Xin commented on SPARK-23901:
-
I actually feel pretty strongly we should remove them.
>
[
https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540468#comment-16540468
]
Reynold Xin commented on SPARK-20202:
-
Yea you can try and see how difficult it is.
> Remove
[
https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540454#comment-16540454
]
Reynold Xin commented on SPARK-20202:
-
If you want to try and put together a PR that actually does
[
https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530643#comment-16530643
]
Reynold Xin commented on SPARK-24579:
-
I can't either.
> SPIP: Standardize Optimized Data
[
https://issues.apache.org/jira/browse/SPARK-24642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525548#comment-16525548
]
Reynold Xin commented on SPARK-24642:
-
[~maxgekk] I think this is too complicated and unpredictable.
[
https://issues.apache.org/jira/browse/SPARK-24642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524590#comment-16524590
]
Reynold Xin commented on SPARK-24642:
-
Do we want this as an aggregate function? I'm thinking it's
[
https://issues.apache.org/jira/browse/SPARK-19480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-19480.
-
Resolution: Duplicate
Target Version/s: (was: 2.4.0, 3.0.0)
> Higher order
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514667#comment-16514667
]
Reynold Xin commented on SPARK-23901:
-
Why are we adding 1200 lines of code for some functions that
[
https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500639#comment-16500639
]
Reynold Xin commented on SPARK-24359:
-
Why would a separate repo lead to faster iteration? What's
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493
]
Reynold Xin edited comment on SPARK-24374 at 6/1/18 8:05 PM:
-
Just thought
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493
]
Reynold Xin commented on SPARK-24374:
-
Just thought of this — Continuous Processing really requires
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493
]
Reynold Xin edited comment on SPARK-24374 at 6/1/18 8:02 PM:
-
Just thought
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488
]
Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:58 PM:
-
That breaks
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488
]
Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:57 PM:
-
That breaks
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488
]
Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:57 PM:
-
That breaks
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488
]
Reynold Xin commented on SPARK-24374:
-
That breaks end to end FT right?
> SPIP: Support Barrier
[
https://issues.apache.org/jira/browse/SPARK-24442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497087#comment-16497087
]
Reynold Xin commented on SPARK-24442:
-
Actually a pretty good idea. I've often wished there's a way
[
https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460116#comment-16460116
]
Reynold Xin commented on SPARK-23074:
-
It should give you the same ordering - that's the
[
https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459979#comment-16459979
]
Reynold Xin commented on SPARK-23074:
-
Can your problem be solved by monotonically_increasing_id,
[
https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442802#comment-16442802
]
Reynold Xin commented on SPARK-24010:
-
It's better to throw an error message to tell the user the db
[
https://issues.apache.org/jira/browse/SPARK-23964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434460#comment-16434460
]
Reynold Xin commented on SPARK-23964:
-
Was it trying to reduce overhead?
> why does Spillable
[
https://issues.apache.org/jira/browse/SPARK-23852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423479#comment-16423479
]
Reynold Xin commented on SPARK-23852:
-
Does turning the flag parquet.filter.stats.enabled off also
[
https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423048#comment-16423048
]
Reynold Xin commented on SPARK-21363:
-
How can user drop the fields or rename them after joins?
>
[
https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412007#comment-16412007
]
Reynold Xin commented on SPARK-23772:
-
This is a good change to do!
> Provide an option to ignore
[
https://issues.apache.org/jira/browse/SPARK-23325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389135#comment-16389135
]
Reynold Xin commented on SPARK-23325:
-
Yes perhaps we should do that. It is a lot more work than what
[
https://issues.apache.org/jira/browse/SPARK-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356536#comment-16356536
]
Reynold Xin commented on SPARK-20090:
-
Do you mind doing it? Thanks.
> Add StructType.fieldNames
[
https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351260#comment-16351260
]
Reynold Xin commented on SPARK-21658:
-
I'd revert this one first. I'd even consider the other one a
[
https://issues.apache.org/jira/browse/SPARK-23081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351186#comment-16351186
]
Reynold Xin commented on SPARK-23081:
-
Scala and Python actually. Sorry I was only commmenting on
[
https://issues.apache.org/jira/browse/SPARK-20425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350876#comment-16350876
]
Reynold Xin commented on SPARK-20425:
-
Hey so I don't think we should be doing multiple boolean
[
https://issues.apache.org/jira/browse/SPARK-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350861#comment-16350861
]
Reynold Xin commented on SPARK-20090:
-
Why would we deprecate this? I'd probably add names to Scala
[
https://issues.apache.org/jira/browse/SPARK-23081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350852#comment-16350852
]
Reynold Xin commented on SPARK-23081:
-
Sorry why are we adding things like this? I see the value of
[
https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350848#comment-16350848
]
Reynold Xin commented on SPARK-21658:
-
Sorry but I object to this change. Why would we put null as
[
https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339794#comment-16339794
]
Reynold Xin commented on SPARK-23173:
-
Yea I agree with you Herman.
On Sun, Jan 21, 2018 at 5:44 PM
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327453#comment-16327453
]
Reynold Xin commented on SPARK-21274:
-
Can't we rewrite this as two aggregates and a join?
>
[
https://issues.apache.org/jira/browse/SPARK-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326619#comment-16326619
]
Reynold Xin commented on SPARK-23083:
-
Here's the website repo:
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319147#comment-16319147
]
Reynold Xin commented on SPARK-22853:
-
Thanks for looking into this.
> K8s or Kubernetes?
>
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-22853.
-
Resolution: Fixed
Assignee: Anirudh Ramanathan
> K8s or Kubernetes?
> --
>
[
https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313419#comment-16313419
]
Reynold Xin commented on SPARK-22947:
-
Yes you convinced me. This seems too annoying to express in
[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312398#comment-16312398
]
Reynold Xin commented on SPARK-7721:
I think it's fine even if you don't preserve the history forever
[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311731#comment-16311731
]
Reynold Xin commented on SPARK-7721:
We can add it first but in my experience this will only be used
[
https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311673#comment-16311673
]
Reynold Xin commented on SPARK-22947:
-
Basically we should separate the logical plan from the
[
https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311667#comment-16311667
]
Reynold Xin commented on SPARK-22947:
-
So this is just a hint that there is only one matching tuple
[
https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310388#comment-16310388
]
Reynold Xin commented on SPARK-22947:
-
Li,
Why are these not just normal inner joins with conditions
[
https://issues.apache.org/jira/browse/SPARK-22648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-22648.
-
Resolution: Fixed
Assignee: Anirudh Ramanathan
Fix Version/s: 2.3.0
>
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300363#comment-16300363
]
Reynold Xin commented on SPARK-22853:
-
I think most of your questions can be answered by Google
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299632#comment-16299632
]
Reynold Xin commented on SPARK-22853:
-
I personally prefer "k8s", since it is way simpler, but I
[
https://issues.apache.org/jira/browse/SPARK-22825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296305#comment-16296305
]
Reynold Xin commented on SPARK-22825:
-
[~maropu] you should :)
> Incorrect results of Casting Array
[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290134#comment-16290134
]
Reynold Xin commented on SPARK-7721:
We definitely don't need to do it in one-go, but with all the
Reynold Xin created SPARK-22779:
---
Summary: ConfigEntry's default value should actually be a value
Key: SPARK-22779
URL: https://issues.apache.org/jira/browse/SPARK-22779
Project: Spark
Issue
Reynold Xin created SPARK-22710:
---
Summary: ConfigBuilder.fallbackConf doesn't trigger onCreate
function
Key: SPARK-22710
URL: https://issues.apache.org/jira/browse/SPARK-22710
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266358#comment-16266358
]
Reynold Xin commented on SPARK-7721:
This is really cool. I took a look but it looks like doctests are
[
https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263589#comment-16263589
]
Reynold Xin commented on SPARK-21866:
-
Why not just declare an image function that loads the image
[
https://issues.apache.org/jira/browse/SPARK-22369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-22369.
-
Resolution: Fixed
Assignee: Hyukjin Kwon
Fix Version/s: 2.3.0
> PySpark:
[
https://issues.apache.org/jira/browse/SPARK-22408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-22408.
-
Resolution: Fixed
Assignee: Patrick Woody
Fix Version/s: 2.3.0
>
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234428#comment-16234428
]
Reynold Xin commented on SPARK-20928:
-
Maybe we can add some information metadata (like a string to
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224122#comment-16224122
]
Reynold Xin commented on SPARK-15689:
-
Why not put all of them as subtasks here?
Also
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220956#comment-16220956
]
Reynold Xin commented on SPARK-20928:
-
That doesn't yet exist does it? How would that work for
[
https://issues.apache.org/jira/browse/SPARK-21043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217415#comment-16217415
]
Reynold Xin commented on SPARK-21043:
-
Because some people expect union by position too.
> Add
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20928:
Attachment: Continuous Processing in Structured Streaming Design Sketch.pdf
> SPIP: Continuous
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20928:
Attachment: (was: Continuous Processing in Structured Streaming Design
Sketch.pdf)
> SPIP:
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20928:
Summary: SPIP: Continuous Processing Mode for Structured Streaming (was:
Continuous Processing
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20928:
Attachment: Continuous Processing in Structured Streaming Design Sketch.pdf
> Continuous
[
https://issues.apache.org/jira/browse/SPARK-22325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin deleted SPARK-22325:
> SPARK_TESTING env variable breaking non-spark builds on amplab jenkins
>
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202924#comment-16202924
]
Reynold Xin edited comment on SPARK-20928 at 10/13/17 1:40 AM:
---
OK got it -
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202924#comment-16202924
]
Reynold Xin commented on SPARK-20928:
-
OK got it - you are basically saying if we can send the offset
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202906#comment-16202906
]
Reynold Xin commented on SPARK-20928:
-
Isn't there an issue with the overhead of tracking in the
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202621#comment-16202621
]
Reynold Xin commented on SPARK-20928:
-
[~c...@koeninger.org] can you write down your thoughts on how
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20928:
Labels: SPIP (was: )
> Continuous Processing Mode for Structured Streaming
>
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198301#comment-16198301
]
Reynold Xin commented on SPARK-22231:
-
For drop columns - why not just df.drop("items.b")?
>
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198306#comment-16198306
]
Reynold Xin commented on SPARK-22231:
-
Can you say more? I can't think of a case in which you'd want
[
https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin reassigned SPARK-20396:
---
Assignee: Li Jin
> groupBy().apply() with pandas udf in pyspark
>
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-21190:
Issue Type: Sub-task (was: New Feature)
Parent: SPARK-22216
> SPIP: Vectorized UDFs in
[
https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-20396:
Issue Type: Sub-task (was: New Feature)
Parent: SPARK-22216
> groupBy().apply() with
101 - 200 of 7166 matches
Mail list logo
