[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375005#comment-16375005
]
Imran Rashid commented on SPARK-23485:
--
{quote}
I think this is because the general expectation is
[
https://issues.apache.org/jira/browse/SPARK-21740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375134#comment-16375134
]
Dheeren Beborrtha commented on SPARK-21740:
---
What workaround did you use? DId you modify
[
https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-23459.
-
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 2.4.0
> Improve the error
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-23408:
--
Fix Version/s: 2.4.0
> Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on
[
https://issues.apache.org/jira/browse/SPARK-23502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375051#comment-16375051
]
Sital Kedia commented on SPARK-23502:
-
I realized that we are printing the web url link and the
[
https://issues.apache.org/jira/browse/SPARK-23502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375119#comment-16375119
]
Sean Owen commented on SPARK-23502:
---
It does introduce some new cases to deal with, like, what happens
Marcelo Vanzin created SPARK-23504:
--
Summary: Flaky test: RateSourceV2Suite.basic microbatch execution
Key: SPARK-23504
URL: https://issues.apache.org/jira/browse/SPARK-23504
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375254#comment-16375254
]
Marcelo Vanzin commented on SPARK-23475:
https://github.com/apache/spark/pull/20662 was merged to
Marcelo Vanzin created SPARK-23505:
--
Summary: Flaky test: ParquetQuerySuite
Key: SPARK-23505
URL: https://issues.apache.org/jira/browse/SPARK-23505
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375305#comment-16375305
]
Arun Manivannan commented on SPARK-20592:
-
x
> Alter table concatenate is not working as
[
https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun Manivannan updated SPARK-20592:
Comment: was deleted
(was: x)
> Alter table concatenate is not working as expected.
>
guichaoxian created SPARK-23506:
---
Summary: Add refreshByPath in HiveMetastoreCatalog and
invalidByPath in FileStatusCache
Key: SPARK-23506
URL: https://issues.apache.org/jira/browse/SPARK-23506
[
https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375386#comment-16375386
]
Apache Spark commented on SPARK-23448:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374708#comment-16374708
]
Yinan Li commented on SPARK-23485:
--
In the Yarn case, yes, it's possible that a node is missing a jar
Kevin Zhang created SPARK-23498:
---
Summary: Accuracy problem in comparison with string and integer
Key: SPARK-23498
URL: https://issues.apache.org/jira/browse/SPARK-23498
Project: Spark
Issue
Pascal GILLET created SPARK-23499:
-
Summary: Mesos Cluster Dispatcher should support priority queues
to submit drivers
Key: SPARK-23499
URL: https://issues.apache.org/jira/browse/SPARK-23499
Project:
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pascal GILLET updated SPARK-23499:
--
Description:
As for Yarn, Mesos users should be able to specify priority queues to define a
Henry Robinson created SPARK-23500:
--
Summary: Filters on named_structs could be pushed into scans
Key: SPARK-23500
URL: https://issues.apache.org/jira/browse/SPARK-23500
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374490#comment-16374490
]
AIT OUFKIR commented on SPARK-23495:
After several checks, I noticed that the issue comes from the
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Zhang updated SPARK-23498:
Description:
While comparing a string column with integer value, spark sql will
automatically
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374745#comment-16374745
]
Anirudh Ramanathan commented on SPARK-23485:
While mostly I think that K8s would be better
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374745#comment-16374745
]
Anirudh Ramanathan edited comment on SPARK-23485 at 2/23/18 6:00 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374748#comment-16374748
]
Imran Rashid commented on SPARK-23485:
--
ok the missing jar was a bad example on kubernetes ... I
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374757#comment-16374757
]
Yinan Li commented on SPARK-23485:
--
It's not that I'm too confident on the capability of Kubernetes to
Xiaoju Wu created SPARK-23493:
-
Summary: insert-into depends on columns order, otherwise incorrect
data inserted
Key: SPARK-23493
URL: https://issues.apache.org/jira/browse/SPARK-23493
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374073#comment-16374073
]
Xiaoju Wu commented on SPARK-9278:
--
Created a new ticket to trace this issue SPARK-23493
>
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374076#comment-16374076
]
Xiaoju Wu commented on SPARK-23493:
---
This issue is similar with the issue described in ticket
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoju Wu updated SPARK-23493:
--
Description:
insert-into only works when the partitionby key columns are set at last:
val data = Seq(
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374506#comment-16374506
]
Ala Luszczak commented on SPARK-23496:
--
I agree that this solution is merely making the problem
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374530#comment-16374530
]
Marco Gaido commented on SPARK-23496:
-
[~ala.luszczak] thanks for your answer. Honestly I don't see
bharath kumar created SPARK-23497:
-
Summary: Sparklyr Applications doesn't disconnect spark driver in
client mode
Key: SPARK-23497
URL: https://issues.apache.org/jira/browse/SPARK-23497
Project:
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374599#comment-16374599
]
Imran Rashid commented on SPARK-23485:
--
Yeah I don't think its safe to assume that its kubernetes
Marco Gaido created SPARK-23501:
---
Summary: Refactor AllStagesPage in order to avoid redundant code
Key: SPARK-23501
URL: https://issues.apache.org/jira/browse/SPARK-23501
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23499:
Assignee: Apache Spark
> Mesos Cluster Dispatcher should support priority queues to
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374768#comment-16374768
]
Apache Spark commented on SPARK-23499:
--
User 'pgillet' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23499:
Assignee: (was: Apache Spark)
> Mesos Cluster Dispatcher should support priority
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374775#comment-16374775
]
Apache Spark commented on SPARK-23501:
--
User 'mgaido91' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23501:
Assignee: (was: Apache Spark)
> Refactor AllStagesPage in order to avoid redundant
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23501:
Assignee: Apache Spark
> Refactor AllStagesPage in order to avoid redundant code
>
[
https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-20680:
--
Assignee: Marcelo Vanzin
> Spark-sql do not support for void column datatype of view
[
https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374830#comment-16374830
]
Keepun commented on SPARK-23471:
Saved to AWS s3://
> RandomForestClassificationModel save() - incorrect
[
https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374841#comment-16374841
]
Xuefu Zhang commented on SPARK-5377:
[~shay_elbaz] I think the issue was closed purely because no one
Jose Torres created SPARK-23503:
---
Summary: continuous execution should sequence committed epochs
Key: SPARK-23503
URL: https://issues.apache.org/jira/browse/SPARK-23503
Project: Spark
Issue
Sital Kedia created SPARK-23502:
---
Summary: Support async init of spark context during spark-shell
startup
Key: SPARK-23502
URL: https://issues.apache.org/jira/browse/SPARK-23502
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374872#comment-16374872
]
Sönke Liebau commented on SPARK-18057:
--
Alright.
I've got a 12h flight to SF ahead of me on Sunday,
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374778#comment-16374778
]
Stavros Kontopoulos commented on SPARK-23485:
-
How about locality preferences + a hardware
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henry Robinson updated SPARK-23500:
---
Description:
Simple filters on dataframes joined with {{joinWith()}} are missing an
[
https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-20680:
--
Assignee: (was: Marcelo Vanzin)
> Spark-sql do not support for void column
[
https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Keepun updated SPARK-23471:
---
Description:
RandomForestClassificationMode.load() does not work after save()
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374778#comment-16374778
]
Stavros Kontopoulos edited comment on SPARK-23485 at 2/23/18 6:59 PM:
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374757#comment-16374757
]
Yinan Li edited comment on SPARK-23485 at 2/23/18 6:22 PM:
---
It's not that I'm
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374778#comment-16374778
]
Stavros Kontopoulos edited comment on SPARK-23485 at 2/23/18 6:36 PM:
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374884#comment-16374884
]
Anirudh Ramanathan commented on SPARK-23485:
Stavros - we [do currently
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374884#comment-16374884
]
Anirudh Ramanathan edited comment on SPARK-23485 at 2/23/18 7:36 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-23408.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20650
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-23408:
-
Assignee: Tathagata Das
> Flaky test: StreamingOuterJoinSuite.left outer early state
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374218#comment-16374218
]
Javier commented on SPARK-21550:
I still observe this behavior in 2.2.0 when approxQuantile is applied to
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374218#comment-16374218
]
Javier edited comment on SPARK-21550 at 2/23/18 10:58 AM:
--
I still observe this
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374218#comment-16374218
]
Javier edited comment on SPARK-21550 at 2/23/18 10:59 AM:
--
I still observe this
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: TaskScheduler_stop.png
> [SS]Exception when stopping continuous processing application
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: (was: TaskScheduler_stop.png)
> [SS]Exception when stopping continuous processing
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374266#comment-16374266
]
Xiaoju Wu commented on SPARK-23493:
---
If that's the case, it should throw an exception to tell the users
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: TaskScheduler_stop.png
> [SS]Exception when stopping continuous processing application
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374236#comment-16374236
]
Wang Yanlin commented on SPARK-23350:
-
add the sequence flow for explainning this error
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374258#comment-16374258
]
Marco Gaido commented on SPARK-23493:
-
I don't think so. Partition columns are always at the end. If
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374139#comment-16374139
]
Apache Spark commented on SPARK-23475:
--
User 'mgaido91' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374146#comment-16374146
]
Marco Gaido commented on SPARK-23493:
-
I don't think this is an issue. I think this is the expected
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374172#comment-16374172
]
Xiaoju Wu commented on SPARK-23493:
---
[~mgaido] "Columns are matched in order while inserting" This is
[
https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374182#comment-16374182
]
KaiXinXIaoLei commented on SPARK-23405:
---
[~q79969786] And if i run 'select ls.cs_order_number from
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374358#comment-16374358
]
Marco Gaido commented on SPARK-23493:
-
How can it know that you are not setting the partition column
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374360#comment-16374360
]
Apache Spark commented on SPARK-23475:
--
User 'mgaido91' has created a pull request for this issue:
David Courtinot created SPARK-23494:
---
Summary: Expose InferSchema's functionalities to the outside
Key: SPARK-23494
URL: https://issues.apache.org/jira/browse/SPARK-23494
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Summary: Creating a json file using a dataframe Generates an issue (was:
Creating a json file using
AIT OUFKIR created SPARK-23495:
--
Summary: Creating a json file using a dataframe creates an issue
Key: SPARK-23495
URL: https://issues.apache.org/jira/browse/SPARK-23495
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Description:
Issue happen when trying to create json file using a dataframe (see code below)
from
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Flags: Important
Remaining Estimate: 4h
Original Estimate: 4h
This issue can
Ala Luszczak created SPARK-23496:
Summary: Locality of coalesced partitions can be severely skewed
by the order of input partitions
Key: SPARK-23496
URL: https://issues.apache.org/jira/browse/SPARK-23496
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Description:
Issue happen when trying to create json file using a dataframe (see code below)
from
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23496:
Assignee: Apache Spark
> Locality of coalesced partitions can be severely skewed by the
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374429#comment-16374429
]
Apache Spark commented on SPARK-23496:
--
User 'ala' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23496:
Assignee: (was: Apache Spark)
> Locality of coalesced partitions can be severely
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374439#comment-16374439
]
Marco Gaido commented on SPARK-23496:
-
I read that the proposed solution is to use random numbers
85 matches
Mail list logo
