gumpcheng created SPARK-21545:
-
Summary: pyspark2
Key: SPARK-21545
URL: https://issues.apache.org/jira/browse/SPARK-21545
Project: Spark
Issue Type: Bug
Components: PySpark
Affects
[
https://issues.apache.org/jira/browse/SPARK-21545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
gumpcheng updated SPARK-21545:
--
Description:
I install spark2.2 following the official steps with CDH5.12.
Info on Cloudera Manager is
[
https://issues.apache.org/jira/browse/SPARK-21545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
gumpcheng updated SPARK-21545:
--
Description:
I install spark2.2 following the official steps with CDH5.12.
Info on Cloudera Manager is
Adrian Ionescu created SPARK-21538:
--
Summary: Attribute resolution inconsistency in Dataset API
Key: SPARK-21538
URL: https://issues.apache.org/jira/browse/SPARK-21538
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-20988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Pentreath resolved SPARK-20988.
Resolution: Fixed
Fix Version/s: 2.3.0
> Convert logistic regression to new
[
https://issues.apache.org/jira/browse/SPARK-20988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Pentreath reassigned SPARK-20988:
--
Assignee: Seth Hendrickson
> Convert logistic regression to new aggregator framework
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:08 PM:
---
Hi,
In case
Eric O. LEBIGOT (EOL) created SPARK-21537:
-
Summary: toPandas() should handle nested columns (as a Pandas
MultiIndex)
Key: SPARK-21537
URL: https://issues.apache.org/jira/browse/SPARK-21537
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:06 PM:
---
Hi,
In case
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:07 PM:
---
Hi,
In case
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-21539:
-
Description:
For spark on yarn.
Right now, when TaskSet can not run on any node or host.Which means
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101298#comment-16101298
]
Sean Owen commented on SPARK-21476:
---
[~sagraw] first someone would have to propose a fix
>
[
https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099477#comment-16099477
]
HanCheol Cho edited comment on SPARK-16784 at 7/26/17 8:27 AM:
---
Hi,
I
[
https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101459#comment-16101459
]
Hyukjin Kwon commented on SPARK-6809:
-
Hi [~davies], I can't find the APIs of pairRDD.R file in the R
[
https://issues.apache.org/jira/browse/SPARK-21537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric O. LEBIGOT (EOL) updated SPARK-21537:
--
Description:
The conversion of a *PySpark dataframe with nested columns* to
zhoukang created SPARK-21539:
Summary: Job should not be aborted when dynamic allocation is
enabled or spark.executor.instances larger then current allocated number by yarn
Key: SPARK-21539
URL:
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:09 PM:
---
Hi,
In case
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:10 PM:
---
Hi,
In case
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH edited comment on SPARK-9776 at 7/26/17 12:05 PM:
---
Hi,
In case
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101597#comment-16101597
]
Quincy HSIEH commented on SPARK-9776:
-
Hi,
In case that someone who has the same issue and comes to
[
https://issues.apache.org/jira/browse/SPARK-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101224#comment-16101224
]
jin xing commented on SPARK-21445:
--
Sorry, I report the exception by mistake.
With the change, it works
[
https://issues.apache.org/jira/browse/SPARK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21524.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18728
Hyukjin Kwon created SPARK-21536:
Summary: Remove the workaroud to allow dots in field names in R's
createDataFame
Key: SPARK-21536
URL: https://issues.apache.org/jira/browse/SPARK-21536
Project:
[
https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101452#comment-16101452
]
Nick Pentreath commented on SPARK-21535:
Parallel CV is in progress:
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101476#comment-16101476
]
Peng Meng commented on SPARK-21476:
---
Hi [~sagraw], could you please test copy pasted the transform
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101476#comment-16101476
]
Peng Meng edited comment on SPARK-21476 at 7/26/17 10:06 AM:
-
Hi [~sagraw],
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101241#comment-16101241
]
Saurabh Agrawal commented on SPARK-21476:
-
[~srowen] Can a fix for this go in the next
[
https://issues.apache.org/jira/browse/SPARK-21412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21412.
---
Resolution: Not A Problem
> Reset BufferHolder while initialize an UnsafeRowWriter
>
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101253#comment-16101253
]
Peng Meng commented on SPARK-21476:
---
Not each transform uses broadcast, do you have some experiment
[
https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099477#comment-16099477
]
HanCheol Cho edited comment on SPARK-16784 at 7/26/17 8:26 AM:
---
Hi,
I
[
https://issues.apache.org/jira/browse/SPARK-21536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101418#comment-16101418
]
Hyukjin Kwon commented on SPARK-21536:
--
BTW, my try was -
[
https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-11046.
--
Resolution: Not A Problem
I lately touched some codes around here - SPARK-20493. I assume we
[
https://issues.apache.org/jira/browse/SPARK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-21524:
-
Assignee: yuhao yang
> ValidatorParamsSuiteHelpers generates wrong temp files
>
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100151#comment-16100151
]
Saurabh Agrawal edited comment on SPARK-21476 at 7/26/17 6:56 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-21476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101443#comment-16101443
]
Saurabh Agrawal commented on SPARK-21476:
-
[~peng.m...@intel.com] My streaming application is
[
https://issues.apache.org/jira/browse/SPARK-21536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101410#comment-16101410
]
Hyukjin Kwon commented on SPARK-21536:
--
I just realised what I found while fixing this is related
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101686#comment-16101686
]
zhoukang commented on SPARK-21539:
--
I am working on this.
> Job should not be aborted when dynamic
[
https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-12957.
-
Resolution: Fixed
Fix Version/s: 2.0.0
> Derive and propagate data constrains in logical
[
https://issues.apache.org/jira/browse/SPARK-21538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-21538:
Issue Type: Improvement (was: Story)
> Attribute resolution inconsistency in Dataset API
>
[
https://issues.apache.org/jira/browse/SPARK-21538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-21538:
Affects Version/s: (was: 3.0.0)
2.3.0
> Attribute resolution inconsistency in
[
https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Seth Hendrickson updated SPARK-21245:
-
Labels: starter (was: )
Priority: Minor (was: Major)
> Resolve code duplication
[
https://issues.apache.org/jira/browse/SPARK-21087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102048#comment-16102048
]
Weichen Xu commented on SPARK-21087:
I will work on it.
> CrossValidator, TrainValidationSplit
[
https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100860#comment-16100860
]
yuhao yang edited comment on SPARK-21535 at 7/26/17 6:30 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101900#comment-16101900
]
Shivaram Venkataraman commented on SPARK-6809:
--
Yeah I dont this JIRA is applicable any more.
[
https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shivaram Venkataraman resolved SPARK-6809.
--
Resolution: Not A Problem
> Make numPartitions optional in pairRDD APIs
>
[
https://issues.apache.org/jira/browse/SPARK-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101994#comment-16101994
]
Weichen Xu commented on SPARK-17025:
Because currently, scala calling python will be difficult and
yu peng created SPARK-21540:
---
Summary: add spark.sql.functions.map_keys and
spark.sql.functions.map_values
Key: SPARK-21540
URL: https://issues.apache.org/jira/browse/SPARK-21540
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101870#comment-16101870
]
yuhao yang commented on SPARK-21535:
The basic idea is that we should release the driver memory as
[
https://issues.apache.org/jira/browse/SPARK-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101984#comment-16101984
]
Ajay Saini edited comment on SPARK-17025 at 7/26/17 5:40 PM:
-
I'm currently
[
https://issues.apache.org/jira/browse/SPARK-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101984#comment-16101984
]
Ajay Saini commented on SPARK-17025:
I'm currently working on a solution to this that involves
[
https://issues.apache.org/jira/browse/SPARK-21485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-21485.
-
Resolution: Fixed
Assignee: Hyukjin Kwon
Fix Version/s: 2.3.0
> API
[
https://issues.apache.org/jira/browse/SPARK-20418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102280#comment-16102280
]
Weichen Xu commented on SPARK-20418:
I will work on this.
> multi-label classification support
>
[
https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102274#comment-16102274
]
Weichen Xu commented on SPARK-11215:
I will take over this feature and create a PR soon.
> Add
Parth Gandhi created SPARK-21541:
Summary: Spark Logs show incorrect job status for a job that does
not create SparkContext
Key: SPARK-21541
URL: https://issues.apache.org/jira/browse/SPARK-21541
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102308#comment-16102308
]
Parth Gandhi commented on SPARK-21541:
--
Currently working on the fix, will file a pull request as
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-21541:
-
Description:
If you run a spark job without creating the SparkSession or SparkContext, the
[
https://issues.apache.org/jira/browse/SPARK-21542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-21542:
--
Component/s: ML
> Helper functions for custom Python Persistence
>
Ajay Saini created SPARK-21542:
--
Summary: Helper functions for custom Python Persistence
Key: SPARK-21542
URL: https://issues.apache.org/jira/browse/SPARK-21542
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102420#comment-16102420
]
Bryan Cutler commented on SPARK-21190:
--
Hi [~icexelloss], yes I think there is definitely some basic
[
https://issues.apache.org/jira/browse/SPARK-21542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Saini updated SPARK-21542:
---
Component/s: (was: ML)
> Helper functions for custom Python Persistence
>
[
https://issues.apache.org/jira/browse/SPARK-21542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-21542:
--
Description:
Currently, there is no way to easily persist Json-serializable parameters
[
https://issues.apache.org/jira/browse/SPARK-21540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21540.
--
Resolution: Duplicate
I guess this was added in SPARK-19975.
> add
[
https://issues.apache.org/jira/browse/SPARK-21400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Kruszewski closed SPARK-21400.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> Spark shouldn't ignore user defined
zhoukang created SPARK-21544:
Summary: Test jar of some module should not install or deploy twice
Key: SPARK-21544
URL: https://issues.apache.org/jira/browse/SPARK-21544
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102638#comment-16102638
]
Robert Kruszewski commented on SPARK-21400:
---
Fixed in
[
https://issues.apache.org/jira/browse/SPARK-21530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21530.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18735
[
https://issues.apache.org/jira/browse/SPARK-21530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21530:
---
Assignee: jin xing
> Update description of spark.shuffle.maxChunksBeingTransferred
>
[
https://issues.apache.org/jira/browse/SPARK-21533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102598#comment-16102598
]
Feng Zhu commented on SPARK-21533:
--
Could you post any examples?
> "configure(...)" method not called
zhoukang created SPARK-21543:
Summary: Should not count executor initialize failed towards task
failures
Key: SPARK-21543
URL: https://issues.apache.org/jira/browse/SPARK-21543
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang closed SPARK-21539.
Resolution: Not A Problem
> Job should not be aborted when dynamic allocation is enabled or
>
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang updated SPARK-21539:
-
Affects Version/s: (was: 2.2.0)
> Job should not be aborted when dynamic allocation is enabled or
>
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhoukang reopened SPARK-21539:
--
> Job should not be aborted when dynamic allocation is enabled or
> spark.executor.instances larger then
[
https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101686#comment-16101686
]
zhoukang edited comment on SPARK-21539 at 7/27/17 2:06 AM:
---
I want to report
73 matches
Mail list logo