Carson Wang created SPARK-9809:
--
Summary: Task crashes because the internal accumulators are not
properly initialized
Key: SPARK-9809
URL: https://issues.apache.org/jira/browse/SPARK-9809
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9809:
---
Assignee: Apache Spark
Task crashes because the internal accumulators are not properly
[
https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-9809:
---
Description:
When a stage failed and another stage was resubmitted with only part of
partitions to
[
https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9809:
---
Assignee: (was: Apache Spark)
Task crashes because the internal accumulators are not
[
https://issues.apache.org/jira/browse/SPARK-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-9801.
--
Resolution: Fixed
Fix Version/s: 1.5.0
1.4.2
1.3.2
Karen Yin-Yee Ng created SPARK-9807:
---
Summary: pyspark.sql.createDataFrame does not infer data type of
parsed TSV
Key: SPARK-9807
URL: https://issues.apache.org/jira/browse/SPARK-9807
Project:
[
https://issues.apache.org/jira/browse/SPARK-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohit Agarwal updated SPARK-9806:
-
Description:
Currently, we are sharing {{ReplayListenerBus}} for replaying the event logs of
Josh Rosen created SPARK-9808:
-
Summary: Remove hash shuffle file consolidation
Key: SPARK-9808
URL: https://issues.apache.org/jira/browse/SPARK-9808
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681078#comment-14681078
]
Apache Spark commented on SPARK-9808:
-
User 'JoshRosen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9808:
---
Assignee: Apache Spark (was: Josh Rosen)
Remove hash shuffle file consolidation
[
https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9808:
---
Assignee: Josh Rosen (was: Apache Spark)
Remove hash shuffle file consolidation
[
https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681082#comment-14681082
]
Josh Rosen commented on SPARK-9808:
---
Note that we can close
[
https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-9808:
---
Target Version/s: 1.6.0
Remove hash shuffle file consolidation
[
https://issues.apache.org/jira/browse/SPARK-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9810:
---
Assignee: Apache Spark (was: Reynold Xin)
Remove individual commit messages from the
[
https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681102#comment-14681102
]
Apache Spark commented on SPARK-9809:
-
User 'carsonwang' has created a pull request
Reynold Xin created SPARK-9810:
--
Summary: Remove individual commit messages from the squash commit
message
Key: SPARK-9810
URL: https://issues.apache.org/jira/browse/SPARK-9810
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680038#comment-14680038
]
Sean Owen commented on SPARK-9636:
--
Easy there, I just meant without failing. Your
[
https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9778:
---
Assignee: (was: Apache Spark)
remove unnecessary evaluation from SortOrder
[
https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9778:
---
Assignee: Apache Spark
remove unnecessary evaluation from SortOrder
[
https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679750#comment-14679750
]
Apache Spark commented on SPARK-9778:
-
User 'cloud-fan' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-9779:
Description:
When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500
error as
[
https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-9779:
Description:
When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500
error as
[
https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9779.
--
Resolution: Duplicate
Fix Version/s: (was: 1.4.2)
[~hujiayin] Don't open duplicate issues.
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679772#comment-14679772
]
Sean Owen commented on SPARK-5837:
--
[~hujiayin] this isn't enough information to advance
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679814#comment-14679814
]
zhouxiaoke commented on SPARK-9590:
---
This function is needed?
support metaq to
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679847#comment-14679847
]
zhouxiaoke commented on SPARK-9590:
---
metaq like kafka is a message queue . We are using
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679846#comment-14679846
]
zhouxiaoke commented on SPARK-9590:
---
metaq like kafka is a message queue . We are using
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679844#comment-14679844
]
zhouxiaoke commented on SPARK-9590:
---
metaq like kafka is a message queue . We are using
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679857#comment-14679857
]
Sean Owen commented on SPARK-9744:
--
join returns something different than cogroup. It
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679879#comment-14679879
]
Jerry Z commented on SPARK-9744:
What's PR short for??? I may have misunderstood things.
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679782#comment-14679782
]
hujiayin commented on SPARK-5837:
-
yes, I've tried all the setting above. The issue just
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-5837:
Comment: was deleted
(was: The master doesn't have this problem. The other parts works well except
the
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679817#comment-14679817
]
hujiayin commented on SPARK-5837:
-
The master doesn't have this problem. The other parts
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679849#comment-14679849
]
Jerry Z commented on SPARK-9744:
With regards to cogroup, I phrased that badly, but meant
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679849#comment-14679849
]
Jerry Z edited comment on SPARK-9744 at 8/10/15 9:34 AM:
-
With
Wenchen Fan created SPARK-9778:
--
Summary: remove unnecessary evaluation from SortOrder
Key: SPARK-9778
URL: https://issues.apache.org/jira/browse/SPARK-9778
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679745#comment-14679745
]
Sean Owen commented on SPARK-9776:
--
I can't reproduce this. Creating a new HiveContext
hujiayin created SPARK-9779:
---
Summary: HTTP500 revisit when open web-UI in yarn-cluster
yarn-client mode (1.2-1.3)
Key: SPARK-9779
URL: https://issues.apache.org/jira/browse/SPARK-9779
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679792#comment-14679792
]
Damian Guy commented on SPARK-9340:
---
Hi, I did try it against the 1.5 and the problem
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679798#comment-14679798
]
Sean Owen commented on SPARK-5837:
--
What about master? it sounds like you're suggesting
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-9744:
-
Component/s: Spark Core
Add RDD method to map with lag and lead
---
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9590.
--
Resolution: Invalid
Fix Version/s: (was: 1.4.2)
Target Version/s: (was: 1.4.1)
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679818#comment-14679818
]
hujiayin commented on SPARK-5837:
-
The master doesn't have this problem. The other parts
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679719#comment-14679719
]
Cheng Lian commented on SPARK-9340:
---
Would like to add that, parquet-avro can be from
[
https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9476.
--
Resolution: Not A Problem
Kafka stream loses leader after 2h of operation
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679719#comment-14679719
]
Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:45 AM:
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679730#comment-14679730
]
hujiayin commented on SPARK-5837:
-
Hi Sean,
I meet this problem on spark 1.2 1.2.1 1.2.2
[
https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679733#comment-14679733
]
Sean Owen commented on SPARK-9636:
--
I think writing to the local directory is the least
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
prakhar jauhari updated SPARK-9396:
---
Affects Version/s: 1.2.2
Spark yarn allocator does not call removeContainerRequest for
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679684#comment-14679684
]
Cheng Lian commented on SPARK-9340:
---
[~damianguy] This is actually a Parquet complex
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679715#comment-14679715
]
Apache Spark commented on SPARK-9396:
-
User 'prakhar-jauhari' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-9742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9742.
--
Resolution: Duplicate
Assignee: (was: Burak Yavuz)
Target Version/s: (was:
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9396:
---
Assignee: Apache Spark
Spark yarn allocator does not call removeContainerRequest for
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9396:
---
Assignee: (was: Apache Spark)
Spark yarn allocator does not call removeContainerRequest
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679719#comment-14679719
]
Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:40 AM:
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679725#comment-14679725
]
prakhar jauhari commented on SPARK-9396:
Hey,
Can some one please review the PR.
[
https://issues.apache.org/jira/browse/SPARK-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9638.
--
Resolution: Duplicate
.save() Procedure fails
---
Key:
[
https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu updated SPARK-9686:
--
Assignee: Cheng Lian
Spark hive jdbc client cannot get table from metadata store
[
https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-9375.
--
Resolution: Duplicate
The total number of executor(s) requested by the driver may be negative
[
https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-9396:
-
Priority: Minor (was: Major)
Issue Type: Improvement (was: Bug)
Spark yarn allocator does not
[
https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679719#comment-14679719
]
Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:43 AM:
[
https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679918#comment-14679918
]
Yanbo Liang commented on SPARK-8518:
[~mengxr] [~meihuawu]
I have update the design
[
https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679904#comment-14679904
]
Sean Owen commented on SPARK-9744:
--
Github Pull Request. I think it's easiest if you
[
https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679943#comment-14679943
]
Andreas commented on SPARK-9746:
Now I see my mistake:
I did
Grigory Turunov created SPARK-9780:
--
Summary: In case of invalid initialization of KafkaDirectStream,
NPE is thrown
Key: SPARK-9780
URL: https://issues.apache.org/jira/browse/SPARK-9780
Project:
[
https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680109#comment-14680109
]
Thomas Graves commented on SPARK-9019:
--
We forgot to close out the jira. This was
[
https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-9019.
Resolution: Won't Fix
spark-submit fails on yarn with kerberos enabled
[
https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680140#comment-14680140
]
Apache Spark commented on SPARK-7542:
-
User 'viirya' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7542:
---
Assignee: (was: Apache Spark)
Support off-heap sort buffer in UnsafeExternalSorter
[
https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680002#comment-14680002
]
Philipp Angerer commented on SPARK-9636:
quietly
Huh?
Again: The script *does*
[
https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680017#comment-14680017
]
zhouxiaoke commented on SPARK-9590:
---
can i put it contribute out of it?
support metaq
[
https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9773:
---
Assignee: Apache Spark
Add Python API for MultilayerPerceptronClassifier
[
https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679964#comment-14679964
]
Apache Spark commented on SPARK-9773:
-
User 'yanboliang' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-9773:
---
Assignee: (was: Apache Spark)
Add Python API for MultilayerPerceptronClassifier
[
https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7542:
---
Assignee: Apache Spark
Support off-heap sort buffer in UnsafeExternalSorter
[
https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680154#comment-14680154
]
Lior Chaga commented on SPARK-4300:
---
Also exists in spark 1.4:
{panel}
12:31:10.821
201 - 276 of 276 matches
Mail list logo
