Rui Li created SPARK-1937:
-
Summary: Tasks can be submitted before executors are registered
Key: SPARK-1937
URL: https://issues.apache.org/jira/browse/SPARK-1937
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated SPARK-1937:
--
Attachment: Before-patch.png
Tasks can be submitted before executors are registered
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated SPARK-1937:
--
Attachment: RSBTest.scala
The program that triggers the problem.
With the patch, the whole execution time of
Rui Li created SPARK-2277:
-
Summary: Make TaskScheduler track whether there's host on a rack
Key: SPARK-2277
URL: https://issues.apache.org/jira/browse/SPARK-2277
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050951#comment-14050951
]
Rui Li commented on SPARK-2277:
---
Suppose task1 prefers node1 but node1 is not available at
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050952#comment-14050952
]
Rui Li commented on SPARK-2277:
---
PR created at:
https://github.com/apache/spark/pull/1212
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052103#comment-14052103
]
Rui Li commented on SPARK-2277:
---
With [PR #892|https://github.com/apache/spark/pull/892],
Rui Li created SPARK-2387:
-
Summary: Remove the stage barrier for better resource utilization
Key: SPARK-2387
URL: https://issues.apache.org/jira/browse/SPARK-2387
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054862#comment-14054862
]
Rui Li commented on SPARK-2387:
---
PR created at
https://github.com/apache/spark/pull/1328
Rui Li created SPARK-2740:
-
Summary: In JavaPairRdd, allow user to specify ascending and
numPartitions for sortByKey
Key: SPARK-2740
URL: https://issues.apache.org/jira/browse/SPARK-2740
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078798#comment-14078798
]
Rui Li commented on SPARK-2387:
---
Right, thanks [~joshrosen] for pointing out. This is just
[
https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110172#comment-14110172
]
Rui Li commented on SPARK-2636:
---
Just want to make sure I understand everything correctly:
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212000#comment-14212000
]
Rui Li commented on SPARK-2321:
---
Hi [~joshrosen],
The new API is quite useful. But the
Rui Li created SPARK-4440:
-
Summary: Enhance the job progress API to expose more information
Key: SPARK-4440
URL: https://issues.apache.org/jira/browse/SPARK-4440
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214223#comment-14214223
]
Rui Li commented on SPARK-2321:
---
Hey [~joshrosen],
Thanks a lot for the update! I created
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217485#comment-14217485
]
Rui Li commented on SPARK-2321:
---
Hi [~joshrosen],
Shall we make {{SparkJobInfo}} and
[
https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256425#comment-14256425
]
Rui Li commented on SPARK-4921:
---
I'm not sure if this is intended, but returning
[
https://issues.apache.org/jira/browse/SPARK-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270714#comment-14270714
]
Rui Li commented on SPARK-2621:
---
Hey [~sandyr], it seems after this change we require the
Rui Li created SPARK-5080:
-
Summary: Expose more cluster resource information to user
Key: SPARK-5080
URL: https://issues.apache.org/jira/browse/SPARK-5080
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562386#comment-14562386
]
Rui Li commented on SPARK-7081:
---
Hi [~joshrosen], requiring the dependency having no
[
https://issues.apache.org/jira/browse/SPARK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791732#comment-14791732
]
Rui Li commented on SPARK-4440:
---
For Hive on Spark, we want completion time for each stage so we can compute
Rui Li created SPARK-14958:
--
Summary: Failed task hangs if error is encountered when getting
task result
Key: SPARK-14958
URL: https://issues.apache.org/jira/browse/SPARK-14958
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561094#comment-15561094
]
Rui Li commented on SPARK-14958:
I hit the issue with Spark 1.6.1
> Failed task hangs if error is
Rui Li created SPARK-24116:
--
Summary: SparkSQL inserting overwrite table has inconsistent
behavior regarding HDFS trash
Key: SPARK-24116
URL: https://issues.apache.org/jira/browse/SPARK-24116
Project: Spark
Rui Li created SPARK-24387:
--
Summary: Heartbeat-timeout executor is added back and used again
Key: SPARK-24387
URL: https://issues.apache.org/jira/browse/SPARK-24387
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490293#comment-16490293
]
Rui Li commented on SPARK-24387:
A snippet of the log w/ some fields masked:
{noformat}
[Stage
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490309#comment-16490309
]
Rui Li commented on SPARK-24387:
When HeartbeatReceiver finds the executor's heartbeat is timeout, it
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509214#comment-16509214
]
Rui Li commented on SPARK-24387:
Yes, blacklisting can be used to avoid the issue. But blacklist can be
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492563#comment-16492563
]
Rui Li commented on SPARK-24387:
Instead of let HeartbeatReceiver tell TaskScheduler the executor is
[
https://issues.apache.org/jira/browse/SPARK-24116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460472#comment-16460472
]
Rui Li commented on SPARK-24116:
[~hyukjin.kwon], sorry for the late response. For example, assume we
[
https://issues.apache.org/jira/browse/SPARK-24116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462040#comment-16462040
]
Rui Li commented on SPARK-24116:
To reproduce:
{code}
create table test_text(x int);
insert overwrite
Rui Li created SPARK-25085:
--
Summary: Insert overwrite a non-partitioned table can delete table
folder
Key: SPARK-25085
URL: https://issues.apache.org/jira/browse/SPARK-25085
Project: Spark
Issue
Rui Li created SPARK-24010:
--
Summary: Select from table needs read access on DB folder when
storage based auth is enabled
Key: SPARK-24010
URL: https://issues.apache.org/jira/browse/SPARK-24010
Project:
[
https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442146#comment-16442146
]
Rui Li commented on SPARK-24010:
Hi [~rxin], I think checking databaseExists is added in SPARK-14869. Do
[
https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446761#comment-16446761
]
Rui Li commented on SPARK-24010:
[~rxin], thanks for your reply. I noted that InMemoryCatalog even
35 matches
Mail list logo
