HyukjinKwon commented on pull request #28106:
URL: https://github.com/apache/spark/pull/28106#issuecomment-624456778
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
AmplabJenkins removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624455787
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624455782
Build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To respond
SparkQA removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624448823
**[Test build #122341 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122341/testReport)**
for PR 27473 at commit
SparkQA commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624455749
**[Test build #122341 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122341/testReport)**
for PR 27473 at commit
AmplabJenkins commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624455782
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
HyukjinKwon edited a comment on pull request #28445:
URL: https://github.com/apache/spark/pull/28445#issuecomment-624455200
Okay, I had some time to investigate the related items here. I think there
are some more places to fix, e.g.
HyukjinKwon edited a comment on pull request #28445:
URL: https://github.com/apache/spark/pull/28445#issuecomment-624455200
Okay, I had some time to investigate the related items here. I think there
are some more places to fix, e.g.
HyukjinKwon commented on pull request #28445:
URL: https://github.com/apache/spark/pull/28445#issuecomment-624455200
Okay, I had some time to investigate the related items here. I think there
are some more places to fix, e.g.
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624454747
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624454742
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624454742
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624436741
**[Test build #122338 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122338/testReport)**
for PR 28458 at commit
SparkQA commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624454509
**[Test build #122338 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122338/testReport)**
for PR 28458 at commit
cloud-fan commented on a change in pull request #26624:
URL: https://github.com/apache/spark/pull/26624#discussion_r420557946
##
File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala
##
@@ -157,23 +259,23 @@ private[spark] object ThreadUtils {
*/
def
AmplabJenkins removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624450968
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624450975
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624450647
**[Test build #122342 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122342/testReport)**
for PR 27473 at commit
AmplabJenkins removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624449141
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624449133
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #28425:
URL: https://github.com/apache/spark/pull/28425#issuecomment-624449089
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28425:
URL: https://github.com/apache/spark/pull/28425#issuecomment-624449089
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
zhengruifeng removed a comment on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-582765435
data: `a9a`: numFeatures=123, numInstances=32,561
testCode:
```scala
import org.apache.spark.ml.clustering._
import
AmplabJenkins commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624449141
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins commented on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624449133
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28425:
URL: https://github.com/apache/spark/pull/28425#issuecomment-624448806
**[Test build #122340 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122340/testReport)**
for PR 28425 at commit
SparkQA commented on pull request #27473:
URL: https://github.com/apache/spark/pull/27473#issuecomment-624448823
**[Test build #122341 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122341/testReport)**
for PR 27473 at commit
SparkQA commented on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624448813
**[Test build #122339 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122339/testReport)**
for PR 28459 at commit
zhengruifeng opened a new pull request #27473:
URL: https://github.com/apache/spark/pull/27473
### What changes were proposed in this pull request?
1, add Level-2 BLAS routine `ger`;
2, stack input vectors to blocks to use Level-3 BLAS routine in training
### Why are the
zhengruifeng edited a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624427337
performace test on **sparse dataset**: the first 10,000 instances of
`webspam_wc_normalized_trigram`
code:
```scala
val df =
dilipbiswal commented on a change in pull request #28425:
URL: https://github.com/apache/spark/pull/28425#discussion_r420550918
##
File path: sql/core/src/test/scala/org/apache/spark/sql/ExplainSuite.scala
##
@@ -343,6 +343,54 @@ class ExplainSuite extends ExplainSuiteHelper
baohe-zhang commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624445143
Another way is to keep a thread-safe variable called availableMemory in
FsHistoryProvider. The initial value can be set as a percentage of Xmx. When we
parse a file via
gengliangwang commented on a change in pull request #28459:
URL: https://github.com/apache/spark/pull/28459#discussion_r420545275
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##
@@ -845,8 +845,9 @@ object SQLConf {
.doc("When
HeartSaVioR commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624441325
I'm not sure that's fairly simple to do. Concurrent load of applications can
be happening in SHS, right? The default value of
`spark.history.retainedApplications` is 50,
cloud-fan commented on pull request #28366:
URL: https://github.com/apache/spark/pull/28366#issuecomment-624439850
thanks, merging to master/3.0!
This is an automated message from the Apache Git Service.
To respond to the
baohe-zhang commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624439430
@HeartSaVioR One way in my mind is that we can monitor the memory usage of
SHS. If the memory usage or event log size exceeds a threshold (e.g, over 50%
of Xmx), we can use
cloud-fan commented on a change in pull request #28425:
URL: https://github.com/apache/spark/pull/28425#discussion_r420540911
##
File path: sql/core/src/test/scala/org/apache/spark/sql/ExplainSuite.scala
##
@@ -343,6 +343,54 @@ class ExplainSuite extends ExplainSuiteHelper
AmplabJenkins removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624437356
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624437356
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624431979
**[Test build #122337 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122337/testReport)**
for PR 28456 at commit
SparkQA commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624437271
**[Test build #122337 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122337/testReport)**
for PR 28456 at commit
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624437029
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624437029
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
cloud-fan commented on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624436648
thanks, merging to master/3.0!
This is an automated message from the Apache Git Service.
To respond to the
SparkQA commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624436741
**[Test build #122338 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122338/testReport)**
for PR 28458 at commit
cloud-fan commented on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624436428
cc @juliuszsompolski as well
This is an automated message from the Apache Git Service.
To respond to the
erenavsarogullari edited a comment on pull request #28208:
URL: https://github.com/apache/spark/pull/28208#issuecomment-624435102
@gengliangwang There is optional Http parameter: `details` (default:
`false`). It needs to be set in order to fetch `node`, `edge` and
`planDescription`
erenavsarogullari commented on pull request #28208:
URL: https://github.com/apache/spark/pull/28208#issuecomment-624435102
@gengliangwang There is optional http parameter: `details` (default:
`false`). It needs to be set in order to fetch `node`, `edge` and
`planDescription` details as
HeartSaVioR commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624434103
Let's discuss first with the plan how to address the major concerns in
comments, especially how to restrict the overall memory usage. I think that's a
blocker for the
HyukjinKwon commented on a change in pull request #28442:
URL: https://github.com/apache/spark/pull/28442#discussion_r420536516
##
File path:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala
##
@@ -131,11 +130,7 @@ class
SparkQA commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624431979
**[Test build #122337 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122337/testReport)**
for PR 28456 at commit
AmplabJenkins removed a comment on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624430843
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624430843
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28459:
URL: https://github.com/apache/spark/pull/28459#issuecomment-624430556
**[Test build #122336 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122336/testReport)**
for PR 28459 at commit
HyukjinKwon commented on a change in pull request #28459:
URL: https://github.com/apache/spark/pull/28459#discussion_r420533700
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##
@@ -2605,7 +2606,10 @@ object SQLConf {
HyukjinKwon commented on a change in pull request #28459:
URL: https://github.com/apache/spark/pull/28459#discussion_r420533700
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##
@@ -2605,7 +2606,10 @@ object SQLConf {
HyukjinKwon opened a new pull request #28459:
URL: https://github.com/apache/spark/pull/28459
### What changes were proposed in this pull request?
This PR proposes to deprecate 'spark.sql.optimizer.metadataOnly'
configuration and remove it in the future release.
### Why are
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624428995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624429091
**[Test build #122335 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122335/testReport)**
for PR 28412 at commit
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624428988
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624426364
**[Test build #122334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122334/testReport)**
for PR 28458 at commit
SparkQA commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624428969
**[Test build #122334 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122334/testReport)**
for PR 28458 at commit
AmplabJenkins commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624428988
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624428013
This is an automated message from the Apache Git Service.
To respond to the message, please log on
baohe-zhang commented on a change in pull request #28412:
URL: https://github.com/apache/spark/pull/28412#discussion_r420531106
##
File path:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala
##
@@ -1167,6 +1168,58 @@ private[history] class
AmplabJenkins commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624428013
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
baohe-zhang commented on a change in pull request #28412:
URL: https://github.com/apache/spark/pull/28412#discussion_r420530840
##
File path: core/src/main/scala/org/apache/spark/internal/config/History.scala
##
@@ -195,4 +195,9 @@ private[spark] object History {
zhengruifeng commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624427337
performace test on the first 10,000 instances of
`webspam_wc_normalized_trigram`
code:
```scala
val df = spark.read.option("numFeatures",
AmplabJenkins removed a comment on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624426569
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624426569
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624426364
**[Test build #122334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122334/testReport)**
for PR 28458 at commit
zhengruifeng commented on pull request #28458:
URL: https://github.com/apache/spark/pull/28458#issuecomment-624426340
performace test on
[`epsilon_normalized.t`](https://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/binary.html)
code:
```scala
import
zhengruifeng opened a new pull request #28458:
URL: https://github.com/apache/spark/pull/28458
### What changes were proposed in this pull request?
1, reorg the `fit` method in LR to several blocks (`createModel`,
`createBounds`, `createOptimizer`, `createInitCoefWithInterceptMatrix`);
AmplabJenkins removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624425092
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624419881
**[Test build #122331 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122331/testReport)**
for PR 28456 at commit
AmplabJenkins removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624425131
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624425131
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624425092
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624425018
**[Test build #122331 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122331/testReport)**
for PR 28456 at commit
SparkQA commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624424796
**[Test build #122333 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122333/testReport)**
for PR 28412 at commit
AmplabJenkins removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423684
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423679
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423178
**[Test build #122332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122332/testReport)**
for PR 28412 at commit
SparkQA commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423673
**[Test build #122332 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122332/testReport)**
for PR 28412 at commit
AmplabJenkins commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423679
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423497
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423497
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-624423178
**[Test build #122332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122332/testReport)**
for PR 28412 at commit
baohe-zhang commented on a change in pull request #28412:
URL: https://github.com/apache/spark/pull/28412#discussion_r420525489
##
File path:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala
##
@@ -1167,6 +1168,58 @@ private[history] class
baohe-zhang commented on a change in pull request #28412:
URL: https://github.com/apache/spark/pull/28412#discussion_r420524061
##
File path:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala
##
@@ -1167,6 +1168,58 @@ private[history] class
AmplabJenkins commented on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624420189
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624420189
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624410522
**[Test build #122329 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122329/testReport)**
for PR 28393 at commit
SparkQA commented on pull request #28393:
URL: https://github.com/apache/spark/pull/28393#issuecomment-624420070
**[Test build #122329 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122329/testReport)**
for PR 28393 at commit
SparkQA commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624419881
**[Test build #122331 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122331/testReport)**
for PR 28456 at commit
AmplabJenkins removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624419421
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624419352
**[Test build #122330 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122330/testReport)**
for PR 28456 at commit
SparkQA removed a comment on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624413848
**[Test build #122330 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122330/testReport)**
for PR 28456 at commit
AmplabJenkins commented on pull request #28456:
URL: https://github.com/apache/spark/pull/28456#issuecomment-624419421
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
beliefer commented on pull request #28164:
URL: https://github.com/apache/spark/pull/28164#issuecomment-624418126
cc @HyukjinKwon
This is an automated message from the Apache Git Service.
To respond to the message, please
1 - 100 of 452 matches
Mail list logo
