[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139847346 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139847347 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42378/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139847334 [Test build #42378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42378/console) for PR 8730 at commit [`afe9396`](https://github.com/apache/spark/commit/afe9396f09353539c6fe9371522373994f8d584a). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10180] [SQL] JDBCRDD does not process E...
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/8391#discussion_r39345066
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
---
@@ -275,6 +275,10 @@ private[sql] class JDBCRDD(
*/
private def compileFilter(f: Filter): String = f match {
case EqualTo(attr, value) => s"$attr = ${compileValue(value)}"
+// Since the null-safe equality operator is not a standard SQL
operator,
+// This was written as using is-null and normal equality.
+case EqualNullSafe(attr, value) =>
+ s"($attr = ${compileValue(value)} OR ($attr IS NULL AND
${compileValue(value)} IS NULL))"
--- End diff --
Yes, it looks so..
If SparkSQL creates the SQL (for datasources) like the below, it can be a
problem..
```
SELECT 1 <=> 1, NULL <=> NULL, 1 <=> NULL;
-> 1, 1, 0
SELECT 1 = 1, NULL = NULL, 1 = NULL;
-> 1, NULL, NULL
```
However, as I see the codes, I think the `compileFilter()` is only used to
construct WHERE clause.
I tested the expression at MySQL and they look ok.
In details,
I tested four cases at MySQL.
1. attr is a column, value is null.
2. attr is a column, value is not null.
3. attr is null, value is null.
4. attr is null, value is not null.
- `CREATE`
```SQL
CREATE TABLE TestTable
(`id` int, `test` varchar(7))
;
```
- `INSERT`
```SQL
INSERT INTO TestTable
(`id`, `test`)
VALUES
(1, null),
(2, 'OpenAM'),
(3, 'OpenDJ')
;
```
- `SELECT`
```SQL
/*1. attr is a column, value is null. */
SELECT
*
FROM
TestTable
WHERE
(test = NULL OR (test IS NULL AND NULL IS NULL));
SELECT
*
FROM
TestTable
WHERE
test <=> NULL;
```
```SQL
/*2. attr is a column, value is not null.*/
SELECT
*
FROM
TestTable
WHERE
(test = 'OpenAM' OR (test IS NULL AND 'OpenAM' IS NULL));
SELECT
*
FROM
TestTable
WHERE
test <=> 'OpenAM';
```
```SQL
/*3. attr is null, value is null.*/
SELECT
*
FROM
TestTable
WHERE
(NULL = NULL OR (NULL IS NULL AND NULL IS NULL));
SELECT
*
FROM
TestTable
WHERE
NULL <=> NULL;
```
```SQL
/*4. attr is null, value is not null.*/
SELECT
*
FROM
TestTable
WHERE
(NULL = 'OpenAM' OR (NULL IS NULL AND 'OpenAM' IS NULL));
SELECT
*
FROM
TestTable
WHERE
NULL <=> 'OpenAM';
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [R][DOC] Fixed typo in README.md
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8733#issuecomment-139847144 I don't think those are typos. In the first case, a new sentence has not started. "installation" seems as clear as "installation path" in the second. Do you mind closing this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10548] [SPARK-10563] [SQL] Fix concurre...
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/8710#discussion_r39345043
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -348,10 +348,24 @@ class SparkContext(config: SparkConf) extends Logging
with ExecutorAllocationCli
// Thread Local variable that can be used by users to pass information
down the stack
private val localProperties = new InheritableThreadLocal[Properties] {
-override protected def childValue(parent: Properties): Properties =
new Properties(parent)
+override protected def childValue(parent: Properties): Properties = {
+ // Note: make a clone such that changes in the parent properties
aren't reflected in
+ // the those of the children threads, which has confusing semantics
(SPARK-10564).
+ val p = new Properties
+ val filtered = parent.asScala.filter { case (k, _) =>
+!nonInheritedLocalProperties.contains(k)
+ }
+ p.putAll(filtered.asJava)
+ p
+}
override protected def initialValue(): Properties = new Properties()
}
+ /**
+ * Keys of local properties that should not be inherited by children
threads.
+ */
+ private[spark] val nonInheritedLocalProperties: HashSet[String] = new
HashSet[String]
--- End diff --
the whole point of SPARK-10548 is to avoid inheriting the SQL execution ID.
How can we avoid that with just cloning?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/8687#discussion_r39344473
--- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
---
@@ -984,6 +986,15 @@ class PairRDDFunctions[K, V](self: RDD[(K, V)])
hadoopConf.setOutputCommitter(classOf[FileOutputCommitter])
}
+// When speculation is on and output committer class name contains
"Direct", we should warn
+// users that they may loss data if they are using a direct output
committer.
+val speculationEnabled = self.conf.getBoolean("spark.speculation",
false)
+if (speculationEnabled &&
+ hadoopConf.get("mapred.output.committer.class",
"").contains("Direct")) {
+ logWarning("We may loss data when use direct output committer with
speculation enabled, " +
+"please make sure your output committer doesn't write data
directly.")
+}
--- End diff --
How about
```
val outputCommitterClass = hadoopConf.get("mapred.output.committer.class",
"")
if (speculationEnabled && outputCommitterClass.contains("Direct")) {
val warningMessage =
s"$outputCommitterClass may be a output committer that writes data
directly to the final location. " +
"Because speculation is enabled, this output committer may cause data
loss (see the case in SPARK-10063). " +
"If possible, please use a output committer that does not have this
behavior (e.g. FileOutputCommitter)."
logWarning(warningMessage)
}
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139843253 [Test build #42378 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42378/consoleFull) for PR 8730 at commit [`afe9396`](https://github.com/apache/spark/commit/afe9396f09353539c6fe9371522373994f8d584a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139843108 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139843100 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [R][DOC] Fixed typo in README.md
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8733#issuecomment-139839929 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [R][DOC] Fixed typo in README.md
GitHub user terrytangyuan opened a pull request: https://github.com/apache/spark/pull/8733 [R][DOC] Fixed typo in README.md You can merge this pull request into a Git repository by running: $ git pull https://github.com/terrytangyuan/spark patch-1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8733.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8733 commit 6a71f18434b9ba63398f21dace00d58ec4e78af3 Author: Yuan Tang (Terry) Date: 2015-09-13T02:19:11Z [R][DOC] Fixed typo in README.md --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139837221 [Test build #42377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42377/console) for PR 8521 at commit [`d9cb6df`](https://github.com/apache/spark/commit/d9cb6dfcb42f630a1c25966f09247bdf614a9791). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139837238 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139837239 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42377/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8521 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139828609 Going to merge this into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139825546 [Test build #42377 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42377/consoleFull) for PR 8521 at commit [`d9cb6df`](https://github.com/apache/spark/commit/d9cb6dfcb42f630a1c25966f09247bdf614a9791). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139825389 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139825390 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10330] Add Scalastyle rule to require u...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8521#issuecomment-139825289 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139822320 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9720] [ML] Identifiable types need UID ...
Github user BertrandDechoux commented on the pull request: https://github.com/apache/spark/pull/8062#issuecomment-139800205 @mengxr The pull request can be merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6548 Adding stddev to DataFrame function...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6297 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6548 Adding stddev to DataFrame function...
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6297#issuecomment-139798279 LGTM, merging this into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139792267 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42376/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139792266 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139792234 [Test build #42376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42376/console) for PR 8358 at commit [`536903e`](https://github.com/apache/spark/commit/536903e2a2ad38811591f9249f5058ede7ffa24c). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10064] [ML] Parallelize decision tree b...
Github user NathanHowell commented on the pull request: https://github.com/apache/spark/pull/8246#issuecomment-139792166 I tend to rebase out of habit to prevent merge-build failures. I'll look at the test failure on Monday, they were all passing at one point. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139788118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139788119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42375/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139788084 [Test build #42375 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42375/console) for PR 8732 at commit [`dd08df0`](https://github.com/apache/spark/commit/dd08df0acff8c2b4bd916c3d8a660a882feaf05d). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139787110 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42374/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139787045 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139787108 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139787071 [Test build #42374 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42374/console) for PR 8731 at commit [`d573bf8`](https://github.com/apache/spark/commit/d573bf82de04433a6728e6e351e7d2cabf8eefe7). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139787047 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42373/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139786829 [Test build #42373 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42373/console) for PR 8216 at commit [`1ba208a`](https://github.com/apache/spark/commit/1ba208a09937d36727bd18a51008b1f70d888714). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class IntersectNode(conf: SQLConf, left: LocalNode, right: LocalNode)` * `case class SampleNode(` * `case class TakeOrderedAndProjectNode(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9213] [SQL] [WIP] Improve regular expre...
Github user watermen commented on the pull request: https://github.com/apache/spark/pull/8715#issuecomment-139775417 @rxin I'll do some performance benchmarks later, and do you have any idea about passing `byte[]` or `UTF8String` into `s""" """`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10548] [SPARK-10563] [SQL] Fix concurre...
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/8710#discussion_r39337844
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -348,10 +348,24 @@ class SparkContext(config: SparkConf) extends Logging
with ExecutorAllocationCli
// Thread Local variable that can be used by users to pass information
down the stack
private val localProperties = new InheritableThreadLocal[Properties] {
-override protected def childValue(parent: Properties): Properties =
new Properties(parent)
+override protected def childValue(parent: Properties): Properties = {
+ // Note: make a clone such that changes in the parent properties
aren't reflected in
+ // the those of the children threads, which has confusing semantics
(SPARK-10564).
+ val p = new Properties
+ val filtered = parent.asScala.filter { case (k, _) =>
+!nonInheritedLocalProperties.contains(k)
+ }
+ p.putAll(filtered.asJava)
+ p
+}
override protected def initialValue(): Properties = new Properties()
}
+ /**
+ * Keys of local properties that should not be inherited by children
threads.
+ */
+ private[spark] val nonInheritedLocalProperties: HashSet[String] = new
HashSet[String]
--- End diff --
Exposing a mutable `HashSet` in the thread-safe `SparkContext` looks
dangerous. Actually, I suggest we don't need to add
`nonInheritedLocalProperties` in the master branch. How about just cloning the
parent properties without adding the `nonInheritedLocalProperties` logic?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update py4j to 0.9.
Github user kevincox closed the pull request at: https://github.com/apache/spark/pull/8722 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139770572 [Test build #42376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42376/consoleFull) for PR 8358 at commit [`536903e`](https://github.com/apache/spark/commit/536903e2a2ad38811591f9249f5058ede7ffa24c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139769023 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139769017 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139766459 [Test build #42375 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42375/consoleFull) for PR 8732 at commit [`dd08df0`](https://github.com/apache/spark/commit/dd08df0acff8c2b4bd916c3d8a660a882feaf05d). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139766242 LGTM in the sense that it's just the same commit as before, as advertised. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user piaozhexiu commented on a diff in the pull request:
https://github.com/apache/spark/pull/8216#discussion_r39337138
--- Diff: core/src/main/scala/org/apache/spark/scheduler/JobWaiter.scala ---
@@ -69,9 +97,11 @@ private[spark] class JobWaiter[T](
}
def awaitResult(): JobResult = synchronized {
+Try(_originalHandler = attachSigintHandler())
while (!_jobFinished) {
this.wait()
}
+Try(detachSigintHandler())
--- End diff --
@davies thank you for reviewing!
My intention for `Try` was to tolerate any error while detaching signal
handler since this is on a best effort basis. For eg, if `attachSignalHandler`
fails for some reason, `detachSignalHanndler` will fail too.
I rewrote this code using `Try`, `Success`, and `Failure` as follows-
```
val attachTry = Try(attachSigintHandler())
while (!_jobFinished) {
this.wait()
}
attachTry match {
case _: Success[_] => detachSigintHandler()
case _: Failure[_] => // Ignore error. Signal handler is on a best
effort basis.
}
```
Hopefully it is more clear now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139764205 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8732#issuecomment-139764317 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139762295 [Test build #42374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42374/consoleFull) for PR 8731 at commit [`d573bf8`](https://github.com/apache/spark/commit/d573bf82de04433a6728e6e351e7d2cabf8eefe7). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6350] [MESOS][backport] Fine-grained mo...
GitHub user dragos opened a pull request: https://github.com/apache/spark/pull/8732 [SPARK-6350] [MESOS][backport] Fine-grained mode scheduler respects spark.mesos.mesosExecutor.cores when launching Mesos executors (regression) (cherry picked from commit 03e8d0a620301c0bfd2bbf21415f7d794da19603) backported to branch 1-5 /cc @andrewor14 You can merge this pull request into a Git repository by running: $ git pull https://github.com/dragos/spark issue/mesos/fine-grained-maxExecutorCores-1.5 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8732.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8732 commit dd08df0acff8c2b4bd916c3d8a660a882feaf05d Author: Iulian Dragos Date: 2015-09-08T12:02:29Z Make the fine-grained mode scheduler respect spark.mesos.mesosExecutor.cores when launching Mesos executors (regression) (cherry picked from commit 03e8d0a620301c0bfd2bbf21415f7d794da19603) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139758491 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8731#issuecomment-139758496 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139757766 [Test build #42373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42373/consoleFull) for PR 8216 at commit [`1ba208a`](https://github.com/apache/spark/commit/1ba208a09937d36727bd18a51008b1f70d888714). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly ...
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/8731 [SPARK-10222] [GRAPHX] [DOCS] More thoroughly deprecate Bagel in favor of GraphX Finish deprecating Bagel; remove reference to nonexistent example You can merge this pull request into a Git repository by running: $ git pull https://github.com/srowen/spark SPARK-10222 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8731.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8731 commit d573bf82de04433a6728e6e351e7d2cabf8eefe7 Author: Sean Owen Date: 2015-09-12T12:47:49Z Finish deprecating Bagel; remove reference to nonexistent example --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139757355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139757360 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42371/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139757233 [Test build #42371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42371/console) for PR 8668 at commit [`558cd04`](https://github.com/apache/spark/commit/558cd04764d715b114e16d09a81411baa7de174a). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139754222 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10001] [CORE] Allow Ctrl-C in spark-she...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8216#issuecomment-139754164 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751439 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751437 [Test build #42372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42372/console) for PR 8358 at commit [`00cf541`](https://github.com/apache/spark/commit/00cf541063a6b78c73987c24e9801d63a0f2ca04). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751440 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42372/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751370 [Test build #42372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42372/consoleFull) for PR 8358 at commit [`00cf541`](https://github.com/apache/spark/commit/00cf541063a6b78c73987c24e9801d63a0f2ca04). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751149 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751154 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9708] [MESOS] Spark should create local...
Github user Zariel commented on the pull request: https://github.com/apache/spark/pull/8358#issuecomment-139751123 What should be the correct order for the local dirs? Currently as I can see the priority is `YARN_LOCAL_DIRS > LOCAL_DIRS > SPARK_EXECUTOR_DIRS > SPARK_LOCAL_DIRS > spark.local.dir > java.io.tmpdir` To me it makes sense that when running in Yarn or Mesos Spark should use their local space if it is available, if someone is running applications in Mesos then its fair to assume they (cluster operator) can provide sufficient local disk space and performance. Ive updated the PR to disable the Mesos sandbox when dynamic allocation is enabled, and also adjusted the local dir priroity so that it now looks like this `YARN_LOCAL_DIRS > LOCAL_DIRS > SPARK_LOCAL_DIRS > SPARK_EXECUTOR_DIRS > MESOS_DIRECTORY > spark.local.dir > java.io.tmpdir` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139749476 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42370/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139749475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139749440 [Test build #42370 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42370/console) for PR 8730 at commit [`cf2c466`](https://github.com/apache/spark/commit/cf2c4665ed695a72818ca5c674f4c791013d4f2e). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class IntersectNode(conf: SQLConf, left: LocalNode, right: LocalNode)` * `case class SampleNode(` * `case class TakeOrderedAndProjectNode(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139745545 [Test build #42371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42371/consoleFull) for PR 8668 at commit [`558cd04`](https://github.com/apache/spark/commit/558cd04764d715b114e16d09a81411baa7de174a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139745317 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139745310 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8687#issuecomment-139745260 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42368/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8687#issuecomment-139745259 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8687#issuecomment-139745224 [Test build #42368 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42368/console) for PR 8687 at commit [`db59c25`](https://github.com/apache/spark/commit/db59c25dc2c12d8fd2e44c118bfc2c47363f7d49). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10547] [TEST] Streamline / improve styl...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8706 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10506][SQL]move close() to finally code...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8664#issuecomment-139744497 @baishuo HiveQuerySuite is failing consistently here. I wonder if it is somehow related to this change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139744243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139744244 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42367/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139744231 [Test build #42367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42367/console) for PR 8668 at commit [`773a11e`](https://github.com/apache/spark/commit/773a11ed8460c5a60b3e498d2089298bfac112bb). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10016][ML]Stored broadcast var in a pri...
Github user vinodkc closed the pull request at: https://github.com/apache/spark/pull/8233 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139741805 @andrewor14 when the numbers of executors requested is lower, driver will send message to AM to changed in ExecutorAllocationManager.  --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10554][Core] Fix NPE with ShutdownHook
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8720 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10554][Core] Fix NPE with ShutdownHook
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8720#issuecomment-139741026 Merged to master / 1.5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10566] [Core] SnappyCompressionCodec in...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8725 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139739924 [Test build #42370 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42370/consoleFull) for PR 8730 at commit [`cf2c466`](https://github.com/apache/spark/commit/cf2c4665ed695a72818ca5c674f4c791013d4f2e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139739666 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8730#issuecomment-139739669 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10575][Spark Core]Wrapped RDD.takeSampl...
GitHub user vinodkc opened a pull request: https://github.com/apache/spark/pull/8730 [SPARK-10575][Spark Core]Wrapped RDD.takeSample with Scope You can merge this pull request into a Git repository by running: $ git pull https://github.com/vinodkc/spark fix_takesample_return Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8730.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8730 commit cf2c4665ed695a72818ca5c674f4c791013d4f2e Author: vinodkc Date: 2015-09-12T07:56:19Z wrapped in scope --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139738717 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139738719 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42369/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139738707 [Test build #42369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42369/console) for PR 8350 at commit [`b7887b3`](https://github.com/apache/spark/commit/b7887b30e7d1806581920bf3264ef1dc5af131aa). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139738374 @vanzin For example, executorsPendingToRemove=Set(1), and executor 2 is idle timeout before a new executor is asked to replace executor 1.. Then driver kill executor 2, and sending RequestExecutors to AM. But executorsPendingToRemove=Set(1,2), So AM doesn't allocate a executor to replace 1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139738102 [Test build #42369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42369/consoleFull) for PR 8350 at commit [`b7887b3`](https://github.com/apache/spark/commit/b7887b30e7d1806581920bf3264ef1dc5af131aa). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8687#issuecomment-139737993 [Test build #42368 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42368/consoleFull) for PR 8687 at commit [`db59c25`](https://github.com/apache/spark/commit/db59c25dc2c12d8fd2e44c118bfc2c47363f7d49). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139737940 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Update version to 1.6.0-SNAPSHOT.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8350#issuecomment-139737944 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10515] When killing executor, there is ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8668#issuecomment-139737840 [Test build #42367 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42367/consoleFull) for PR 8668 at commit [`773a11e`](https://github.com/apache/spark/commit/773a11ed8460c5a60b3e498d2089298bfac112bb). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9899][SQL] log warning for direct outpu...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8687#issuecomment-139737781 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
