Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16451
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71040/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71040 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71040/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71038/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71038 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71038/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71040 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71040/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
(FWIW, I am pretty sure of this PR for now)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Build started: [TESTS] `org.apache.spark.streaming.CheckpointSuite`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71038 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71038/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
```
- recovery with file input stream *** FAILED *** (10 seconds, 205
milliseconds)
The code passed to eventually never returned normally. Attempted 660
times over
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Ah, I just found anothet one. Let me check all other errors again. They are
now pretty few (30-ish).
---
If your project is set up for it, you can reply to this email and have your
reply
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16451
@HyukjinKwon are you still working on this or believe this is a good point
to commit this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71015/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71015 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71015/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Build started: [TESTS]
`org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71015 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71015/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Ah, thank you.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16451
Yeah, that's great. That narrows down the fix a bit.
I bet there are other places in tests where we could use the same logic, to
only ignore the error on Windows, but unless you know of obvious
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
I made a new function just simply because it repeats the same logics.
Either way is fine with me.
So.. do you mean something like the one as below?
```scala
try {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71009/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71009 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71009/testReport)**
for PR 16451 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16451
OK right, so the problem is still fundamentally about not deleting open
files. The recursive deletion itself is OK on Windows.
I sort of still favor using Utils.deleteRecursively and
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Build started: [TESTS]
`org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #71009 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71009/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
> Utils.deleteRecursively does seem to delete the contents first, so I
don't know why it fails on Windows.
Maybe, I misunderstood this comment and also I might be wrong but let me
try
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
@srowen, regarding
https://github.com/apache/spark/pull/16451#discussion_r94572449, would it be
okay to leave as is or should I give a shot for `Utils.deleteRecursively`?
---
If your project
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70954/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Build started: [TESTS] `org.apache.spark.sql.hive.HiveSparkSubmitSuite`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70954 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70954/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70953/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70953 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70953/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70955/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70955 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70955/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70955 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70955/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70954 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70954/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70953 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70953/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70899/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70899 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70899/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
I just checked each except for the one below is passed in Windows via
concatenated
[full-log](https://gist.github.com/HyukjinKwon/2d199ac9156c380015ad5a71f77866be).
It seems
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70899 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70899/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70893/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70893 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70893/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70892/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70892 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70892/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70893 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70893/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70892 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70892/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70891 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70891/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70891/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70891 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70891/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70881/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70881 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70881/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
I really don't think using the full path makes `HiveSparkSubmitSuite.scala`
flaky but if it seems frequently failed, let me use the original code path for
OSs except Windows.
---
If your
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70881 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70881/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70875/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70875 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70875/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70870/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70870 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70870/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70875 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70875/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Let me just push a small commit fixing the _"not"_ condition just mainly to
retrigger the test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70871 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70871/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70871/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70871 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70871/testReport)**
for PR 16451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70866/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70866 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70866/testReport)**
for PR 16451 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70870 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70870/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16451
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70869/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16451
**[Test build #70869 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70869/testReport)**
for PR 16451 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Now, there are 30ish tests failed on Windows which I could identify via
AppVeyor tests
[here](https://gist.github.com/HyukjinKwon/88a0b37cd027934bc14f3aa9f812be31)
which I am currently working
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16451
Hi @srowen, do you mind if I ask to check whether the changes look
reasonable? (I will double check if the tests are really passed after the tests
above are finished.)
---
If your project is
96 matches
Mail list logo
