[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-20 Thread Dawid Weiss (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181089#comment-17181089
 ] 

Dawid Weiss commented on LUCENE-9468:
-

Just FYI: the underlying issue is similar - they have temp. file creation 
factory that doesn't have any means of tracking or deleting files afterwards. 
For tests, this is the relevant bit that creates it:

https://github.com/gradle/gradle/blob/c62647535fdfb67a28778aa38151d5381e9a842b/subprojects/testing-jvm/src/main/java/org/gradle/api/internal/tasks/testing/junit/JUnitTestFramework.java#L42-L47

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Michael McCandless (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179723#comment-17179723
 ] 

Michael McCandless commented on LUCENE-9468:


{quote}I don't work (or advocate) for gradle... 
{quote}
OK, good point :)  I added a comment on [that gradle 
issue|https://github.com/gradle/gradle/issues/12020] pointing back to this 
issue.

Unfortunately the snippet you linked to there has now become whitespace ... I 
think you need to link to a stable (githash'd) version of that source?
{quote}LUCENE-9465 is already implemented, Mike.
{quote}
Awesome, thanks!  I will try to switch my stupid beaster to this real beaster!

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Dawid Weiss (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179676#comment-17179676
 ] 

Dawid Weiss commented on LUCENE-9468:
-

LUCENE-9465 is already implemented, Mike. 

I don't work (or advocate) for gradle... I use it and I think it's fine most of 
the time. This said, it's like any other software: bugs happen. I am a bit 
disappointed they didn't even respond to that issue where I explicitly pointed 
out where the problem was/ is...

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Michael McCandless (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179659#comment-17179659
 ] 

Michael McCandless commented on LUCENE-9468:


Thanks [~dweiss] ... I had ~10K of these gradle buggy tmp files by the time I 
noticed it, but it is easy enough for me to workaround.

I do not want to do a {{clean}} on every beasting run, though.  That'd just 
decrease the already poor test efficiency!

So, I just inserted an explicit {{rm -f 
lucene/core/build/tmp/test/jar_extract*}} between beast iterations.

Hmm, OK, I see, it is far more than just these {{jar_extract_*}} files – even 
after removing those, I have ~15K other files, created by our tests I think, 
totaling ~9.6 GB.  OK, I will change my script to {{rm -rf 
lucene/core/build/tmp}} each time.  They truly are temp files right?  I will 
not slow down subsequent iterations by removing them?

Admittedly this is an exotic use case!  And maybe once we have true beasting 
support with gradle (LUCENE-9465) I can switch to that.  Most users would 
probably remember to insert a {{gradle clean}} now and then.  But it is 
disturbing that if you fail to do that, you can lose GBs to these supposedly 
temporary files!
{quote}There is a related bigger issue with gradle workers leaving their stuff 
in user's temp - this is what I really don't like...

This is the issue:
[https://github.com/gradle/gradle/issues/12020]
{quote}
Thanks for finding/sharing that issue.  That is indeed annoying, even moreso 
than this issue!  In fact, I went and ran {{ls /tmp}} on my 128 core beast box. 
 It took ~8 seconds to come back with (get this!) ~675K supposedly temporary 
gradle files!  Sheesh.  I will also fix my beasting script to remove THOSE ones 
too.

I guess proper garbage collection is truly hard.

 

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Dawid Weiss (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179627#comment-17179627
 ] 

Dawid Weiss commented on LUCENE-9468:
-

This is the issue:
https://github.com/gradle/gradle/issues/12020

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Dawid Weiss (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179624#comment-17179624
 ] 

Dawid Weiss commented on LUCENE-9468:
-

This 'tmp' folder under build holds all sorts of task-specific temporary data. 
We actually use it to in renderJavadoc, for example. It is a convenient 
mechanism to provide common "temporary space" for all gradle tasks. Do you care 
much about what's under build/tmp, Mike? These are fairly small files and 
eventually a clean will remove all of these.

There is a related bigger issue with gradle workers leaving their stuff in 
user's temp - this is what I really don't like... 

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Michael McCandless (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179598#comment-17179598
 ] 

Michael McCandless commented on LUCENE-9468:


OK, I did not realize this is a {{gradle}} bug, sigh.

Yeah we should not try to work around it.  I can easily rm -rf these files in 
between beast runs.

I'll try to open an issue upstream for this then.  Thanks for looking [~dweiss].

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (LUCENE-9468) "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_XXXX files

2020-08-18 Thread Dawid Weiss (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179377#comment-17179377
 ] 

Dawid Weiss commented on LUCENE-9468:
-

These are temporary files internal to gradle's test task. It's not something we 
do. They should be cleaned, but it's a bug in gradle - I don't think we should 
cater for this as it'll make the build more complex and it may prove difficult 
to track on gradle upgrades?

> "./gradlew -p lucene test" leaks lucene/core/build/tmp/test/jar_extract_ 
> files
> --
>
> Key: LUCENE-9468
> URL: https://issues.apache.org/jira/browse/LUCENE-9468
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Priority: Major
>
> I have been stupid-beasting ({{while(true) "./gradlew -p lucene test"}}) 
> Lucene core + modules tests, and noticed that I have accumulated many 
> (~10.3K) files like these:
> {noformat}
> -rw-r--r-- 1 mike mike  4954 Aug 17 12:49 
> lucene/core/build/tmp/test/jar_extract_9943749690454255636_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 13:24 
> lucene/core/build/tmp/test/jar_extract_9949237584070142535_tmp
> -rw-r--r-- 1 mike mike 14627 Aug 17 14:01 
> lucene/core/build/tmp/test/jar_extract_9950285037002822552_tmp
> -rw-r--r-- 1 mike mike 15935 Aug 17 15:10 
> lucene/core/build/tmp/test/jar_extract_995066590821695944_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 11:23 
> lucene/core/build/tmp/test/jar_extract_9952865172929838404_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 14:41 
> lucene/core/build/tmp/test/jar_extract_9960016969100835830_tmp
> -rw-r--r-- 1 mike mike  5488 Aug 17 10:07 
> lucene/core/build/tmp/test/jar_extract_9960479662672452908_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 13:07 
> lucene/core/build/tmp/test/jar_extract_996420631017213954_tmp
> -rw-r--r-- 1 mike mike 84929 Aug 17 10:30 
> lucene/core/build/tmp/test/jar_extract_9964495910786482810_tmp
> -rw-r--r-- 1 mike mike  8034 Aug 17 17:10 
> lucene/core/build/tmp/test/jar_extract_9965528236930220207_tmp
> -rw-r--r-- 1 mike mike 43565 Aug 17 11:52 
> lucene/core/build/tmp/test/jar_extract_9967892842722777228_tmp
> -rw-r--r-- 1 mike mike 36278 Aug 17 10:36 
> lucene/core/build/tmp/test/jar_extract_996836107828729763_tmp
> -rw-r--r-- 1 mike mike 29997 Aug 17 15:48 
> lucene/core/build/tmp/test/jar_extract_9968527122717193835_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 11:11 
> lucene/core/build/tmp/test/jar_extract_9968609693107939092_tmp
> -rw-r--r-- 1 mike mike  9920 Aug 17 14:31 
> lucene/core/build/tmp/test/jar_extract_9968809316564216653_tmp
> -rw-r--r-- 1 mike mike 19078 Aug 17 13:22 
> lucene/core/build/tmp/test/jar_extract_9969318805542859308_tmp
> -rw-r--r-- 1 mike mike 28711 Aug 17 11:44 
> lucene/core/build/tmp/test/jar_extract_9974798403956637924_tmp {noformat}
> It seems to grow by ~64 files (how many cores I configured gradle to use in 
> my {{./gradle.properties}} on each iteration of beasting.
> I think {{gradle}} should be cleaning this up maybe?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org