Re: ant git commit: Unbreak tests

2018-07-09 Thread Stefan Bodewig
On 2018-07-07, Jaikiran Pai wrote:

> Here's a status of the current state of upstream repo branches
> "master" and "1.9.x".

Many thanks, Jaikiran and many thanks for the detailed report. I've been
able to reproduce the checks you've performed.

I'll build RCs for the next Ant releases soon.

Stefan

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-09 Thread Stefan Bodewig
On 2018-07-06,  wrote:

> That would reduce the original "2f64e0b5"  diff to (the extra lines
> starting with \ before the diff are added by the checker i wrote)

Thanks, Martijn

I've just committed the fix to Ant's URL inside jdepend.xsl.

Stefan

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-08 Thread Nicolas Lalevée
I have re done the revert and merge locally, and compared the diff between my 
local banches and the remote one. I had only diffs due to my editor 
automatically removing trailing space on empty lines, and I had to figure out 
what the status of the apt tasks (and indeed it doesn’t need to be merged back 
into master).

I have not tested as much as you have, but I have tested the revert, merge and 
conflicts resolve, and it is ok for me.

So thank you for you detailed mail about what you did. I think we should have 
that rule: in case of a commits which generates a lot of diff, share the 
commands which generated these diffs. Thus anyone can check the rationale of 
the commands and make the diff between local and remote.

Nicolas

> Le 7 juil. 2018 à 14:53, Jaikiran Pai  a écrit :
> 
> Here's a status of the current state of upstream repo branches "master" and 
> "1.9.x". But before getting to it, I would like to state that I really had no 
> pleasure in doing these reverts. I really do mean it. I wish we had never 
> ended up in this situation (and hopefully will never again), but I do believe 
> reverting this was the right decision.
> 
> 1.9.x branch:
> 
> - Before starting the revert operation, the latest commit on this branch was 
> 7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0 which was the trailing whitespace 
> commit.
> - Reverted that commit by issuing a "git revert 
> 7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0"
> - Did a clean build (just compilation and jar generation, no test cases were 
> run locally)
> - Finally to make sure I didn't introduce any unnecessary changes/problems of 
> my own in this efforts, I compared the latest commit (which was the revert 
> commit) against the 7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0 commit's parent 
> on 1.9.x, b2da27513c7806357bf146bde44b3cc469757122 using the following 
> command:
> 
> git diff b2da27513c7806357bf146bde44b3cc469757122 
> 9b1b8dbbc6e9aa98922da28683f3773f586811e5
> 
> This returned empty (which is a good thing)
> 
> Pushed this state to upstream 1.9.x branch.
> 
> master branch:
> 
> This was a bit more complicated than the 1.9.x branch, given merge commits 
> plus additional master only commits that had happened on this branch between 
> the trailing whitespace commit, plus the fact that the trailing whitespace 
> commit touched extremely large number of files.
> 
> - Before starting the revert on this branch, the latest commit on it was 
> 4ce54bf3b6c521af9c8db3229df5cd8b3199a3b2.
> - The trailing whitespace commit was done before that above commit and was 
> 2f64e0b51c295960cb15aa77c7c1f447b2518e14. There were some other unrelated 
> commits between these 2 commits.
> - Reverted that commit by issuing:
> 
> git revert 2f64e0b51c295960cb15aa77c7c1f447b2518e14
> 
> Needed to sort out merge conflicts with the following files:
> Unmerged paths:
>   (use "git reset HEAD ..." to unstage)
>   (use "git add ..." to mark resolution)
> 
> both modified:   src/etc/testcases/taskdefs/cvspass.xml
> both modified:   src/etc/testcases/taskdefs/delete.xml
> both modified:   src/etc/testcases/taskdefs/jar.xml
> both modified: src/etc/testcases/taskdefs/optional/pvcs.xml
> both modified: 
> src/etc/testcases/taskdefs/optional/xml/endpiece-ns-no-location.xml
> both modified: src/etc/testcases/taskdefs/optional/xml/endpiece.xml
> both modified:   src/etc/testcases/taskdefs/typedef.xml
> both modified:   src/tests/antunit/taskdefs/copy-test.xml
> both modified:   src/tests/antunit/taskdefs/get-test.xml
> 
> Manually fixed those conflicts and completed the revert.
> 
> - Did one round of local clean build to make sure things were fine.
> - At this point, the revert was complete, but there remained one more step to 
> merge 1.9.x branch into master.
> - Issued "git merge 1.9.x" (where 1.9.x was the branch which included the 
> fully reverted state)
> - Merge conflicts had to be resolved in the following files:
> 
> Unmerged paths:
>   (use "git add/rm ..." as appropriate to mark resolution)
> 
> both modified:   src/etc/poms/ant-javamail/pom.xml
> both modified:   src/etc/poms/ant-swing/pom.xml
> both modified:   src/etc/poms/ant-testutil/pom.xml
> both modified:   src/etc/testcases/filters/build.xml
> both modified: src/etc/testcases/taskdefs/conditions/antversion.xml
> both modified:   src/etc/testcases/taskdefs/delete.xml
> both modified:   src/etc/testcases/taskdefs/java.xml
> both modified: src/etc/testcases/taskdefs/optional/pvcs.xml
> both modified: src/etc/testcases/taskdefs/optional/script.xml
> both modified: src/tests/antunit/core/extension-point-test.xml
> deleted by us:   src/tests/antunit/taskdefs/apt-test.xml
> both modified:   src/tests/antunit/taskdefs/get-test.xml
> both modified:   src/tests/antunit/taskdefs/javac-test.xml
> both modified:   src/tests/antunit/taskdefs/tar-test.xml
> both modified: src/tests/antunit/taskdefs/taskdef-antlib-test.xml
> 
> 

Re: ant git commit: Unbreak tests

2018-07-07 Thread Jaikiran Pai

Hello Martijn,

Thank you for spending time on this and for that checker. I did look 
into yourmail and considered itbefore deciding on what to do with the 
state of upstream branches.I decided to go with a complete revert 
approach (which I explain in a separate reply in this thread), because I 
personally felt a lot more confident in what it meant and involved, in 
terms of git technicalities.
Again, thank you very much for these efforts. Just like you and everyone 
else who's been involved in the project, I am not happy that we had to 
do a revertand the sequence of eventswhich led us to this.


-Jaikiran



On 06/07/18 5:19 PM, j...@apache.org wrote:

Hello all

Just for your info, please take into consideration for a rollback or 
not descision (I am neither happy with the commit, nor happy with a 
rollback and therefore am 0 on rollback or not):



I have written a small checker to remove all whitespace only diffs 
from the diffs on the URL below.


Significant whitespace changes that may have been lost would be 
unlikely (space difference before "/>" , ">" or ")" and around "=" is 
also ignored)


That would reduce the original "2f64e0b5"  diff to (the extra lines 
starting with \ before the diff are added by the checker i wrote)


Removing whitespace only changes from asf.txt
From: Gintas Grigelionis 
Date: Sun, 1 Jul 2018 13:31:35 + (+0200)
Subject: Trailing whitespace
X-Git-Url: 
https://git1-us-west.apache.org/repos/asf?p=ant.git;a=commitdiff_plain;h=2f64e0b5


Trailing whitespace
---

\
\@ -87,11 +87,11 @@  
  JDepend Analysis align="right">Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and 
https://ant.apache.org";>Ant.  width="100%"> Summary 

\@ -87,11 +87,11 @@  
  JDepend Analysis align="right">Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and 
http://jakarta.apache.org";>Ant.  width="100%"> Summary 


\
diff --git a/src/etc/jdepend.xsl b/src/etc/jdepend.xsl
index f813297..907ade2 100644
--- a/src/etc/jdepend.xsl
+++ b/src/etc/jdepend.xsl
@@ -87,11 +87,11 @@
 
 
 
-
+
 JDepend Analysis
-    Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and 
http://jakarta.apache.org";>Ant.

-    
-
+    Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and 
https://ant.apache.org";>Ant.

+    
+
 
 Summary
 
\
\@ -57,8 +57,8 @@  dir="${test.dir}/src/org/apache/tools/ant"/> dir="${test.dir}/dest"/> file="${test.dir}/src/org/apache/tools/ant/DirscannerSetup.java"> 

Re: ant git commit: Unbreak tests

2018-07-07 Thread Jaikiran Pai
Here's a status of the current state of upstream repo branches "master" 
and "1.9.x". But before getting to it, I would like to state that I 
really had no pleasure in doing these reverts. I really do mean it. I 
wish we had never ended up in this situation (and hopefully will never 
again), but I do believe reverting this was the right decision.


1.9.x branch:

- Before starting the revert operation, the latest commit on this branch 
was 7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0 which was the trailing 
whitespace commit.
- Reverted that commit by issuing a "git revert 
7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0"
- Did a clean build (just compilation and jar generation, no test cases 
were run locally)
- Finally to make sure I didn't introduce any unnecessary 
changes/problems of my own in this efforts, I compared the latest commit 
(which was the revert commit) against the 
7df9120ebc1f9bee97a6a1a47f0a5fda986e4ab0 commit's parent on 1.9.x, 
b2da27513c7806357bf146bde44b3cc469757122 using the following command:


git diff b2da27513c7806357bf146bde44b3cc469757122 
9b1b8dbbc6e9aa98922da28683f3773f586811e5


This returned empty (which is a good thing)

Pushed this state to upstream 1.9.x branch.

master branch:

This was a bit more complicated than the 1.9.x branch, given merge 
commits plus additional master only commits that had happened on this 
branch between the trailing whitespace commit, plus the fact that the 
trailing whitespace commit touched extremely large number of files.


- Before starting the revert on this branch, the latest commit on it was 
4ce54bf3b6c521af9c8db3229df5cd8b3199a3b2.
- The trailing whitespace commit was done before that above commit and 
was 2f64e0b51c295960cb15aa77c7c1f447b2518e14. There were some other 
unrelated commits between these 2 commits.

- Reverted that commit by issuing:

git revert 2f64e0b51c295960cb15aa77c7c1f447b2518e14

Needed to sort out merge conflicts with the following files:
Unmerged paths:
  (use "git reset HEAD ..." to unstage)
  (use "git add ..." to mark resolution)

    both modified:   src/etc/testcases/taskdefs/cvspass.xml
    both modified:   src/etc/testcases/taskdefs/delete.xml
    both modified:   src/etc/testcases/taskdefs/jar.xml
    both modified: src/etc/testcases/taskdefs/optional/pvcs.xml
    both modified: 
src/etc/testcases/taskdefs/optional/xml/endpiece-ns-no-location.xml

    both modified: src/etc/testcases/taskdefs/optional/xml/endpiece.xml
    both modified:   src/etc/testcases/taskdefs/typedef.xml
    both modified:   src/tests/antunit/taskdefs/copy-test.xml
    both modified:   src/tests/antunit/taskdefs/get-test.xml

Manually fixed those conflicts and completed the revert.

- Did one round of local clean build to make sure things were fine.
- At this point, the revert was complete, but there remained one more 
step to merge 1.9.x branch into master.
- Issued "git merge 1.9.x" (where 1.9.x was the branch which included 
the fully reverted state)

- Merge conflicts had to be resolved in the following files:

Unmerged paths:
  (use "git add/rm ..." as appropriate to mark resolution)

    both modified:   src/etc/poms/ant-javamail/pom.xml
    both modified:   src/etc/poms/ant-swing/pom.xml
    both modified:   src/etc/poms/ant-testutil/pom.xml
    both modified:   src/etc/testcases/filters/build.xml
    both modified: src/etc/testcases/taskdefs/conditions/antversion.xml
    both modified:   src/etc/testcases/taskdefs/delete.xml
    both modified:   src/etc/testcases/taskdefs/java.xml
    both modified: src/etc/testcases/taskdefs/optional/pvcs.xml
    both modified: src/etc/testcases/taskdefs/optional/script.xml
    both modified: src/tests/antunit/core/extension-point-test.xml
    deleted by us:   src/tests/antunit/taskdefs/apt-test.xml
    both modified:   src/tests/antunit/taskdefs/get-test.xml
    both modified:   src/tests/antunit/taskdefs/javac-test.xml
    both modified:   src/tests/antunit/taskdefs/tar-test.xml
    both modified: src/tests/antunit/taskdefs/taskdef-antlib-test.xml

Manually resolved the conflicts in all of those and committed the merge 
locally.


- Ran one more round of local build and it went fine (no tests were 
executed locally).
- Finally to make sure that I hadn't messed up these revert + merge, I 
did a compare of the latest master commit (which included the revert + 
merge state) against the parent of the (reverted) 
2f64e0b51c295960cb15aa77c7c1f447b2518e14 commit, 
aad5b519563cfe3dab3034be9bd3e83c0fb508c0 using the command:


git diff aad5b519563cfe3dab3034be9bd3e83c0fb508c0 
995b518abf60dd8cd52f9e94c4186bbf78513b96


(unlike the 1.9.x case), this command returned a diff which contained 
the expected set of changes that had gone in between the trailing 
whitespace, force updated merge commits on master. Reviewed this 
comparison diff and it looked fine and correct to me. Pushed this state 
to "master" branch of upstream repo.


At this point, these branches are in a state where they can be used for 
regu

Re: ant git commit: Unbreak tests

2018-07-06 Thread jkf

Hello all

Just for your info, please take into consideration for a rollback or not 
descision (I am neither happy with the commit, nor happy with a rollback 
and therefore am 0 on rollback or not):



I have written a small checker to remove all whitespace only diffs from 
the diffs on the URL below.


Significant whitespace changes that may have been lost would be unlikely 
(space difference before "/>" , ">" or ")" and around "=" is also ignored)


That would reduce the original "2f64e0b5"  diff to (the extra lines 
starting with \ before the diff are added by the checker i wrote)


Removing whitespace only changes from asf.txt
From: Gintas Grigelionis 
Date: Sun, 1 Jul 2018 13:31:35 + (+0200)
Subject: Trailing whitespace
X-Git-Url: 
https://git1-us-west.apache.org/repos/asf?p=ant.git;a=commitdiff_plain;h=2f64e0b5


Trailing whitespace
---

\
\@ -87,11 +87,11 @@  
  JDepend Analysis align="right">Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and href="https://ant.apache.org";>Ant.  width="100%"> Summary align="right">
\@ -87,11 +87,11 @@  
  JDepend Analysis align="right">Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and href="http://jakarta.apache.org";>Ant.  width="100%"> Summary align="right">

\
diff --git a/src/etc/jdepend.xsl b/src/etc/jdepend.xsl
index f813297..907ade2 100644
--- a/src/etc/jdepend.xsl
+++ b/src/etc/jdepend.xsl
@@ -87,11 +87,11 @@
 
 
 
-
+
 JDepend Analysis
-    Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and href="http://jakarta.apache.org";>Ant.

-    
-
+    Designed for use with href="http://www.clarkware.com/software/JDepend.html";>JDepend and href="https://ant.apache.org";>Ant.

+    
+
 
 Summary
 
\
\@ -57,8 +57,8 @@  dir="${test.dir}/src/org/apache/tools/ant"/> dir="${test.dir}/dest"/> file="${test.dir}/src/org/apache/tools/ant/DirscannerSetup.java"> 

Re: ant git commit: Unbreak tests

2018-07-06 Thread Stefan Bodewig
On 2018-07-06, Jaikiran Pai wrote:

> On 05/07/18 2:42 PM, Stefan Bodewig wrote:
>> On 2018-07-05, Jaikiran Pai wrote:

>>> I personally believe that reviewing these meaningless changes is a
>>> waste of time and energy. I'm in favour of rolling back the entire
>>> commit set if that's what it takes.

>> +1

>> although reverting the commits in both branches and merging back the
>> 1.9.x branch is likely going to end in an ugly merge that will need
>> review as well. Hopefullly a shorter one.

> Yes, I agree.I plan to attempt this later tonight (around 8 hours from
> now) if no one else gets to it before that. Just letting it know here,
> so that we don't end up duplicating these efforts.

Thank you. I'm unlikely to get there before you do, would have tackled
it tomorrow.

Stefan

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-05 Thread Jaikiran Pai



On 05/07/18 2:42 PM, Stefan Bodewig wrote:

On 2018-07-05, Jaikiran Pai wrote:


I personally believe that reviewing these meaningless changes is a
waste of time and energy. I'm in favour of rolling back the entire
commit set if that's what it takes.

+1

although reverting the commits in both branches and merging back the
1.9.x branch is likely going to end in an ugly merge that will need
review as well. Hopefullly a shorter one.
Yes, I agree.I plan to attempt this later tonight (around 8 hours from 
now) if no one else gets to it before that. Just letting it know here, 
so that we don't end up duplicating these efforts.


-Jaikiran

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-05 Thread Stefan Bodewig
On 2018-07-05, Jaikiran Pai wrote:

> I personally believe that reviewing these meaningless changes is a
> waste of time and energy. I'm in favour of rolling back the entire
> commit set if that's what it takes.

+1

although reverting the commits in both branches and merging back the
1.9.x branch is likely going to end in an ugly merge that will need
review as well. Hopefullly a shorter one.

Stefan

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-04 Thread Jaikiran Pai

On 05/07/18 12:57 AM, Stefan Bodewig wrote:

Gintas,


-  passfile="testpassfile.tmp"%/>
+  passfile="testpassfile.tmp"/>

the commit that introduced the issue was labeled "Trailing whitespace"
and I trusted to contain exactly that and didn't bother reviewing
it. Obviously it did not.

A single commit that spans a dozen mail messages is something you really
cannot review properly.

Glitches happen, this is not a problem. But if they hide inside a patch
that contains more than 4500 changes lines it becomes impossible to deal
with them.

Given we were planning to cut new releases I now feel very uncomfortable
and compelled to wade through all those 4500 lines as well as the 4500
lines of the other commit with the same message and the merge of the 1.9
branch (and doing the same to the equally big commits on the 1.9.x
branch). This is going to delay the releases by several days, at least.

It was made explicitly clear by committers, PMC members and Ant PMC 
chairman that the commits of these nature aren't acceptable. Yet, more 
and more such commits have been done over and over again, using these 
upstream repos as a personal playground and forcing it on the rest of 
the community. At this point, I personally believe that reviewing these 
meaningless changes is a waste of time and energy. I'm in favour of 
rolling back the entire commit set if that's what it takes.


-Jaikiran

-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org



Re: ant git commit: Unbreak tests

2018-07-04 Thread Stefan Bodewig
Gintas,

> -  passfile="testpassfile.tmp"%/>
> +  passfile="testpassfile.tmp"/>

the commit that introduced the issue was labeled "Trailing whitespace"
and I trusted to contain exactly that and didn't bother reviewing
it. Obviously it did not.

A single commit that spans a dozen mail messages is something you really
cannot review properly.

Glitches happen, this is not a problem. But if they hide inside a patch
that contains more than 4500 changes lines it becomes impossible to deal
with them.

Given we were planning to cut new releases I now feel very uncomfortable
and compelled to wade through all those 4500 lines as well as the 4500
lines of the other commit with the same message and the merge of the 1.9
branch (and doing the same to the equally big commits on the 1.9.x
branch). This is going to delay the releases by several days, at least.

Stefan


-
To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org
For additional commands, e-mail: dev-h...@ant.apache.org