Re: [PATCH v2 6/9] streaming_write_entry: propagate streaming errors

2013-03-26 Thread Junio C Hamano
Jeff King p...@peff.net writes:

 Subject: [PATCH] streaming_write_entry: propagate streaming errors

 When we are streaming an index blob to disk, we store the
 error from stream_blob_to_fd in the result variable, and
 then immediately overwrite that with the return value of
 close. That means we catch errors on close (e.g., problems
 committing the file to disk), but miss anything which
 happened before then.

 We can fix this by using bitwise-OR to accumulate errors in
 our result variable.

 While we're here, we can also simplify the error handling
 with an early return, which makes it easier to see under
 which circumstances we need to clean up.

 Signed-off-by: Jeff King p...@peff.net

Very sensible.  Thanks.
--
To unsubscribe from this list: send the line unsubscribe git in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[PATCH v2 6/9] streaming_write_entry: propagate streaming errors

2013-03-25 Thread Jeff King
On Mon, Mar 25, 2013 at 02:39:34PM -0700, Jonathan Nieder wrote:

  --- a/entry.c
  +++ b/entry.c
  @@ -126,8 +126,10 @@ static int streaming_write_entry(struct cache_entry 
  *ce, char *path,
  fd = open_output_fd(path, ce, to_tempfile);
  if (0 = fd) {
  result = stream_blob_to_fd(fd, ce-sha1, filter, 1);
  -   *fstat_done = fstat_output(fd, state, statbuf);
  -   result = close(fd);
  +   if (!result) {
  +   *fstat_done = fstat_output(fd, state, statbuf);
  +   result = close(fd);
  +   }
 
 Should this do something like
 [...]
 to avoid leaking the file descriptor?

Yes, Eric Sunshine noticed this, too. Re-rolled patch is below, which I
think is even a little cleaner.

  +test_expect_success 'read-tree -u detects bit-errors in blobs' '
  +   (
  +   cd bit-error 
  +   rm content.t 
  +   test_must_fail git read-tree --reset -u FETCH_HEAD
  +   )
 
 Makes sense.  Might make sense to use rm -f instead of rm to avoid
 failures if content.t is removed already.

Yeah, good point. My original test looked like:

  git init bit-error 
  git fetch .. 
  corrupt ...
  test_must_fail ...

but I ended up refactoring it to re-use the corrupted directories, and
added the rm after the fact. The use of FETCH_HEAD is also bogus
(read-tree is failing, but because we are giving it a bogus ref, not
because of the corruption, so we are not actually testing anything
anymore, even though it still passes).

Both fixed in my re-roll.

-- 8 --
Subject: [PATCH] streaming_write_entry: propagate streaming errors

When we are streaming an index blob to disk, we store the
error from stream_blob_to_fd in the result variable, and
then immediately overwrite that with the return value of
close. That means we catch errors on close (e.g., problems
committing the file to disk), but miss anything which
happened before then.

We can fix this by using bitwise-OR to accumulate errors in
our result variable.

While we're here, we can also simplify the error handling
with an early return, which makes it easier to see under
which circumstances we need to clean up.

Signed-off-by: Jeff King p...@peff.net
---
 entry.c  | 16 +---
 t/t1060-object-corruption.sh | 25 +
 2 files changed, 34 insertions(+), 7 deletions(-)

diff --git a/entry.c b/entry.c
index 17a6bcc..a20bcbc 100644
--- a/entry.c
+++ b/entry.c
@@ -120,16 +120,18 @@ static int streaming_write_entry(struct cache_entry *ce, 
char *path,
 const struct checkout *state, int to_tempfile,
 int *fstat_done, struct stat *statbuf)
 {
-   int result = -1;
+   int result = 0;
int fd;
 
fd = open_output_fd(path, ce, to_tempfile);
-   if (0 = fd) {
-   result = stream_blob_to_fd(fd, ce-sha1, filter, 1);
-   *fstat_done = fstat_output(fd, state, statbuf);
-   result = close(fd);
-   }
-   if (result  0 = fd)
+   if (fd  0)
+   return -1;
+
+   result |= stream_blob_to_fd(fd, ce-sha1, filter, 1);
+   *fstat_done = fstat_output(fd, state, statbuf);
+   result |= close(fd);
+
+   if (result)
unlink(path);
return result;
 }
diff --git a/t/t1060-object-corruption.sh b/t/t1060-object-corruption.sh
index d36994a..2945395 100755
--- a/t/t1060-object-corruption.sh
+++ b/t/t1060-object-corruption.sh
@@ -24,6 +24,15 @@ test_expect_success 'setup corrupt repo' '
)
 '
 
+test_expect_success 'setup repo with missing object' '
+   git init missing 
+   (
+   cd missing 
+   test_commit content 
+   rm -f $(obj_to_file HEAD:content.t)
+   )
+'
+
 test_expect_success 'streaming a corrupt blob fails' '
(
cd bit-error 
@@ -31,4 +40,20 @@ test_expect_success 'streaming a corrupt blob fails' '
)
 '
 
+test_expect_success 'read-tree -u detects bit-errors in blobs' '
+   (
+   cd bit-error 
+   rm -f content.t 
+   test_must_fail git read-tree --reset -u HEAD
+   )
+'
+
+test_expect_success 'read-tree -u detects missing objects' '
+   (
+   cd missing 
+   rm -f content.t 
+   test_must_fail git read-tree --reset -u HEAD
+   )
+'
+
 test_done
-- 
1.8.2.13.g0f18d3c

--
To unsubscribe from this list: send the line unsubscribe git in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


Re: [PATCH v2 6/9] streaming_write_entry: propagate streaming errors

2013-03-25 Thread Jonathan Nieder
Jeff King wrote:

 Both fixed in my re-roll.

Thanks!  This and the rest of the patches up to and including patch 8
look good to me.

I haven't decided what to think about patch 9 yet, but I suspect it
would be good, too.  In the long term I suspect git clone
--worktree-only repo (or some other standard interface for
git-new-workdir functionality) is a better way to provide a convenient
lightweight same-machine clone anyway.

Jonathan
--
To unsubscribe from this list: send the line unsubscribe git in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html