[PATCH v9 00/19] index-helper/watchman

2016-05-09 Thread David Turner
Formatting and patch naming fixes from Junio. No substantive changes. David Turner (8): index-helper: log warnings unpack-trees: preserve index extensions watchman: add a config option to enable the extension index-helper: kill mode index-helper: don't run if already running

[PATCH v9 02/19] read-cache: allow to keep mmap'd memory after reading

2016-05-09 Thread David Turner
From: Nguyễn Thái Ngọc Duy Later, we will introduce git index-helper to share this memory with other git processes. We only unmap it when we discard the index (although the kernel may of course choose to page it out). Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner

[PATCH v9 08/19] read-cache: add watchman 'WAMA' extension

2016-05-09 Thread David Turner
n Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/technical/index-format.txt | 22 ++ cache.h | 4 ++ dir.h| 3 + read-cache.c | 117 ++- 4 files changed,

[PATCH v9 09/19] watchman: support watchman to reduce index refresh cost

2016-05-09 Thread David Turner
From: Nguyễn Thái Ngọc Duy The previous patch has the logic to clear bits in 'WAMA' bitmap. This patch has logic to set bits as told by watchman. The missing bit, _using_ these bits, are not here yet. A lot of this code is written by David Turner originally, mostly from [1]. I'

[PATCH v9 11/19] update-index: enable/disable watchman support

2016-05-09 Thread David Turner
From: Nguyễn Thái Ngọc Duy Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ Documentation/git-update-index.txt | 6 ++ builtin/update-index.c | 16 3 files changed, 25 insertions(+) diff --git a

[PATCH v9 13/19] watchman: add a config option to enable the extension

2016-05-09 Thread David Turner
For installations that have centrally-managed configuration, it's easier to set a config once than to run update-index on every repository. Signed-off-by: David Turner --- .gitignore| 1 + Documentation/config.txt | 4 Makefile | 1 +

[PATCH v9 10/19] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-09 Thread David Turner
ting. That kind of list can be kept in index-helper. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 6 + cache.h| 2 + dir.c | 23 +++- dir.h

[PATCH v9 16/19] index-helper: autorun mode

2016-05-09 Thread David Turner
Soon, we'll want to automatically start index-helper, so we need a mode that silently exits if it can't start up (either because it's not in a git dir, or because another one is already running). Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 4

[PATCH v9 03/19] index-helper: new daemon for caching index and related stuff

2016-05-09 Thread David Turner
ne.org/gmane.comp.version-control.git/247268/focus=248771 Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner Signed-off-by: Ramsay Jones --- .gitignore | 1 + Documentation/git-index-helper.txt | 50 +++ Makefile | 5 + cach

[PATCH v9 05/19] index-helper: log warnings

2016-05-09 Thread David Turner
Instead of writing warnings to stderr, write them to a log. Later, we'll probably be daemonized, so writing to stderr will be pointless. Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ index-helper.c | 32 --

[PATCH v9 19/19] untracked-cache: config option

2016-05-09 Thread David Turner
Add a config option to populate the untracked cache. For installations that have centrally-managed configuration, it's easier to set a config once than to run update-index on every repository. Signed-off-by: David Turner --- Documentation/config.txt | 4 read-cache.c

[PATCH v9 17/19] index-helper: optionally automatically run

2016-05-09 Thread David Turner
Introduce a new config option, indexhelper.autorun, to automatically run git index-helper before starting up a builtin git command. This enables users to keep index-helper running without manual intervention. Signed-off-by: David Turner --- Documentation/config.txt | 4 read-cache.c

[PATCH v9 15/19] index-helper: don't run if already running

2016-05-09 Thread David Turner
Signed-off-by: David Turner --- index-helper.c | 7 +++ t/t7900-index-helper.sh | 9 + 2 files changed, 16 insertions(+) diff --git a/index-helper.c b/index-helper.c index 4ed1610..b275f6e 100644 --- a/index-helper.c +++ b/index-helper.c @@ -458,6 +458,13 @@ int main(int

[PATCH v9 18/19] trace: measure where the time is spent in the index-heavy operations

2016-05-09 Thread David Turner
: 0.004052343 s: write index, changed mask = 2 trace.c:420 performance: 0.048365509 s: git command: './git' 'status' Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- diff-lib.c | 4 dir.c| 2 ++ name-hash.c

[PATCH v9 04/19] index-helper: add --strict

2016-05-09 Thread David Turner
t;) and before verify_shm() detects an error. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 9 +++ cache.h| 1 + index-helper.c | 48 +++

Re: [PATCH v9 00/19] index-helper/watchman

2016-05-09 Thread David Turner
On Mon, 2016-05-09 at 14:40 -0700, Junio C Hamano wrote: > Hmmm, I seem to be getting > > $ cat t/trash*7900*/err > fatal: Already running > > after running t7900 and it fails at #5, after applying > "index-helper: optionally automatically run" It still passes for me (with or without USE

Re: [PATCH v9 00/19] index-helper/watchman

2016-05-09 Thread David Turner
On Mon, 2016-05-09 at 15:32 -0700, Junio C Hamano wrote: > Junio C Hamano writes: > > > David Turner writes: > > > > > On Mon, 2016-05-09 at 14:40 -0700, Junio C Hamano wrote: > > > > Hmmm, I seem to be getting > > > > > > > >

Re: [PATCH v9 03/19] index-helper: new daemon for caching index and related stuff

2016-05-10 Thread David Turner
Will do, thanks. On Tue, 2016-05-10 at 12:13 +0200, SZEDER Gábor wrote: > This patch adds a new plumbing command, which then will show up in > completion after 'git '. Could you please squash in this > oneliner to exclude index-helper from porcelain commands in the > completion script? > > > --

[PATCH v10 02/20] read-cache: allow to keep mmap'd memory after reading

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy Later, we will introduce git index-helper to share this memory with other git processes. We only unmap it when we discard the index (although the kernel may of course choose to page it out). Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner

[PATCH v10 03/20] pkt-line: add gentle version of packet_write

2016-05-12 Thread David Turner
ld be permitted to die without disrupting clients. Signed-off-by: David Turner --- pkt-line.c | 18 ++ pkt-line.h | 2 ++ 2 files changed, 20 insertions(+) diff --git a/pkt-line.c b/pkt-line.c index 62fdb37..f964446 100644 --- a/pkt-line.c +++ b/pkt-line.c @@ -91,6 +91,12 @@

[PATCH v10 15/20] index-helper: kill mode

2016-05-12 Thread David Turner
Add a new command (and command-line arg) to allow index-helpers to exit cleanly. This is mainly useful for tests. Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ index-helper.c | 31 ++- t/t7900-index-helper.sh

[PATCH v10 10/20] watchman: support watchman to reduce index refresh cost

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy The previous patch has the logic to clear bits in 'WAMA' bitmap. This patch has logic to set bits as told by watchman. The missing bit, _using_ these bits, are not here yet. A lot of this code is written by David Turner originally, mostly from [1]. I'

[PATCH v10 05/20] index-helper: add --strict

2016-05-12 Thread David Turner
t;) and before verify_shm() detects an error. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 9 +++ cache.h| 1 + index-helper.c | 48 +++

[PATCH v10 18/20] index-helper: optionally automatically run

2016-05-12 Thread David Turner
Introduce a new config option, indexhelper.autorun, to automatically run git index-helper before starting up a builtin git command. This enables users to keep index-helper running without manual intervention. Signed-off-by: David Turner --- Documentation/config.txt | 4 read-cache.c

[PATCH v10 07/20] index-helper: add --detach

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy We detach after creating and opening the socket, because otherwise we might return control to the shell before index-helper is ready to accept commands. This might lead to flaky tests. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner

[PATCH v10 11/20] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-12 Thread David Turner
ting. That kind of list can be kept in index-helper. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 6 + cache.h| 2 + dir.c | 23 +++- dir.h

[PATCH v10 00/20] index-helper/watchman

2016-05-12 Thread David Turner
packet_write was causing the sigpipes (by calling write_or_die, which intentionally overrides the caller's preferences about signal handling). This version fixes that. I didn't test on a virtual machine, but I did test by adding a sleep(). David Turner (9): pkt-line: add gentle

[PATCH v10 17/20] index-helper: autorun mode

2016-05-12 Thread David Turner
Soon, we'll want to automatically start index-helper, so we need a mode that silently exits if it can't start up (either because it's not in a git dir, or because another one is already running). Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 4

[PATCH v10 13/20] unpack-trees: preserve index extensions

2016-05-12 Thread David Turner
the untracked cache were entirely invalidated by such an operation, the user has signaled their intention to have such a cache, and we don't want to throw it away. The same logic applies to the watchman state. Signed-off-by: David Turner --- cache.h | 1 + read-ca

[PATCH v10 19/20] trace: measure where the time is spent in the index-heavy operations

2016-05-12 Thread David Turner
: 0.004052343 s: write index, changed mask = 2 trace.c:420 performance: 0.048365509 s: git command: './git' 'status' Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- diff-lib.c | 4 dir.c| 2 ++ name-hash.c

[PATCH v10 20/20] untracked-cache: config option

2016-05-12 Thread David Turner
Add a config option to populate the untracked cache. For installations that have centrally-managed configuration, it's easier to set a config once than to run update-index on every repository. Signed-off-by: David Turner --- Documentation/config.txt | 4 read-cache.c

[PATCH v10 09/20] read-cache: add watchman 'WAMA' extension

2016-05-12 Thread David Turner
n Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/technical/index-format.txt | 22 ++ cache.h | 4 ++ dir.h| 3 + read-cache.c | 117 ++- 4 files changed,

[PATCH v10 14/20] watchman: add a config option to enable the extension

2016-05-12 Thread David Turner
For installations that have centrally-managed configuration, it's easier to set a config once than to run update-index on every repository. Signed-off-by: David Turner --- .gitignore| 1 + Documentation/config.txt | 4 Makefile | 1 +

[PATCH v10 06/20] daemonize(): set a flag before exiting the main process

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy This allows signal handlers and atexit functions to realize this situation and not clean up. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- builtin/gc.c | 2 +- cache.h | 2 +- daemon.c | 2 +- setup.c | 4 +++- 4 files changed, 6

[PATCH v10 08/20] index-helper: log warnings

2016-05-12 Thread David Turner
Instead of writing warnings to stderr, write them to a log. Later, we'll probably be daemonized, so writing to stderr will be pointless. Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ index-helper.c | 12 +++- 2 files change

[PATCH v10 12/20] update-index: enable/disable watchman support

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ Documentation/git-update-index.txt | 6 ++ builtin/update-index.c | 16 3 files changed, 25 insertions(+) diff --git a

[PATCH v10 01/20] read-cache.c: fix constness of verify_hdr()

2016-05-12 Thread David Turner
From: Nguyễn Thái Ngọc Duy Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- read-cache.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/read-cache.c b/read-cache.c index d9fb78b..16cc487 100644 --- a/read-cache.c +++ b/read-cache.c @@ -1345,7 +1345,7

[PATCH v10 16/20] index-helper: don't run if already running

2016-05-12 Thread David Turner
Signed-off-by: David Turner --- index-helper.c | 7 +++ t/t7900-index-helper.sh | 9 + 2 files changed, 16 insertions(+) diff --git a/index-helper.c b/index-helper.c index a1b33e4..7b893a0 100644 --- a/index-helper.c +++ b/index-helper.c @@ -435,6 +435,13 @@ int main(int

[PATCH v10 04/20] index-helper: new daemon for caching index and related stuff

2016-05-12 Thread David Turner
ne.org/gmane.comp.version-control.git/247268/focus=248771 Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner Signed-off-by: Ramsay Jones --- .gitignore | 1 + Documentation/git-index-helper.txt | 50 ++ Makefile

Re: [PATCH v10 11/20] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-13 Thread David Turner
On Fri, 2016-05-13 at 00:10 +0100, Ramsay Jones wrote: > > On 12/05/16 21:20, David Turner wrote: > > From: Nguyễn Thái Ngọc Duy > [snip] > > > > > +/* in ms */ > > +#define WATCHMAN_TIMEOUT 1000 > > + > > +static int poke_and_wait_fo

[PATCH] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-13 Thread David Turner
ting. That kind of list can be kept in index-helper. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Can we just replace this one patch? Documentation/git-index-helper.txt | 6 + cache.h| 2 + dir.c | 23 +++- dir.

[PATCH v10 ter] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-13 Thread David Turner
listing. That kind of list can be kept in index-helper. Helped-by: Ramsay Jones Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Right, let's try this one instead. The actual segfault that Ramsay points out will not happen in ordinary usage (since we control both client and

Re: [PATCH v10 20/20] untracked-cache: config option

2016-05-16 Thread David Turner
On Sun, 2016-05-15 at 16:43 +0700, Duy Nguyen wrote: > On Fri, May 13, 2016 at 3:20 AM, David Turner < > dtur...@twopensource.com> wrote: > > Add a config option to populate the untracked cache. > > > > For installations that have centrally-managed configuration, i

Re: [RFD PATCH 0/3] Free all the memory!

2016-05-16 Thread David Turner
On Mon, 2016-05-16 at 20:22 -0700, Stefan Beller wrote: > When using automated tools to find memory leaks, it is hard to > distinguish > between actual leaks and intentional non-cleanups at the end of the > program, > such that the actual leaks hide in the noise. valgrind on git rev-parse HEAD sho

Re: [PATCH 04/14] connect: rewrite feature parsing to work on string_list

2016-05-17 Thread David Turner
On Wed, 2016-05-04 at 13:13 -0700, Junio C Hamano wrote: > Stefan Beller writes: > > > Later on when we introduce the version 2 transport protocol, the > > capabilities will not be transported in one lone string but each > > s/lone/long/, I think. > > > capability will be carried in its own pkt

Re: [PATCH v10 00/20] index-helper/watchman

2016-05-19 Thread David Turner
Do folks have any more comments on this version? Do I need to re-roll to replace 11/20 as I proposed and drop 20/20? Thanks. On Thu, 2016-05-12 at 16:19 -0400, David Turner wrote: > packet_write was causing the sigpipes (by calling write_or_die, which > intentionally overrides the ca

Re: [PATCH v10 00/20] index-helper/watchman

2016-05-19 Thread David Turner
On Thu, 2016-05-19 at 13:11 -0700, Junio C Hamano wrote: > David Turner writes: > > > Do folks have any more comments on this version? > > Not from me at the moment. > > > Do I need to re-roll > > to replace 11/20 as I proposed and drop 20/20? > >

[PATCH v12 00/20] index-helper/watchman

2016-05-19 Thread David Turner
automatically-run index-helpers, so I fixed that (with a new patch at the end of the series). Everything else is the same as the updated version of v11. David Turner (9): pkt-line: add gentle version of packet_write index-helper: log warnings unpack-trees: preserve index extensions watchman

[PATCH v12 02/20] read-cache: allow to keep mmap'd memory after reading

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy Later, we will introduce git index-helper to share this memory with other git processes. We only unmap it when we discard the index (although the kernel may of course choose to page it out). Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner

[PATCH v12 07/20] index-helper: add --detach

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy We detach after creating and opening the socket, because otherwise we might return control to the shell before index-helper is ready to accept commands. This might lead to flaky tests. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner

[PATCH v12 01/20] read-cache.c: fix constness of verify_hdr()

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- read-cache.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/read-cache.c b/read-cache.c index d9fb78b..16cc487 100644 --- a/read-cache.c +++ b/read-cache.c @@ -1345,7 +1345,7

[PATCH v12 06/20] daemonize(): set a flag before exiting the main process

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy This allows signal handlers and atexit functions to realize this situation and not clean up. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- builtin/gc.c | 2 +- cache.h | 2 +- daemon.c | 2 +- setup.c | 4 +++- 4 files changed, 6

[PATCH v12 03/20] pkt-line: add gentle version of packet_write

2016-05-19 Thread David Turner
ld be permitted to die without disrupting clients. Signed-off-by: David Turner --- pkt-line.c | 18 ++ pkt-line.h | 2 ++ 2 files changed, 20 insertions(+) diff --git a/pkt-line.c b/pkt-line.c index 62fdb37..f964446 100644 --- a/pkt-line.c +++ b/pkt-line.c @@ -91,6 +91,12 @@

[PATCH v12 05/20] index-helper: add --strict

2016-05-19 Thread David Turner
t;) and before verify_shm() detects an error. Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 9 +++ cache.h| 1 + index-helper.c | 48 +++

[PATCH v12 13/20] unpack-trees: preserve index extensions

2016-05-19 Thread David Turner
the untracked cache were entirely invalidated by such an operation, the user has signaled their intention to have such a cache, and we don't want to throw it away. The same logic applies to the watchman state. Signed-off-by: David Turner --- cache.h | 1 + read-ca

[PATCH v12 12/20] update-index: enable/disable watchman support

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ Documentation/git-update-index.txt | 6 ++ builtin/update-index.c | 16 3 files changed, 25 insertions(+) diff --git a

[PATCH v12 11/20] index-helper: use watchman to avoid refreshing index with lstat()

2016-05-19 Thread David Turner
listing. That kind of list can be kept in index-helper. Helped-by: Ramsay Jones Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 6 + cache.h| 2 + dir.c | 23 +++- dir.

[PATCH v12 18/20] index-helper: optionally automatically run

2016-05-19 Thread David Turner
Introduce a new config option, indexhelper.autorun, to automatically run git index-helper before starting up a builtin git command. This enables users to keep index-helper running without manual intervention. Signed-off-by: David Turner --- Documentation/config.txt | 4 read-cache.c

[PATCH v12 19/20] trace: measure where the time is spent in the index-heavy operations

2016-05-19 Thread David Turner
: 0.004052343 s: write index, changed mask = 2 trace.c:420 performance: 0.048365509 s: git command: './git' 'status' Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner --- diff-lib.c | 4 dir.c| 2 ++ name-hash.c

[PATCH v12 14/20] watchman: add a config option to enable the extension

2016-05-19 Thread David Turner
For installations that have centrally-managed configuration, it's easier to set a config once than to run update-index on every repository. Signed-off-by: David Turner --- .gitignore| 1 + Documentation/config.txt | 4 Makefile | 1 +

[PATCH v12 08/20] index-helper: log warnings

2016-05-19 Thread David Turner
Instead of writing warnings to stderr, write them to a log. Later, we'll probably be daemonized, so writing to stderr will be pointless. Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ index-helper.c | 12 +++- 2 files change

[PATCH v12 16/20] index-helper: don't run if already running

2016-05-19 Thread David Turner
Signed-off-by: David Turner --- index-helper.c | 7 +++ t/t7900-index-helper.sh | 9 + 2 files changed, 16 insertions(+) diff --git a/index-helper.c b/index-helper.c index 4a171e6..ddc641a 100644 --- a/index-helper.c +++ b/index-helper.c @@ -438,6 +438,13 @@ int main(int

[PATCH v12 15/20] index-helper: kill mode

2016-05-19 Thread David Turner
Add a new command (and command-line arg) to allow index-helpers to exit cleanly. This is mainly useful for tests. Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 3 +++ index-helper.c | 31 ++- t/t7900-index-helper.sh

[PATCH v12 04/20] index-helper: new daemon for caching index and related stuff

2016-05-19 Thread David Turner
ne.org/gmane.comp.version-control.git/247268/focus=248771 Signed-off-by: Nguyễn Thái Ngọc Duy Signed-off-by: David Turner Signed-off-by: Ramsay Jones --- .gitignore | 1 + Documentation/git-index-helper.txt | 50 ++ Makefile

[PATCH v12 17/20] index-helper: autorun mode

2016-05-19 Thread David Turner
Soon, we'll want to automatically start index-helper, so we need a mode that silently exits if it can't start up (either because it's not in a git dir, or because another one is already running). Signed-off-by: David Turner --- Documentation/git-index-helper.txt | 4

[PATCH v12 10/20] watchman: support watchman to reduce index refresh cost

2016-05-19 Thread David Turner
From: Nguyễn Thái Ngọc Duy The previous patch has the logic to clear bits in 'WAMA' bitmap. This patch has logic to set bits as told by watchman. The missing bit, _using_ these bits, are not here yet. A lot of this code is written by David Turner originally, mostly from [1]. I'

[PATCH v12 09/20] read-cache: add watchman 'WAMA' extension

2016-05-19 Thread David Turner
n Thái Ngọc Duy Signed-off-by: David Turner --- Documentation/technical/index-format.txt | 22 ++ cache.h | 4 ++ dir.h| 3 + read-cache.c | 117 ++- 4 files changed,

[PATCH v12 20/20] index-helper: indexhelper.exitafter config

2016-05-19 Thread David Turner
high value. Signed-off-by: David Turner --- Documentation/config.txt | 4 index-helper.c | 2 ++ t/t7900-index-helper.sh | 8 3 files changed, 14 insertions(+) diff --git a/Documentation/config.txt b/Documentation/config.txt index 385ea66..336d5a2 100644 --- a

Signing off, for now

2016-05-24 Thread David Turner
June 3rd will be my last day at Twitter. I hope that my new job (starting in July after a month of vacation) will give me time to work on Git, but I don't know exactly what parts I'll be working on, or on what schedule. As a result, some of my patchsets may get significantly less of my attention.

Re: [WIP PATCH 00/14] Protocol v2 patches

2016-05-24 Thread David Turner
I was looking at this again today, and noticed that it doesn't really address the HTTP case. The central problem is that protocol v2 goes like this: server: I have capabilities w,x,y, and z client: I want capabilities x and z. But HTTP goes like this: client: [request] server: [response] I tried

Re: [WIP PATCH 00/14] Protocol v2 patches

2016-05-25 Thread David Turner
On Wed, 2016-05-25 at 06:03 +0700, Duy Nguyen wrote: > On Wed, May 25, 2016 at 5:46 AM, David Turner < > dtur...@twopensource.com> wrote: > > I was looking at this again today, and noticed that it doesn't > > really > > address the HTTP case. > > > &g

Re: [WIP PATCH 00/14] Protocol v2 patches

2016-05-25 Thread David Turner
On Wed, 2016-05-25 at 09:23 -0700, Junio C Hamano wrote: > David Turner writes: > > > I was looking at this again today, and noticed that it doesn't > > really > > address the HTTP case. > > > > The central problem is that protocol v2 goes like this: >

Re: [PATCH 12/13] dir_iterator: new API for iterating over a directory tree

2016-05-31 Thread David Turner
On Mon, 2016-05-30 at 09:55 +0200, Michael Haggerty wrote: > +struct dir_iterator_level { > + int initialized; > + > + DIR *dir; > + > + /* > + * The length of the directory part of refname at this level "refname"? Isn't this was for directories? > + if (lsta

Re: [PATCH 2/4] reachable.c: mark reachable objects in index from all worktrees

2016-06-01 Thread David Turner
On Wed, 2016-06-01 at 17:45 +0700, Nguyễn Thái Ngọc Duy wrote: > Current mark_reachable_objects() only marks objects from index from > _current_ worktree as reachable instead of all worktrees. Because > this > function is used for pruning, there is a chance that objects > referenced > by other work

Re: [PATCH 0/2] strbuf: improve API

2016-06-01 Thread David Turner
On Wed, 2016-06-01 at 03:42 -0400, Jeff King wrote: > 2. Do caching tricks for strbufs used in tight loops. For example, > have strbuf_release() throw its buffer into a last-used cache, > and > let the next strbuf_grow() use that cache entry. This cuts > malloc() > out of the loop.

Re: [PATCH 0/2] strbuf: improve API

2016-06-01 Thread David Turner
On Wed, 2016-06-01 at 16:09 -0400, Jeff King wrote: > On Wed, Jun 01, 2016 at 03:50:29PM -0400, David Turner wrote: > > > On Wed, 2016-06-01 at 03:42 -0400, Jeff King wrote: > > > 2. Do caching tricks for strbufs used in tight loops. For > > > example, > > &g

Re: [PATCH v2 00/13] Reference iterators

2016-06-03 Thread David Turner
On Fri, 2016-06-03 at 14:33 +0200, Michael Haggerty wrote: > This is v2 of a patch series to implement iteration over references > via iterators. Thanks to Ramsay, Eric, Junio, and David for their > feedback about v1 [1]. I think I have addressed all of the points > that > were raised. In case I d

Re: Signing off, for now

2016-06-03 Thread David Turner
On Tue, 2016-05-24 at 15:22 -0400, David Turner wrote: > - Protocol v2: I would like to get a new draft of Stefan's series out > before I leave, but no promises. It's turned out to be a bit more > complicated than I expected to support HTTP. At worst, I'll toss my > WI

Re: [PATCH v2 5/6] lock_ref_for_update(): make error handling more uniform

2016-06-10 Thread David Turner
On Fri, 2016-06-10 at 10:14 +0200, Michael Haggerty wrote: > /* > + * Check whether the REF_HAVE_OLD and old_oid values stored in update > + * are consistent with the result read for the reference. error is > + * true iff there was an error reading the reference; otherwise, oid "error" is not a

Re: [PATCH v12 11/20] index-helper: use watchman to avoid refreshing index with lstat()

2016-06-17 Thread David Turner
> > - if (really && cache_errno == EINVAL) { > > + if (really || cache_errno == EINVAL) { > > /* If we are doing --really-refresh that > > * means the index is not valid anymore. > >

Re: What's cooking in git.git (Aug 2016, #06; Sun, 14)

2016-08-17 Thread David Turner
On Wed, 2016-08-17 at 17:49 +0700, Duy Nguyen wrote: > On Mon, Aug 15, 2016 at 5:46 AM, Junio C Hamano wrote: > > * dt/index-helper (2016-07-06) 21 commits > > > > A new "index-helper" daemon has been introduced to give newly > > spawned Git process a quicker access to the data in the index, and

Re: [PATCH v2 04/38] refs: add a backend method structure

2016-09-04 Thread David Turner
ances) and will > also serve as the vtable for ref_store instances of that type. > > As yet, the backends cannot do anything. > > Signed-off-by: Ronnie Sahlberg > Signed-off-by: David Turner > Signed-off-by: Junio C Hamano > Signed-off-by: Jeff King > Signed-off-by:

Re: [PATCH v2 05/38] refs: create a base class "ref_store" for files_ref_store

2016-09-04 Thread David Turner
On Sun, 2016-09-04 at 18:08 +0200, Michael Haggerty wrote: > +/* A linked list of ref_stores for submodules: */ > +static struct ref_store *submodule_ref_stores; I don't like the per-submodule stores being in a linked list, which requires a linear search. Stefan has, I think, been doing a bunch

Re: [PATCH v2 05/38] refs: create a base class "ref_store" for files_ref_store

2016-09-05 Thread David Turner
On Mon, 2016-09-05 at 05:53 +0200, Michael Haggerty wrote: > On 09/04/2016 10:40 PM, David Turner wrote: > > On Sun, 2016-09-04 at 18:08 +0200, Michael Haggerty wrote: > > > >> +/* A linked list of ref_stores for submodules: */ > >> +static struct ref_store *submo

Re: [PATCH v2 38/38] refs: implement iteration over only per-worktree refs

2016-09-08 Thread David Turner
Other than the duplicated sign-offs, this series looks good to me ("Don't act surprised, you guys, cuz I wrote 'em"). Kind of a funny place to cut it off, but I guess it makes sense. On Sun, 2016-09-04 at 18:08 +0200, Michael Haggerty wrote: > From: David Turner >

[PATCH 2/2] fsck: handle bad trees like other errors

2016-09-26 Thread David Turner
From: David Turner Instead of dying when fsck hits a malformed tree object, log the error like any other and continue. Now fsck can tell the user which tree is bad, too. Signed-off-by: David Turner --- fsck.c | 18 +++-- t/t1450-fsck.sh

[PATCH 1/2] tree-walk: be more specific about corrupt tree errors

2016-09-26 Thread David Turner
uot;, which makes it seem like the data bit-rotted on disk. Our sha1 check would already have found that. These errors are ones of data that is malformed in the first place. Signed-off-by: David Turner Signed-off-by: Jeff King --- t/t1007-hash-object.sh | 15 +-- t/t1007/tr

[PATCH 0/2] tree-walk improvements

2016-09-26 Thread David Turner
means that I'm going to continue corresponding from nova...@novalis.org, but will send patches with the @twosigma.com address in the author line. Email address note 2: I'm not subscribed to the mailing list these days, so please CC me (at nova...@novalis.org) on replies. David Turner (1):

Re: [PATCH 0/2] tree-walk improvements

2016-09-26 Thread David Turner
On Mon, 2016-09-26 at 12:43 -0700, Junio C Hamano wrote: > David Turner writes: > > > The first patch is a re-roll of Peff's patch from 2014 -- here's > > the archive message: > > > > http://git.661346.n2.nabble.com/PATCH-tree-walk-be-more-specific-

[PATCH 1/3] tree-walk: be more specific about corrupt tree errors

2016-09-26 Thread David Turner
uot;, which makes it seem like the data bit-rotted on disk. Our sha1 check would already have found that. These errors are ones of data that is malformed in the first place. Signed-off-by: David Turner Signed-off-by: Jeff King --- t/t1007-hash-object.sh | 15 +-- t/t1007/

[PATCH 2/3] fsck: handle bad trees like other errors

2016-09-26 Thread David Turner
Instead of dying when fsck hits a malformed tree object, log the error like any other and continue. Now fsck can tell the user which tree is bad, too. Signed-off-by: David Turner --- fsck.c | 18 +++-- t/t1450-fsck.sh

[PATCH 3/3] add David Turner's Two Sigma address

2016-09-26 Thread David Turner
From: David Turner Signed-off-by: David Turner --- .mailmap | 1 + 1 file changed, 1 insertion(+) diff --git a/.mailmap b/.mailmap index 9441a54..9cc33e9 100644 --- a/.mailmap +++ b/.mailmap @@ -48,6 +48,7 @@ David KÃ¥gedal David Reiss David S. Miller David Turner +David Turner

Re: [PATCH 3/3] add David Turner's Two Sigma address

2016-09-26 Thread David Turner
Sorry for the bad subject line, this is of course v2 of the series. On Mon, 2016-09-26 at 20:11 -0400, David Turner wrote: > From: David Turner > > Signed-off-by: David Turner > --- > .mailmap | 1 + > 1 file changed, 1 insertion(+) > > diff --git a/.mailmap b/

Re: [PATCH 1/2] tree-walk: be more specific about corrupt tree errors

2016-09-27 Thread David Turner
On Tue, 2016-09-27 at 01:14 -0400, Jeff King wrote: > I also wonder if $bin_sha1 should actually be more like: > > hex_sha1=$(echo foo | git hash-object --stdin -w) > bin_sha1=$(echo $hex_sha1 | perl -ne 'printf "\\%3o", ord for /./g') > > so that it's a real sha1 (or maybe it is in your orig

[PATCH v3 1/3] tree-walk: be more specific about corrupt tree errors

2016-09-27 Thread David Turner
uot;, which makes it seem like the data bit-rotted on disk. Our sha1 check would already have found that. These errors are ones of data that is malformed in the first place. Signed-off-by: David Turner Signed-off-by: Jeff King --- t/t1007-hash-object.sh | 21 +++-- tree-walk.c

[PATCH v3 3/3] add David Turner's Two Sigma address

2016-09-27 Thread David Turner
From: David Turner Signed-off-by: David Turner --- .mailmap | 1 + 1 file changed, 1 insertion(+) diff --git a/.mailmap b/.mailmap index 9441a54..9cc33e9 100644 --- a/.mailmap +++ b/.mailmap @@ -48,6 +48,7 @@ David Kågedal David Reiss David S. Miller David Turner +David Turner

[PATCH v3 2/3] fsck: handle bad trees like other errors

2016-09-27 Thread David Turner
Instead of dying when fsck hits a malformed tree object, log the error like any other and continue. Now fsck can tell the user which tree is bad, too. Signed-off-by: David Turner --- fsck.c | 18 - t/t1450-fsck.sh | 16 +-- tree-walk.c | 83

Re: [PATCH 2/2] fsck: handle bad trees like other errors

2016-09-27 Thread David Turner
On Tue, 2016-09-27 at 01:27 -0400, Jeff King wrote: > > -static void decode_tree_entry(struct tree_desc *desc, const char *buf, > > unsigned long size) > > +static int decode_tree_entry(struct tree_desc *desc, const char *buf, > > unsigned long size, struct strbuf *err) > > { > > I know we used

[PATCH v4 2/2] fsck: handle bad trees like other errors

2016-09-27 Thread David Turner
Instead of dying when fsck hits a malformed tree object, log the error like any other and continue. Now fsck can tell the user which tree is bad, too. Signed-off-by: David Turner --- fsck.c | 18 - t/t1450-fsck.sh | 16 +-- tree-walk.c | 83

[PATCH v4 1/2] tree-walk: be more specific about corrupt tree errors

2016-09-27 Thread David Turner
uot;, which makes it seem like the data bit-rotted on disk. Our sha1 check would already have found that. These errors are ones of data that is malformed in the first place. Signed-off-by: David Turner Signed-off-by: Jeff King --- t/t1007-hash-object.sh | 25 +++-

<    1   2   3   4   5   6   7   8   9   10   >