Re: iopipe v0.0.4 - RingBuffers!

2018-05-15 Thread biocyberman via Digitalmars-d-announce
On Monday, 14 May 2018 at 14:23:43 UTC, Steven Schveighoffer wrote: On 5/14/18 6:02 AM, bioinfornatics wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: [...] Hi Steve, It is an exciting works, that could help in bioinformatics area. Indeed in bioinformatics we

Re: iopipe v0.0.4 - RingBuffers!

2018-05-14 Thread Claude via Digitalmars-d-announce
On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: However, I am struggling to find a use case for this that showcases why you would want to use it. While it does work, and works beautifully, it doesn't show any measurable difference vs. the array allocated buffer that

Re: iopipe v0.0.4 - RingBuffers!

2018-05-14 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/14/18 6:02 AM, bioinfornatics wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. However, I am struggling to

Re: iopipe v0.0.4 - RingBuffers!

2018-05-14 Thread bioinfornatics via Digitalmars-d-announce
On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. However, I am struggling to find a use case for this that showcases why

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Nick Sabalausky (Abscissa) via Digitalmars-d-announce
On 05/12/2018 08:14 AM, Steven Schveighoffer wrote: But I am not expecting any miracles here. GNU grep does pretty much everything it can to achieve performance -- including eschewing the standard library buffering system as I am doing. I can probably match the performance at some point, but

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/12/18 3:38 PM, Patrick Schluter wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. [...] They can be

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Patrick Schluter via Digitalmars-d-announce
On Friday, 11 May 2018 at 16:06:41 UTC, Jonathan M Davis wrote: [...] Oh, there had been an epic forum thread about the use of GNU grep for BSD. i don't remember the details but it was long and heated (it was so epic that I even read it as I normaly don't care at all for BSD stuff).

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Patrick Schluter via Digitalmars-d-announce
On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. [...] They can be problematic with some CPU's and OS's. For modern

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Dmitry Olshansky via Digitalmars-d-announce
On Saturday, 12 May 2018 at 14:48:58 UTC, Joakim wrote: On Saturday, 12 May 2018 at 12:45:16 UTC, Dmitry Olshansky wrote: On Saturday, 12 May 2018 at 12:14:28 UTC, Steven Schveighoffer wrote: [...] I could offer a few tricks to fix that w/o getting too dirty. GNU grep is fast, but std.regex

Re: iopipe v0.0.4 - RingBuffers!

2018-05-12 Thread Dmitry Olshansky via Digitalmars-d-announce
On Saturday, 12 May 2018 at 12:14:28 UTC, Steven Schveighoffer wrote: On 5/11/18 5:42 PM, Joakim wrote: On Friday, 11 May 2018 at 16:07:26 UTC, Steven Schveighoffer wrote: [...] What stops you from downloading a linux release from here? https://github.com/ldc-developers/ldc/releases So I

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Uknown via Digitalmars-d-announce
On Friday, 11 May 2018 at 23:46:16 UTC, Dmitry Olshansky wrote: On Friday, 11 May 2018 at 13:28:58 UTC, Steven Schveighoffer wrote: On 5/11/18 1:30 AM, Dmitry Olshansky wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: grep on Mac is a piece of sheat, sadly and I

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Dmitry Olshansky via Digitalmars-d-announce
On Friday, 11 May 2018 at 13:28:58 UTC, Steven Schveighoffer wrote: On 5/11/18 1:30 AM, Dmitry Olshansky wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Joakim via Digitalmars-d-announce
On Friday, 11 May 2018 at 16:07:26 UTC, Steven Schveighoffer wrote: On 5/11/18 11:44 AM, Steven Schveighoffer wrote: On 5/10/18 7:22 PM, Steven Schveighoffer wrote: [...] Shameful note: Macos grep is BSD grep, and is not NEARLY as fast as GNU grep, which has much better performance (and is

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Jon Degenhardt via Digitalmars-d-announce
On Friday, 11 May 2018 at 15:44:04 UTC, Steven Schveighoffer wrote: On 5/10/18 7:22 PM, Steven Schveighoffer wrote: Shameful note: Macos grep is BSD grep, and is not NEARLY as fast as GNU grep, which has much better performance (and is 2x as fast as iopipe_search on my Linux VM, even when

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/11/18 11:44 AM, Steven Schveighoffer wrote: On 5/10/18 7:22 PM, Steven Schveighoffer wrote: However, this example *does* show the power of iopipe -- it handles all flavors of unicode with one template function, is quite straightforward (though I want to abstract the line tracking code,

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Jonathan M Davis via Digitalmars-d-announce
On Friday, May 11, 2018 11:44:04 Steven Schveighoffer via Digitalmars-d- announce wrote: > Shameful note: Macos grep is BSD grep, and is not NEARLY as fast as GNU > grep, which has much better performance (and is 2x as fast as > iopipe_search on my Linux VM, even when printing line numbers).

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/10/18 7:22 PM, Steven Schveighoffer wrote: However, this example *does* show the power of iopipe -- it handles all flavors of unicode with one template function, is quite straightforward (though I want to abstract the line tracking code, that stuff is really tricky to get right). Oh, and

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Uknown via Digitalmars-d-announce
On Friday, 11 May 2018 at 13:28:58 UTC, Steven Schveighoffer wrote: [...] I do get the point of having to go outside the cache. I'll look and see if maybe specifying a 1000 line context helps ;) Update: nope, still pretty much the same. I'm sure someone will find some good show off

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Ali Çehreli via Digitalmars-d-announce
On 05/11/2018 06:28 AM, Steven Schveighoffer wrote: > 1. Ring buffers are really cool (I still love how it works) and perform > as well as normal buffers > 2. The use cases are much smaller than I thought There is the LMAX Disruptor, which was open sourced a few year ago along with a large

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/11/18 5:55 AM, Kagamin wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: However, I am struggling to find a use case for this that showcases why you would want to use it. While it does work, and works beautifully, it doesn't show any measurable difference vs.

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Steven Schveighoffer via Digitalmars-d-announce
On 5/11/18 1:30 AM, Dmitry Olshansky wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. However, I am struggling to

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Dmitry Olshansky via Digitalmars-d-announce
On Friday, 11 May 2018 at 09:55:10 UTC, Kagamin wrote: On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: However, I am struggling to find a use case for this that showcases why you would want to use it. While it does work, and works beautifully, it doesn't show any

Re: iopipe v0.0.4 - RingBuffers!

2018-05-11 Thread Kagamin via Digitalmars-d-announce
On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: However, I am struggling to find a use case for this that showcases why you would want to use it. While it does work, and works beautifully, it doesn't show any measurable difference vs. the array allocated buffer that

Re: iopipe v0.0.4 - RingBuffers!

2018-05-10 Thread Dmitry Olshansky via Digitalmars-d-announce
On Thursday, 10 May 2018 at 23:22:02 UTC, Steven Schveighoffer wrote: OK, so at dconf I spoke with a few very smart guys about how I can use mmap to make a zero-copy buffer. And I implemented this on the plane ride home. However, I am struggling to find a use case for this that showcases why