Re: Resizable array, the fastest known approach

2022-02-08 Thread Greg Young
A bit older reference but worth benchmarking https://stackoverflow.com/questions/11621606/faster-way-to-move-memory-page-than-mremap On Tue, Feb 8, 2022 at 6:51 AM r r wrote: > Hello, > 1. What is the fastest implementation of resizable array in Java? I know > only one, that copies whole array

Re: Megamorphic virtual call optimization in Java

2022-02-05 Thread Greg Young
which jvm? On Sat, Feb 5, 2022 at 6:26 AM r r wrote: > Hello, > we know that there are some techniques that make virtual calls not so > expensive in JVM like Inline Cache or Polymorphic Inline Cache. > > Let's consider the following situation: > > Base is an interface. > > public void f(Base[] b

Re: What linux distribution is better tooled for learning about resource utilization and perf tuning

2019-07-11 Thread Greg Young
How well do you already know Linux? Are you comfortable compiling kernels etc or are you just looking for a stock install? While this seems like a trivial detail it's not :) On Thu, Jul 11, 2019, 9:53 PM Ruslan Rusu wrote: > Hi here, > > I'm a beginner in this space. As I read and learn was cu

Re: Faster System.nanotime() ?

2019-05-01 Thread Greg Young
"A) Some BIOSes resetting TSC on a single core or hyperthread on each socket (usually thread 0 of core 0) for some strange reason during the boot sequence. [I've conclusively shown this on some 4 socket Sandy Bridge systems.] This leads different vcores to have vastly differing TSC values, which ge

Re: Sorting a very large number of objects

2019-01-19 Thread Greg Young
Given the list and people having many levels of experience/age/etc its probably worth expounding on : I'm reminded about the old story of the McIlroy and Knuth word count programs. https://franklinchen.com/blog/2011/12/08/revisiting-knuth-and-mcilroys-word-count-programs/ On Sat, Jan 19, 2019 at

Re: Probing the CPU for metrics / info

2018-11-29 Thread Greg Young
take a look at http://libcpuid.sourceforge.net/index.html On Thu, Nov 29, 2018 at 5:19 PM Mani Sarkar wrote: > Hi, > > Haven't written here for a long time. I have a query about probing CPUs > (via commands and/or programs) to find out vital information about them > mostly speed/performance rela

Re: Getting clock difference of 2 servers upto single digit micros (as close as possible)

2018-11-04 Thread Greg Young
So there is a well known protocol for this (determining relative clocks) from a rather unusual source... chess servers! Many people enjoy playing chess online very quickly (say 1 minute per side), when playing such quick games a small latency difference can make a huge overall difference so it beco

Re: Mechanical sympathy for high schoolers?

2018-10-18 Thread Greg Young
So I would probably focus on some more basic principles with them and focus on what is faster and *why*. I would also *NOT* use javascript if the point was to look at efficiency but instead something like C. To be fair you can teach an aspiring student enough C to write basic data structures very q

Re: How does matching engine on the financial exchanges handle fail-over

2018-09-08 Thread Greg Young
Just to add to the already fair reply by Martin. Take a look at how eventstore works. It tolerates a minority of servers failing, takes load similar to stock exchanges, and is OSS so you can actually read the code. https://github.com/eventstore/eventstore. You can actually find our paxos implementa

Re: jHiccup for .NET?

2018-08-29 Thread Greg Young
If someone wants to work on it I have a profiler api implementation that could be a useful starting point. It supports both mono and the CLR (two separate implementations the mono one is in C the CLR C++) On Wed, Aug 29, 2018 at 1:07 PM Remi Forax wrote: > > > -- > >

Re: Throughput test of OpenHFT networking

2018-05-12 Thread Greg Young
learning > purpose. > > > W dniu sobota, 12 maja 2018 21:59:53 UTC+2 użytkownik Greg Young napisał: >> >> Will your production system be running over loopback? >> >> On Sun, May 13, 2018 at 1:59 AM, John Hening wrote: >> >>> I know that testing by loop

Re: Throughput test of OpenHFT networking

2018-05-12 Thread Greg Young
Will your production system be running over loopback? On Sun, May 13, 2018 at 1:59 AM, John Hening wrote: > I know that testing by loopback isn't the best idea (and that it omits a > part of the network stack) but it is the simplest and I have just a laptop > with one physical network interface

Re: peanut butter

2018-05-08 Thread Greg Young
We used to have a similar one "mole asses" referring to https://en.wikipedia.org/wiki/Molasses. Though we also used it in regard to people on teams. On Tue, May 8, 2018 at 6:16 PM, Tony Finch wrote: > Some time ago I encountered the term "peanut butter", meaning bad > performance due to a pervas

Re: Exclusive core for a process, is it reasonable?

2018-04-09 Thread Greg Young
rt going into this is astounding. I can't help thinking >> that it won't end well. >> >> On 04/09/2018 10:55 AM, Greg Young wrote: >> >> To be fair many of the fpga based things have also moved to asics. You >> know you are in for fun when a fpga is too slow.

Re: Exclusive core for a process, is it reasonable?

2018-04-09 Thread Greg Young
To be fair many of the fpga based things have also moved to asics. You know you are in for fun when a fpga is too slow. On Mon, Apr 9, 2018 at 12:58 AM, Martin Thompson wrote: > 5+ years ago it was pretty common for folks to modify the Linux kernel or > run cut down OS implementations when pushi

Re: Intra-process queue between Java and C++

2018-03-30 Thread Greg Young
Will the 16 bytes save you time? On Fri, Mar 30, 2018 at 10:36 PM, Roman Leventov wrote: > Martin, thanks a lot! > > I thought about Aeron IPC, but as far as I understand it maps to the queue > model only when there is a single producer and a single consumer. Also it > felt a little too heavywei

Re: REST for comms (GOTO 2015 talk)

2017-09-04 Thread Greg Young
This is slightly changed in http 2.0 (unsolicited response) On Thu, Aug 17, 2017 at 6:24 PM, Todd Montgomery wrote: > REST and RPC have good uses. But they are not a panacea. > > REST has implicit coupling because each HTTP request must have a > corresponding HTTP response. Think of this as mand

Re: Disk-based logger - write pretouch

2017-07-10 Thread Greg Young
I would be interested to test it with zfs, it might even be harmful On Mon, Jul 10, 2017 at 11:55 PM, Michael Barker wrote: > From our own experience with journaling the benefits of pre-touching files > depends on the file system used. When ended up using XFS and threw away > all of our pre-tou

Re: Socket buffer and rates streaming

2017-04-14 Thread Greg Young
for a price feed? what good is a 30 second old price update? I would prefer the current one losing the middle in most cases. if you were doing level 2 data (order book) this statement would make more sense. On Fri, Apr 14, 2017 at 3:00 PM, Vero K. wrote: > thanks, but losing msgs won't work for

Re: Why would SocketChannel be slower when sending a single msg instead of 1k msgs after proper warmup?

2017-04-12 Thread Greg Young
You are likely measuring wrong and just have not figured out how yet. On Wed, Apr 12, 2017 at 8:56 PM, J Crawford wrote: > The SO question has the source codes of a simple server and client that > demonstrate and isolate the problem. Basically I'm timing the latency of a > ping-pong (client-serve

Re: Hiring Angular JS Developer at Washington DC

2017-01-30 Thread Greg Young
On another list after getting tons of these we setup the list so it would require approval on first mail. That got rid of all of them. On Mon, Jan 30, 2017 at 4:30 PM, Richard Warburton wrote: > Hi, > > This is not a job postings mailing, please don't send messages like this > again. > > On Mon,

Re: Prefetching and false sharing

2017-01-29 Thread Greg Young
I am not sure how much I would trust an AWS machine in general for benchmarks On Sun, Jan 29, 2017 at 7:34 PM, Duarte Nunes wrote: > Forgot to mention that I had to use an AWS machine and CPU counters are not > available, so not posting those. > > > On Sunday, January 29, 2017 at 8:33:46 PM UTC+1

Re: US Presidents and Computing Security

2017-01-02 Thread Greg Young
Why do I have generals and couriers in my head? On Mon, Jan 2, 2017 at 7:43 AM, k...@kodewerk.com wrote: > > On Jan 2, 2017, at 8:31 AM, Chris Vest wrote: > > The rabbit hole of what-can-be-trusted goes pretty deep: > http://sharps.org/wp-content/uploads/BECKER-CHES.pdf > > > > > 'Computers have

Re: Systematic Process to Reduce Linux OS Jitter

2016-12-26 Thread Greg Young
@Gil this should be a blog post. On Mon, Dec 26, 2016 at 5:09 PM, Gil Tene wrote: > One of the biggest reasons folks tend to stay away from the consumer CPUs in > this space (like the is the i7-6950X you mentioned below) is the ack of ECC > memory support. I really wish Intel provided ECC suppor

Modern Garbage Collection (good article)

2016-12-21 Thread Greg Young
Thought people on here would enjoy this https://medium.com/@octskyward/modern-garbage-collection-911ef4f8bd8e#.ptdzwcmq2 -- Studying for the Turing test -- You received this message because you are subscribed to the Google Groups "mechanical-sympathy" group. To unsubscribe from this group and

Re: Does percentile metrics follow the rules of summations?

2016-12-21 Thread Greg Young
no because the 99th percentiles do not necessarily happen at the same time. On Wed, Dec 21, 2016 at 10:53 AM, Gaurav Abbi wrote: > Hi, > We are collecting certain metrics using (Graphite + Grafana) use them as a > tool to monitor system health and performance. > > For one of the latency metric, w

Re: LLC-misses are high, and yet it runs slower - why?

2016-12-15 Thread Greg Young
While I don't have an answer to your question I just wanted to point out that it is a wonderful question and I would love to see more like this on the list. On Thu, Dec 15, 2016 at 9:55 AM, Elazar Leibovich wrote: > Hi, > > I wrote a small piece of code that should > demonstrate the fact that one

Re: detecting "broken" TCP connections

2016-11-29 Thread Greg Young
In my experience protocol level tcp keep alives don't always work between implementations. BSD - windows used to be a primary culprit, though they were set they would not get hit in some cases. Things may be better today. On same implementation they should work quite well. Definitely worth testing

New Instructions (Intel)

2016-10-14 Thread Greg Young
https://lkml.org/lkml/2016/10/12/530 -- Studying for the Turing test -- You received this message because you are subscribed to the Google Groups "mechanical-sympathy" group. To unsubscribe from this group and stop receiving emails from it, send an email to mechanical-sympathy+unsubscr...@goo

Re: False sharing/memory alignment performance with memory mapped files

2016-09-11 Thread Greg Young
Just guessing but based on the test, the cache aligned version touches pages with different access pattern than the test without alignment. On Sun, Sep 11, 2016 at 5:37 PM, Kyle Kavanagh wrote: > Looking into the effects of false sharing when writing to memory mapped > files. Intuitively, I woul

The myth of ram

2016-09-03 Thread Greg Young
http://www.ilikebigbits.com/blog/2014/4/21/the-myth-of-ram-part-i without comment. -- Studying for the Turing test -- You received this message because you are subscribed to the Google Groups "mechanical-sympathy" group. To unsubscribe from this group and stop receiving emails from it, send a

Re: How to sequence messages we sent to client and find bugs

2016-08-21 Thread Greg Young
With exchanges often traffic is sent to everyone when using non-reliable transports such as UDP. As example see the STAMP protocol (over UDP multicast). In this protocol every message is given a sequence number (perfectly ordered). Clients then can find any missing messages by looking for gaps in t