A long time ago I asked a similar question in this list. The answer I received was that Latency in JMeter is the time elapsed since the request sent and the first chunk (4kb) of the response is received.
To overcome this issue I start a program inside a shell or prompt to get latency statistics during the test. The concept of Latency is the elapsed time since the last byte sent and the first byte received.
