Hi
I've run into some performance issues with my hadoop MapReduce Job.
Basically what I'm doing with it is:
- read data from HDFS file
- the output goes also to HDFS file (multiple ones in my scenerio)
- in my mapper I process each line and enrich it with some data read
from HBase table (I do Get each time)
- I don't use reducer
The Get performance seems not that good. On Average it is ~17.5
gets/second. Peaks are 100gets/sec (which would be desirable speed :)).
The logs are from one node only. and the performance count also.
My schema is nothing special - one ColumnFamily with 3 columns. But I
heavilly use timestamps. My table looks like this:
{NAME => 'XYZ', FAMILIES => [{NAME => 'cf', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS =>
'2147483646', true
TTL => '2147483647', MIN_VERSIONS => '0', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}
Look at number of VERSIONS.
And my GETs are like this:
Get get = new Get(Bytes.toBytes(key));
get.setMaxVersions(1);
get.setTimeRange(0, timestamp);
get.setCacheBlocks(false);
get.addFamily(Bytes.toBytes("cf"));
Result res = htable.get(get);
I init that HTable like this:
htable = new HTable(config, QUERY_TABLE_NAME);
htable.setAutoFlush(false);
htable.setWriteBufferSize(1024 * 1024 * 12);
I've attached a sample of Get performance - first column is number of
GETs, the second is a date.
Could You suggest where I'm getting that performance penalty? What to
look at to check if I'm not doing something stupid here, what kind of
statistics?
Regards
Marcin
8 2012-06-19 10:20:19
21 2012-06-19 10:20:20
25 2012-06-19 10:20:21
13 2012-06-19 10:20:22
22 2012-06-19 10:20:23
4 2012-06-19 10:20:24
3 2012-06-19 10:20:25
2 2012-06-19 10:20:27
1 2012-06-19 10:20:28
7 2012-06-19 10:20:29
2 2012-06-19 10:20:30
1 2012-06-19 10:20:32
2 2012-06-19 10:20:33
5 2012-06-19 10:20:34
2 2012-06-19 10:20:35
3 2012-06-19 10:20:37
5 2012-06-19 10:20:38
5 2012-06-19 10:20:39
16 2012-06-19 10:20:40
16 2012-06-19 10:20:41
11 2012-06-19 10:20:42
5 2012-06-19 10:20:43
6 2012-06-19 10:20:44
15 2012-06-19 10:20:45
12 2012-06-19 10:20:46
19 2012-06-19 10:20:47
17 2012-06-19 10:20:48
17 2012-06-19 10:20:49
19 2012-06-19 10:20:50
12 2012-06-19 10:20:51
16 2012-06-19 10:20:52
14 2012-06-19 10:20:53
5 2012-06-19 10:20:54
26 2012-06-19 10:20:55
16 2012-06-19 10:20:56
17 2012-06-19 10:20:57
11 2012-06-19 10:20:58
18 2012-06-19 10:20:59
20 2012-06-19 10:21:00
18 2012-06-19 10:21:01
21 2012-06-19 10:21:02
28 2012-06-19 10:21:03
17 2012-06-19 10:21:04
19 2012-06-19 10:21:05
8 2012-06-19 10:21:06
12 2012-06-19 10:21:07
22 2012-06-19 10:21:08
16 2012-06-19 10:21:09
16 2012-06-19 10:21:10
18 2012-06-19 10:21:11
20 2012-06-19 10:21:12
24 2012-06-19 10:21:13
17 2012-06-19 10:21:14
21 2012-06-19 10:21:15
9 2012-06-19 10:21:16
14 2012-06-19 10:21:17
20 2012-06-19 10:21:18
40 2012-06-19 10:21:19
24 2012-06-19 10:21:20
15 2012-06-19 10:21:21
16 2012-06-19 10:21:22
27 2012-06-19 10:21:23
3 2012-06-19 10:21:24
20 2012-06-19 10:21:25
21 2012-06-19 10:21:26
20 2012-06-19 10:21:27
17 2012-06-19 10:21:28
27 2012-06-19 10:21:29
10 2012-06-19 10:21:30
10 2012-06-19 10:21:31
9 2012-06-19 10:21:32
10 2012-06-19 10:21:33
15 2012-06-19 10:21:34
23 2012-06-19 10:21:35
18 2012-06-19 10:21:36
17 2012-06-19 10:21:37
23 2012-06-19 10:21:38
21 2012-06-19 10:21:39
14 2012-06-19 10:21:40
18 2012-06-19 10:21:41
13 2012-06-19 10:21:42
23 2012-06-19 10:21:43
13 2012-06-19 10:21:45
13 2012-06-19 10:21:46
15 2012-06-19 10:21:47
11 2012-06-19 10:21:48
2 2012-06-19 10:21:49
13 2012-06-19 10:21:50
16 2012-06-19 10:21:51
15 2012-06-19 10:21:52
16 2012-06-19 10:21:53
28 2012-06-19 10:21:54
23 2012-06-19 10:21:55
24 2012-06-19 10:21:56
34 2012-06-19 10:21:57
22 2012-06-19 10:21:58
24 2012-06-19 10:21:59
22 2012-06-19 10:22:00
20 2012-06-19 10:22:01
18 2012-06-19 10:22:02
13 2012-06-19 10:22:03
19 2012-06-19 10:22:04
16 2012-06-19 10:22:05
13 2012-06-19 10:22:06
26 2012-06-19 10:22:07
18 2012-06-19 10:22:08
8 2012-06-19 10:22:09
42 2012-06-19 10:22:10
11 2012-06-19 10:22:11
9 2012-06-19 10:22:12
12 2012-06-19 10:22:13
45 2012-06-19 10:22:14
25 2012-06-19 10:22:15
16 2012-06-19 10:22:16
19 2012-06-19 10:22:17
28 2012-06-19 10:22:18
32 2012-06-19 10:22:19
14 2012-06-19 10:22:20
17 2012-06-19 10:22:21
20 2012-06-19 10:22:22
27 2012-06-19 10:22:23
100 2012-06-19 10:22:24
15 2012-06-19 10:22:25
20 2012-06-19 10:22:26
13 2012-06-19 10:22:27
12 2012-06-19 10:22:28
12 2012-06-19 10:22:29
9 2012-06-19 10:22:30
29 2012-06-19 10:22:31
14 2012-06-19 10:22:32
19 2012-06-19 10:22:33
24 2012-06-19 10:22:34
24 2012-06-19 10:22:35
20 2012-06-19 10:22:36
22 2012-06-19 10:22:37
14 2012-06-19 10:22:38
14 2012-06-19 10:22:39
18 2012-06-19 10:22:40
17 2012-06-19 10:22:41
13 2012-06-19 10:22:42
15 2012-06-19 10:22:43
23 2012-06-19 10:22:44
23 2012-06-19 10:22:45
20 2012-06-19 10:22:46
17 2012-06-19 10:22:47
7 2012-06-19 10:22:48
18 2012-06-19 10:22:49
25 2012-06-19 10:22:50
14 2012-06-19 10:22:51
21 2012-06-19 10:22:52
25 2012-06-19 10:22:53
8 2012-06-19 10:22:54
19 2012-06-19 10:22:55
14 2012-06-19 10:22:56
14 2012-06-19 10:22:57
19 2012-06-19 10:22:58
28 2012-06-19 10:22:59
27 2012-06-19 10:23:00
26 2012-06-19 10:23:01
16 2012-06-19 10:23:02
10 2012-06-19 10:23:03
22 2012-06-19 10:23:04
8 2012-06-19 10:23:05
15 2012-06-19 10:23:06
21 2012-06-19 10:23:07
32 2012-06-19 10:23:08
15 2012-06-19 10:23:09
8 2012-06-19 10:23:10
7 2012-06-19 10:23:11
10 2012-06-19 10:23:12
23 2012-06-19 10:23:13
17 2012-06-19 10:23:14
17 2012-06-19 10:23:15
10 2012-06-19 10:23:16
9 2012-06-19 10:23:17
15 2012-06-19 10:23:18
13 2012-06-19 10:23:19
17 2012-06-19 10:23:20
15 2012-06-19 10:23:21
13 2012-06-19 10:23:22
16 2012-06-19 10:23:23
14 2012-06-19 10:23:24
10 2012-06-19 10:23:25
19 2012-06-19 10:23:26
11 2012-06-19 10:23:27
14 2012-06-19 10:23:28
17 2012-06-19 10:23:29
22 2012-06-19 10:23:30
11 2012-06-19 10:23:31
17 2012-06-19 10:23:32
21 2012-06-19 10:23:33
9 2012-06-19 10:23:34
20 2012-06-19 10:23:35
15 2012-06-19 10:23:36
15 2012-06-19 10:23:37
20 2012-06-19 10:23:38
10 2012-06-19 10:23:39
2 2012-06-19 10:23:40
18 2012-06-19 10:23:41
21 2012-06-19 10:23:42
23 2012-06-19 10:23:43
21 2012-06-19 10:23:44
21 2012-06-19 10:23:45
15 2012-06-19 10:23:46
27 2012-06-19 10:23:47
17 2012-06-19 10:23:48
33 2012-06-19 10:23:49
14 2012-06-19 10:23:50
24 2012-06-19 10:23:51
28 2012-06-19 10:23:52
23 2012-06-19 10:23:53
15 2012-06-19 10:23:54
14 2012-06-19 10:23:55
11 2012-06-19 10:23:56
9 2012-06-19 10:23:57
13 2012-06-19 10:23:58
20 2012-06-19 10:23:59
21 2012-06-19 10:24:00
9 2012-06-19 10:24:01
11 2012-06-19 10:24:02
11 2012-06-19 10:24:03
22 2012-06-19 10:24:04
20 2012-06-19 10:24:05
11 2012-06-19 10:24:06
14 2012-06-19 10:24:07
22 2012-06-19 10:24:08
29 2012-06-19 10:24:09
36 2012-06-19 10:24:10
16 2012-06-19 10:24:11
22 2012-06-19 10:24:12
16 2012-06-19 10:24:13
28 2012-06-19 10:24:14
14 2012-06-19 10:24:15
14 2012-06-19 10:24:16
18 2012-06-19 10:24:17
30 2012-06-19 10:24:18
9 2012-06-19 10:24:19
18 2012-06-19 10:24:20
12 2012-06-19 10:24:21
20 2012-06-19 10:24:22
23 2012-06-19 10:24:23
28 2012-06-19 10:24:24
28 2012-06-19 10:24:25
31 2012-06-19 10:24:26
25 2012-06-19 10:24:27
21 2012-06-19 10:24:28
29 2012-06-19 10:24:29
22 2012-06-19 10:24:30
21 2012-06-19 10:24:31
16 2012-06-19 10:24:32
14 2012-06-19 10:24:33
18 2012-06-19 10:24:34
25 2012-06-19 10:24:35
27 2012-06-19 10:24:36
27 2012-06-19 10:24:37
17 2012-06-19 10:24:38
23 2012-06-19 10:24:39
22 2012-06-19 10:24:40
25 2012-06-19 10:24:41
15 2012-06-19 10:24:42
1 2012-06-19 10:24:43
