[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156223#comment-14156223
]
Damien Carol commented on HIVE-8231:
[~alangates] HIVE-8290 solve this issue.
As HIVE-8290 is commited, HIVE don't try to use {{foo7}} as bucketed table.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Attachments: a_beeline_insert.txt, a_hiveserver2_insert.txt,
b_beeline_insert.txt, b_hiveserver2_insert.txt, c_beeline.txt,
c_hiveserver2.txt
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155640#comment-14155640
]
Alan Gates commented on HIVE-8231:
--
Damien, I'm definitely still trying to debug this. But I'm juggling it with
several other bugs, so it may be a day or until until I figure anything out.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Attachments: a_beeline_insert.txt, a_hiveserver2_insert.txt,
b_beeline_insert.txt, b_hiveserver2_insert.txt, c_beeline.txt,
c_hiveserver2.txt
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152951#comment-14152951
]
Damien Carol commented on HIVE-8231:
Restarting HDFS AND Yarn AND remote Metastore AND Hiveserver2 didn't helped.
I think the bug comes because there are no base dir.
When I'm doing major compaction. The base is created and I can see the new rows.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152978#comment-14152978
]
Damien Carol commented on HIVE-8231:
I don't think it's a cache issue. Doing stop/run of ALL daemons of the cluster
change nothing.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153012#comment-14153012
]
Damien Carol commented on HIVE-8231:
Another strange result, when I'm doing this query:
{code}
select ROW__ID, INPUT__FILE__NAME, * from foo7;
{code}
I'm having this result :
{noformat}
+---+-+--+--+
|row__id|
input__file__name | foo7.id |
+---+-+--+--+
| {transactionid:536,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:537,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:538,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:539,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:540,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:541,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:542,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:544,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:545,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
| {transactionid:546,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_542/bucket_0 | 1
|
+---+-+--+--+
10 rows selected (0.168 seconds)
{noformat}
Which is wrong.
See here :
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
/user/hive/warehouse/casino.db/foo7;
+-+--+
| DFS Output
|
+-+--+
| Found 4 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-30 11:29
/user/hive/warehouse/casino.db/foo7/base_542 |
| drwxr-xr-x - hduser supergroup 0 2014-09-30 11:30
/user/hive/warehouse/casino.db/foo7/delta_544_544 |
| drwxr-xr-x - hduser supergroup 0 2014-09-30 11:30
/user/hive/warehouse/casino.db/foo7/delta_545_545 |
| drwxr-xr-x - hduser supergroup 0 2014-09-30 11:30
/user/hive/warehouse/casino.db/foo7/delta_546_546 |
+-+--+
5 rows selected (0.025 seconds)
{noformat}
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string |
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153022#comment-14153022
]
Damien Carol commented on HIVE-8231:
With block offset VC :
{noformat}
+---+-+--+--+--+
|row__id|
input__file__name | block__offset__inside__file |
foo7.id |
+---+-+--+--+--+
| {transactionid:536,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
61 | 1|
| {transactionid:537,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
122 | 1|
| {transactionid:538,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
183 | 1|
| {transactionid:539,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
244 | 1|
| {transactionid:540,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
306 | 1|
| {transactionid:541,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
367 | 1|
| {transactionid:542,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
428 | 1|
| {transactionid:544,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
489 | 1|
| {transactionid:545,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
550 | 1|
| {transactionid:546,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
612 | 1|
| {transactionid:547,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
612 | 1|
| {transactionid:548,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
612 | 1|
| {transactionid:549,bucketid:0,rowid:0} |
hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/base_546/bucket_0 |
612 | 1|
+---+-+--+--+--+
13 rows selected (0.162 seconds)
{noformat}
Column {{input\_\_file\_\_name}} and {{block\_\_offset\_\_inside\_\_file}} have
wrong values for the last 3 rows. These rows are in delta directories.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3.
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153279#comment-14153279
]
Alan Gates commented on HIVE-8231:
--
Ok, I'm not sure if we're chasing the same bug or not. But I'll keep chasing
the one I see and if we get lucky it will turn out to have the same root cause.
Could you turn on debug level logging on your hive client and HiveServer2
instance, then do the insert and select that reproduces the error and attach
both logs. That would help me have an idea where things may be going wrong.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153281#comment-14153281
]
Alan Gates commented on HIVE-8231:
--
I mean JDBC client, not hive client.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153627#comment-14153627
]
Alan Gates commented on HIVE-8231:
--
I definitely think we are seeing separate issues. I have a filed a new issue
HIVE-8311 for what I am seeing.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153682#comment-14153682
]
Damien Carol commented on HIVE-8231:
[~alangates] I agree because every query in my cluster use the SAME Tez Session
and reuse the same containers.
Feel free to help me on this one once HIVE-8311 is out :)
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Attachments: a_beeline_insert.txt, a_hiveserver2_insert.txt,
b_beeline_insert.txt, b_hiveserver2_insert.txt
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151757#comment-14151757
]
Damien Carol commented on HIVE-8231:
[~alangates] I made lot of tests in WE. It seems that INSERT/DELETE/UPDATE
doesn't work at all with concurrency enabled.
If I deactivate ACID with :
{noformat}
!-- concurrency --
property
namehive.support.concurrency/name
valuefalse/value
/property
!-- compactor org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager /
org.apache.hadoop.hive.ql.lockmgr.DbTxnManager --
property
namehive.txn.manager/name
valueorg.apache.hadoop.hive.ql.lockmgr.DummyTxnManager/value
/property
{noformat}
then everything is ok.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151758#comment-14151758
]
Damien Carol commented on HIVE-8231:
To be more precise, this commands works :
{code}
drop table if exists foo6;
create table foo6 (id int) clustered by (id) into 1 buckets;
insert into table foo6 VALUES(1);
select * from foo6;
drop table if exists foo7;
create table foo7 (id int) STORED AS ORC;
insert into table foo7 VALUES(1);
select * from foo7;
{code}
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151759#comment-14151759
]
Damien Carol commented on HIVE-8231:
This bug is still here even with HIVE-8203 committed.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152007#comment-14152007
]
Alan Gates commented on HIVE-8231:
--
I think I can reproduce the same bug with 2 command line sessions doing things
in the following order:
# Start session 1
# in session 1 insert into table
# start session 2
# in session 2 select * see all rows
# in session 1, delete some rows
# in session 1 selec *, see less rows
# in session 2 select * , see all rows
If I stop and restart session 2 after this, than it sees the appropriate number
of rows. So either it isn't getting new transaction information for each query
in the session, or the results are being cached somewhere on it.
Does this match the behavior you're seeing?
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152384#comment-14152384
]
Damien Carol commented on HIVE-8231:
I need to test [~alangates] use case.
I will also try another test: stop and restart session between each query.
Few details on my config:
* We use Tez session
* We use container re-use
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152518#comment-14152518
]
Alan Gates commented on HIVE-8231:
--
At the moment I'm testing with MR.
Also, I see that if I do a query that causes an MR job (for instance {{select
count (*))}}) then it gets the right result.
In looking through the logs the select * on session two (step 7 above) actually
sees the wrong number of delta files in the directory. I'm working on
debugging whether this is because it is caching the file listing (which I
doubt) or because it is caching the transaction information (more likely) and
not seeing the newer files because it believes it shouldn't. I have confirmed
that Driver.runInternal (which encodes the transaction information) is encoding
the right information, but that may not be being properly propagated to the
FileSinkOperator reading the data.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Priority: Critical
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149134#comment-14149134
]
Damien Carol commented on HIVE-8231:
*seams to only affects ORC format*
More investigation on last trunk (26/09/2014):
{noformat}
0: jdbc:hive2://nc-h04:1/casino drop table if exists foo6;
No rows affected (0.121 seconds)
0: jdbc:hive2://nc-h04:1/casino create table foo6 (id int);
No rows affected (0.08 seconds)
0: jdbc:hive2://nc-h04:1/casino insert into table foo6 VALUES(1);
No rows affected (2.823 seconds)
0: jdbc:hive2://nc-h04:1/casino select * from foo6;
+--+--+
| foo6.id |
+--+--+
| 1|
+--+--+
1 row selected (0.079 seconds)
0: jdbc:hive2://nc-h04:1/casino
0: jdbc:hive2://nc-h04:1/casino
0: jdbc:hive2://nc-h04:1/casino drop table if exists foo7;
No rows affected (0.127 seconds)
0: jdbc:hive2://nc-h04:1/casino create table foo7 (id int) STORED AS ORC;
No rows affected (0.059 seconds)
0: jdbc:hive2://nc-h04:1/casino insert into table foo7 VALUES(1);
No rows affected (1.707 seconds)
0: jdbc:hive2://nc-h04:1/casino select * from foo7;
+--+--+
| foo7.id |
+--+--+
+--+--+
No rows selected (0.084 seconds)
{noformat}
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
|
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149142#comment-14149142
]
Damien Carol commented on HIVE-8231:
I see in log :
{noformat}
2014-09-26 15:32:18,483 ERROR [Thread-8]: compactor.Initiator
(Initiator.java:run(111)) - Caught exception while trying to determine if we
should compact testsimon.values__tmp__table__11. Marking clean to avoid
repeated failures, java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.txn.compactor.Initiator.run(Initiator.java:88)
2014-09-26 15:32:18,484 ERROR [Thread-8]: txn.CompactionTxnHandler
(CompactionTxnHandler.java:markCleaned(355)) - Unable to delete compaction
record
{noformat}
I wonder if there is a problem with the tables that store values.
Every values table stay in database :
{noformat}
0: jdbc:hive2://nc-h04:1/casino show tables;
+---+--+
| tab_name |
+---+--+
| classification_compte |
| dim_hotesse |
...
| societe |
| testsimon__dim_lieu_sorted_dls__ |
| values__tmp__table__10|
| values__tmp__table__11|
| values__tmp__table__12|
| values__tmp__table__2 |
| values__tmp__table__3 |
| values__tmp__table__4 |
| values__tmp__table__5 |
| values__tmp__table__6 |
| values__tmp__table__7 |
| values__tmp__table__8 |
| values__tmp__table__9 |
+---+--+
47 rows selected (0.061 seconds)
0: jdbc:hive2://nc-h04:1/casino
{noformat}
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149206#comment-14149206
]
Alan Gates commented on HIVE-8231:
--
The values table should vanish as soon as you close the session that did the
insert, since they are temp tables.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149215#comment-14149215
]
Alan Gates commented on HIVE-8231:
--
[~damien.carol], based on your output above it looks like you are reading the
data via HS2 (since it says jdbc in your command line). There was a definite
bug in using ACID via HS2. I'm curious if you still see this after HIVE-8203.
I'll have that one checked in as soon as the 24 hours after Eugene's +1 passes.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
[jira] [Commented] (HIVE-8231) Error when insert into empty table with ACID
[
https://issues.apache.org/jira/browse/HIVE-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149938#comment-14149938
]
Damien Carol commented on HIVE-8231:
bq. ... based on your output above it looks like you are reading the data via
HS2.
[~alangates] yes, I'm using HS2. I saw your comment on HIVE-8203 and I made the
link. I'm waiting the fix of HIVE-8203 and I will re-test on real data.
The behaviour of values tables is still confusing.
Error when insert into empty table with ACID
Key: HIVE-8231
URL: https://issues.apache.org/jira/browse/HIVE-8231
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Damien Carol
Assignee: Damien Carol
Fix For: 0.14.0
Steps to show the bug :
1. create table
{code}
create table encaissement_1b_64m like encaissement_1b;
{code}
2. check table
{code}
desc encaissement_1b_64m;
dfs -ls hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m;
{code}
everything is ok:
{noformat}
0: jdbc:hive2://nc-h04:1/casino desc encaissement_1b_64m;
+++--+--+
| col_name | data_type | comment |
+++--+--+
| id | int| |
| idmagasin | int| |
| zibzin | string | |
| cheque | int| |
| montant| double | |
| date | timestamp | |
| col_6 | string | |
| col_7 | string | |
| col_8 | string | |
+++--+--+
9 rows selected (0.158 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS Output |
+-+--+
+-+--+
No rows selected (0.01 seconds)
{noformat}
3. Insert values into the new table
{noformat}
insert into table encaissement_1b_64m VALUES (1, 1,
'8909', 1, 12.5, '12/05/2014', '','','');
{noformat}
4. Check
{noformat}
0: jdbc:hive2://nc-h04:1/casino select id from encaissement_1b_64m;
+-+--+
| id |
+-+--+
+-+--+
No rows selected (0.091 seconds)
{noformat}
There are already a pb. I don't see the inserted row.
5. When I'm checking HDFS directory, I see {{delta_421_421}} folder
{noformat}
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
+-+--+
| DFS
Output |
+-+--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:17
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/delta_421_421
|
+-+--+
2 rows selected (0.014 seconds)
{noformat}
6. Doing a major compaction solves the bug
{noformat}
0: jdbc:hive2://nc-h04:1/casino alter table encaissement_1b_64m compact
'major';
No rows affected (0.046 seconds)
0: jdbc:hive2://nc-h04:1/casino dfs -ls
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/;
++--+
| DFS Output
|
++--+
| Found 1 items
|
| drwxr-xr-x - hduser supergroup 0 2014-09-23 12:21
hdfs://nc-h04/user/hive/warehouse/casino.db/encaissement_1b_64m/base_421
|
++--+
2 rows selected (0.02 seconds)
{noformat}
--
This
