hbase prefix column mapping with no value

[Wojciech Indyk]

Hello!
I have few columns in hbase with prefix. The culumns has no value, like:
pre_a -> timestamp=123, value=
pre_b -> timestamp=123, value=

I want to map the prefix on map in hive, like
https://issues.apache.org/jira/browse/HIVE-3725 .
Using map does not work: there is empty map in hive.
Any type of the value of the map doesn't work with empty value in
hbase. The mapping works with non-empty values. Is it a bug? Should I
report it?

Kindly regards
Wojciech Indyk

Re: character '' not supported here

[Nitin Pawar]

I could not solve the problem so I had to recreate the table from another
temp table

I think its issue with ORC file format
may be we can post to dev@ or wait for some dev to response

On Mon, Jul 20, 2015 at 1:51 PM, patcharee 
wrote:

>  Hi,
>
> I created a hive table stored as orc file (partitioned and compressed by
> ZLIB) from Hive CLI, added data into this table by a Spark application.
> After adding I was able to query data and everything looked fine. Then I
> concatenated the table from Hive CLI. After that I am not able to query
> data, like select count(*) from Table, any more, just got error line 1:1
> character '' not supported here, no matter Tez or MR engine.
>
> How can you solve the problem in your case?
>
> BR,
> Patcharee
>
>
>
> On 18. juli 2015 21:26, Nitin Pawar wrote:
>
>  can you tell exactly what steps you did/?
>  also did you try running the query with processing to MR instead of tez?
>  not sure this issue with orc file formats .. i had once faced issues on
> alter table for orc backed tabled on adding a new column
>
> On Sun, Jul 19, 2015 at 12:05 AM, pth001 
> wrote:
>
>>  Hi,
>>
>> The query result>
>>
>> 11236119012.64043-5.9708868.5592070.0
>> 0.00.0-19.6869931308.804799848.00.0061966440.0
>> 0.0301.274750.382470460.0NULL1120081
>> 11236122012.513598-6.36717137.39279460.0
>> 0.00.0-22.3003921441.054799848.00.00508465060.0
>> 0.0112.207870.304595230.0NULL1120081
>> 5122503682415.1955.1722354.9027147
>> -0.0244086120.023590.553-38.96928-1130.046974660.54
>> 2.5969802E-49.706164E-1123054.2680.00.241967370.0
>> NULL1120081
>> 9121449412.25196412.081688-9.594620.0
>> 0.00.0-25.93576258.6562599848.00.00217082170.0
>> 0.01.29632131.15602660.0NULL1120081
>> 9121458412.3020987.752461-12.1834630.0
>> 0.00.0-24.983763351.195399848.00.00237235990.0
>> 0.01.41373750.992398860.0NULL1120081
>>
>> I stored table in orc format, partitioned and compressed by ZLIB. The
>> problem happened just after I concatenate table.
>>
>> BR,
>> Patcharee
>>
>> On 18/07/15 12:46, Nitin Pawar wrote:
>>
>>  select * without where will work because it does not involve file
>> processing
>>  I suspect the problem is with field delimiter so i asked for records so
>> that we can see whats the data in each column
>>
>>  are you using csv file with columns delimited by some char and it has
>> numeric data in quotes ?
>>
>> On Sat, Jul 18, 2015 at 3:58 PM, patcharee 
>> wrote:
>>
>>>  This select * from table limit 5; works, but not others. So?
>>>
>>> Patcharee
>>>
>>>
>>> On 18. juli 2015 12:08, Nitin Pawar wrote:
>>>
>>> can you do select * from table limit 5;
>>>
>>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee 
>>> wrote:
>>>
 Hi,

 I am using hive 0.14 with Tez engine. Found a weird problem. Any
 suggestions?

 hive> select count(*) from 4D;
 line 1:1 character '' not supported here
 line 1:2 character '' not supported here
 line 1:3 character '' not supported here
 line 1:4 character '' not supported here
 line 1:5 character '' not supported here
 line 1:6 character '' not supported here
 line 1:7 character '' not supported here
 line 1:8 character '' not supported here
 line 1:9 character '' not supported here
 ...
 ...
 line 1:131 character '' not supported here
 line 1:132 character '' not supported here
 line 1:133 character '' not supported here
 line 1:134 character '' not supported here
 line 1:135 character '' not supported here
 line 1:136 character '' not supported here
 line 1:137 character '' not supported here
 line 1:138 character '' not supported here
 line 1:139 character '' not supported here
 line 1:140 character '' not supported here
 line 1:141 character '' not supported here
 line 1:142 character '' not supported here
 line 1:143 character '' not supported here
 line 1:144 character '' not supported here
 line 1:145 character '' not supported here
 line 1:146 character '' not supported here

 BR,
 Patcharee



>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>>
>
>
> --
> Nitin Pawar
>
>
>


-- 
Nitin Pawar

Re: character '' not supported here

[patcharee]

Hi,

I created a hive table stored as orc file (partitioned and compressed by 
ZLIB) from Hive CLI, added data into this table by a Spark application. 
After adding I was able to query data and everything looked fine. Then I 
concatenated the table from Hive CLI. After that I am not able to query 
data, like select count(*) from Table, any more, just got error line 1:1 
character '' not supported here, no matter Tez or MR engine.


How can you solve the problem in your case?

BR,
Patcharee


On 18. juli 2015 21:26, Nitin Pawar wrote:

can you tell exactly what steps you did/?
also did you try running the query with processing to MR instead of tez?
not sure this issue with orc file formats .. i had once faced issues 
on alter table for orc backed tabled on adding a new column


On Sun, Jul 19, 2015 at 12:05 AM, pth001 > wrote:


Hi,

The query result>

11236119012.64043-5.970886 8.5592070.0   
0.00.0-19.686993 1308.804799848.00.006196644   
0.00.0 301.274750.382470460.0NULL11 20081
11236122012.513598-6.3671713 7.3927946   
0.00.00.0-22.300392 1441.054799848.0   
0.00508465060.00.0 112.207870.304595230.0   
NULL11 20081
5122503682415.1955.172235 4.9027147   
-0.0244086120.023590.553 -38.96928-1130.0469   
74660.542.5969802E-4 9.706164E-1123054.2680.0   
0.241967370.0 NULL1120081
9121449412.25196412.081688 -9.594620.0   
0.00.0-25.93576258.65625 99848.00.0021708217   
0.00.01.2963213 1.15602660.0NULL11   
20081
9121458412.3020987.752461 -12.1834630.0   
0.00.0-24.983763 351.195399848.00.0023723599   
0.00.0 1.41373750.992398860.0NULL11 20081


I stored table in orc format, partitioned and compressed by ZLIB.
The problem happened just after I concatenate table.

BR,
Patcharee

On 18/07/15 12:46, Nitin Pawar wrote:

select * without where will work because it does not involve file
processing
I suspect the problem is with field delimiter so i asked for
records so that we can see whats the data in each column

are you using csv file with columns delimited by some char and it
has numeric data in quotes ?

On Sat, Jul 18, 2015 at 3:58 PM, patcharee
mailto:patcharee.thong...@uni.no>> wrote:

This select * from table limit 5; works, but not others. So?

Patcharee


On 18. juli 2015 12:08, Nitin Pawar wrote:

can you do select * from table limit 5;

On Sat, Jul 18, 2015 at 3:35 PM, patcharee
mailto:patcharee.thong...@uni.no>> wrote:

Hi,

I am using hive 0.14 with Tez engine. Found a weird
problem. Any suggestions?

hive> select count(*) from 4D;
line 1:1 character '' not supported here
line 1:2 character '' not supported here
line 1:3 character '' not supported here
line 1:4 character '' not supported here
line 1:5 character '' not supported here
line 1:6 character '' not supported here
line 1:7 character '' not supported here
line 1:8 character '' not supported here
line 1:9 character '' not supported here
...
...
line 1:131 character '' not supported here
line 1:132 character '' not supported here
line 1:133 character '' not supported here
line 1:134 character '' not supported here
line 1:135 character '' not supported here
line 1:136 character '' not supported here
line 1:137 character '' not supported here
line 1:138 character '' not supported here
line 1:139 character '' not supported here
line 1:140 character '' not supported here
line 1:141 character '' not supported here
line 1:142 character '' not supported here
line 1:143 character '' not supported here
line 1:144 character '' not supported here
line 1:145 character '' not supported here
line 1:146 character '' not supported here

BR,
Patcharee





-- 
Nitin Pawar





-- 
Nitin Pawar





--
Nitin Pawar