[jira] [Created] (HIVE-23996) remove unused line

2020-08-05 Thread philipse (Jira)
philipse created HIVE-23996:
---

 Summary: remove unused line
 Key: HIVE-23996
 URL: https://issues.apache.org/jira/browse/HIVE-23996
 Project: Hive
  Issue Type: Improvement
Reporter: philipse
Assignee: philipse


remove unused line to keep code clean



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-23988) remove unused method

2020-08-04 Thread philipse (Jira)
philipse created HIVE-23988:
---

 Summary: remove unused method
 Key: HIVE-23988
 URL: https://issues.apache.org/jira/browse/HIVE-23988
 Project: Hive
  Issue Type: Improvement
Reporter: philipse


`getWindowingTableFunction` in 
[FunctionRegistry|https://github.com/apache/hive/compare/master...GuoPhilipse:remove-unused-method?expand=1#diff-5da198f553d39251b25c4e5c4db2d1cc]
 method seems not used, maybe we can remove it to make code more clearer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-23081) if partition have the same data location,quey will ignore the former one

2020-03-26 Thread philipse (Jira)
philipse created HIVE-23081:
---

 Summary: if partition have the same data location,quey will ignore 
the former one
 Key: HIVE-23081
 URL: https://issues.apache.org/jira/browse/HIVE-23081
 Project: Hive
  Issue Type: Bug
  Components: Query Planning
Affects Versions: 2.1.1
Reporter: philipse
 Attachments: image-2020-03-26-14-45-22-717.png, 
image-2020-03-26-14-45-33-112.png, image-2020-03-26-14-45-44-959.png, 
image-2020-03-26-14-46-01-562.png, image-2020-03-26-14-48-02-096.png

Hi 

I have a weird thing,the bevior shows like this:

1) create table test1(id int) partitioned by (year int);

2) insert overwrite table test1(partition=2020) select 1;

3) check the location of partition 2020,so as '/A/B';

4) alter table test1 add partition(year=2021) location '/A/B'

5)check the data

!image-2020-03-26-14-45-22-717.png!

6)check partitrions

!image-2020-03-26-14-45-33-112.png!

7)check data from different partitions

!image-2020-03-26-14-46-01-562.png!

8)The question is,when we check the count,the result sames wrong :

hive> select year,count(1) as cnt from test1 group by year;

OK
2021 1
Time taken: 9.524 seconds, Fetched: 1 row(s)
hive>

 

Can anyone help review whether we have fixed this issue in furture?

 

Thansk in advance!

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-22686) MapredLocalTask hang for over 9 nine hours

2019-12-31 Thread philipse (Jira)
philipse created HIVE-22686:
---

 Summary: MapredLocalTask hang for over 9 nine hours
 Key: HIVE-22686
 URL: https://issues.apache.org/jira/browse/HIVE-22686
 Project: Hive
  Issue Type: Bug
  Components: Parser
Affects Versions: 1.1.1
 Environment: [^normal_plan.xml]

[^local_task_hangs_plan.xml] [^hadoop-080-084.dump]

 
Reporter: philipse
 Attachments: hadoop-080-084.dump, image-2019-12-31-16-30-14-731.png, 
image-2019-12-31-16-30-55-652.png, image-2019-12-31-16-31-40-304.png, 
image-2019-12-31-16-42-11-589.png, image-2019-12-31-16-42-20-416.png, 
local_task_hangs_plan.xml, normal_plan.xml

Hi ,

Yesterday, i  run a hive on mr task,it hangs for over nine hours,after rerun it 
with the same data on the same hiveserver,the task finished in 10 mins in 
time,i am already crazy on it.

here is the last logs for the first try(which hangs for hours):

  !image-2019-12-31-16-31-40-304.png!

 

here is the second try(which finishs in 10 mins,the local part cost 7 seconds 
also) :

!image-2019-12-31-16-30-55-652.png!

 

the most weird thing is the plan.xml is different,the plans and jstack 
infomation are as attached.the cpu and memory is normal,while the process is so 
slow.

!image-2019-12-31-16-42-20-416.png!

!image-2019-12-31-16-42-11-589.png!

My headache is:

1.Do the plan.xml can be different for the same hql and the same hiveserver

2.The first try runs quite slow,every records operation(put into hashmap) cost 
almost 1000ms.while the second try runs quite fast(same data and same 
hiveserver). 

Do Anyone has already met similar issues, any points will be appreciated.

Thanks.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-21721) nvl function fail with NullPointerException if the two paramtype are different

2019-05-10 Thread philipse (JIRA)
philipse created HIVE-21721:
---

 Summary: nvl function fail with NullPointerException if the two 
paramtype are different
 Key: HIVE-21721
 URL: https://issues.apache.org/jira/browse/HIVE-21721
 Project: Hive
  Issue Type: Bug
  Components: Parser
Affects Versions: 1.1.0
Reporter: philipse
Assignee: philipse
 Attachments: image-2019-05-11-10-41-05-168.png

Hi all

when i user nvl and case when fucntion, it behaviors like the following.which 
is weird to me, and makes me headache everytime. i need to check where the 
nullpointexception throws out when it hadppens,So can the reasons more friendly 
to users,

!image-2019-05-11-10-41-05-168.png!
{code:java}
select nvl(cast('2019-05-10 11:11:11,111' as timestamp),'2019-05-10 
11:11:11,111');
Error: Error while compiling statement: FAILED: NullPointerException null 
(state=42000,code=4)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HIVE-21606) when creating table with hdfs location,should not check permission of all the children dirs

2019-04-12 Thread philipse (JIRA)
philipse created HIVE-21606:
---

 Summary: when creating table with hdfs location,should not check 
permission of all the children dirs
 Key: HIVE-21606
 URL: https://issues.apache.org/jira/browse/HIVE-21606
 Project: Hive
  Issue Type: Bug
  Components: Authorization
Affects Versions: 2.3.4
Reporter: philipse
Assignee: philipse
 Attachments: image-2019-04-12-15-31-30-883.png, 
image-2019-04-12-15-34-55-942.png

when we create a table with a specific location
{code:java}
create table testdb.test6(id int) location '/data/dpdcadmin/test2/test2/test4';
{code}
we met the following errors:
{code:java}
Error: Error while compiling statement: FAILED: HiveAccessControlException 
Permission denied: Principal [name=bidcadmin, type=USER] does not have 
following privileges for operation CREATETABLE [[INSERT, DELETE] on Object 
[type=DFS_URI, name=hdfs://hadoopcluster/data/dpdcadmin/test2/test2/test5]] 
(state=42000,code=4)
{code}
 

the hdfs permission is as the following

!image-2019-04-12-15-34-55-942.png!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)