[jira] [Created] (HIVE-24076) MetastoreDirectSql.getDatabase() needs a space in the query

2020-08-26 Thread Naveen Gangam (Jira)
Naveen Gangam created HIVE-24076:


 Summary: MetastoreDirectSql.getDatabase() needs a space in the 
query
 Key: HIVE-24076
 URL: https://issues.apache.org/jira/browse/HIVE-24076
 Project: Hive
  Issue Type: Sub-task
  Components: Hive
Affects Versions: 4.0.0
Reporter: Naveen Gangam
Assignee: Naveen Gangam


String queryTextDbSelector= "select "
  + "\"DB_ID\", \"NAME\", \"DB_LOCATION_URI\", \"DESC\", "
  + "\"OWNER_NAME\", \"OWNER_TYPE\", \"CTLG_NAME\" , \"CREATE_TIME\", 
\"DB_MANAGED_LOCATION_URI\""
  + "FROM "+ DBS

There needs to be a space before FROM so the query is right. Currently it falls 
back to JDO, so not lapse in functionality.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Your project's website

2020-08-26 Thread Owen O'Malley
Is there any more feedback or concerns on the proposed site?

If not, I'll go ahead and check it in and file the jira for Apache Infra to
move the hosting for our site.

.. Owen

On Tue, Aug 18, 2020 at 2:05 PM Owen O'Malley 
wrote:

> All,
>I realized that I could mark my fork of the Hive repository as having
> github pages to effectively publish them. It took some changes, but now it
> is live on http://omalley.github.io/hive .
>
> On Tue, Aug 18, 2020 at 6:14 AM Andrew Wetmore  wrote:
>
>> Good progress! We will need an official PMC statement that Infra can
>> close down the project presence on the CMS.
>>
>> Thanks!
>>
>> Andrew
>>
>> On Tue, Aug 18, 2020 at 4:09 AM Owen O'Malley 
>> wrote:
>>
>>> All,
>>>
>>>  I ported the current site to github pages and pushed it to
>>> https://github.com/apache/hive/pull/1410 .
>>>
>>> Take a look. It will certainly be much easier to maintain.
>>>
>>> .. Owen
>>>
>>> On Mon, Aug 17, 2020 at 6:26 AM Andrew Wetmore 
>>> wrote:
>>>
 Hi:

 I wrote to you two weeks ago about your project website, but have not
 seen
 a response. Whom should I contact directly? I am trying to see whether
 your
 project still uses the Apache CMS and, if so, what your plans are to
 migrate off it.

 Thanks in advance for your help.

 Andrew

 On Wed, Aug 5, 2020 at 9:17 AM Andrew Wetmore 
 wrote:

 > Hi:
 >
 > I am part of the Infrastructure team, and am writing to ask whether
 your
 > project is still using the Apache CMS for your project website. As you
 > know, the CMS is reaching end-of-life, and we need projects to move
 their
 > websites onto a different option within the next few weeks.
 >
 > There are several alternatives available, including those listed on
 this
 > page [1] on managing project websites. Infra is assembling a Wiki
 page [2]
 > on migrating a website from the CMS, and is looking forward to helping
 > projects with this transition.
 >
 > Please let me know whether your site is still on the Apache CMS and,
 if
 > so, who will be the project point-of-contact with Infra for the
 migration.
 >
 > Thank you!
 >
 >
 >
 >
 > [1] https://infra.apache.org/project-site.html
 >
 > [2]
 >
 https://cwiki.apache.org/confluence/display/INFRA/Migrate+your+project+website+from+the+Apache+CMS
 >
 >
 >
 > --
 > Andrew Wetmore
 > Technical Writer-Editor
 > Infra
 > *Apache Software Foundation*
 > andr...@apache.org
 >
 >
 > <
 https://www.avast.com/sig-email?utm_medium=email_source=link_campaign=sig-email_content=webmail>
 Virus-free.
 > www.avast.com
 > <
 https://www.avast.com/sig-email?utm_medium=email_source=link_campaign=sig-email_content=webmail
 >
 > <#m_2078696594329065464_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
 >


 --
 Andrew Wetmore
 Technical Writer-Editor
 Infra
 *Apache Software Foundation*
 andr...@apache.org

>>>
>>
>> --
>> Andrew Wetmore
>> Technical Writer-Editor
>> Infra
>> *Apache Software Foundation*
>> andr...@apache.org
>>
>


Re: Your project's website

2020-08-26 Thread John S
Hi Owen,

I took a look and clicked around your github.io  link.
It seems to work well and I did not notice anything broken in my random walk.

I also took a look at: https://github.com/apache/hive/pull/1410 

I do not see anything that I would consider a blocker to moving forward.

As a contributor and community member this change has my +1 at least.

- jfs

> On Aug 26, 2020, at 8:52 AM, Owen O'Malley  wrote:
> 
> Is there any more feedback or concerns on the proposed site?
> 
> If not, I'll go ahead and check it in and file the jira for Apache Infra to
> move the hosting for our site.
> 
> .. Owen
> 
> On Tue, Aug 18, 2020 at 2:05 PM Owen O'Malley 
> wrote:



[jira] [Created] (HIVE-24077) Streaming Ingest v2 does not send heartbeats

2020-08-26 Thread Matt Burgess (Jira)
Matt Burgess created HIVE-24077:
---

 Summary: Streaming Ingest v2 does not send heartbeats
 Key: HIVE-24077
 URL: https://issues.apache.org/jira/browse/HIVE-24077
 Project: Hive
  Issue Type: Bug
  Components: Streaming
Reporter: Matt Burgess


In Hive Streaming v2, TransactionBatch calls setupHeartbeatThread() before 
setting minTxnId to an AtomicLong object, so the value that is used for 
HeartbeatRunnable is null. Upon the first call to run(), a NullPointerException 
is thrown by the minTxnId.get() call, which causes the thread to fail and it 
does not get rescheduled. This causes any transaction that exceeds the 
transaction timeout time (default 5 mins) to be aborted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24078) result rows not equal in mr and tez

2020-08-26 Thread kuqiqi (Jira)
kuqiqi created HIVE-24078:
-

 Summary: result rows not equal in mr and tez
 Key: HIVE-24078
 URL: https://issues.apache.org/jira/browse/HIVE-24078
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2, Tez
Affects Versions: 3.1.2
Reporter: kuqiqi


select
rank_num,
province_name,
programset_id,
programset_name,
programset_type,
cv,
uv,
pt,
rank_num2,
rank_num3,
city_name,
level,
cp_code,
cp_name,
version_type,
zz.city_code,
zz.province_alias,
'20200815' dt
from 
(SELECT row_number() over(partition BY 
a1.province_alias,a1.city_code,a1.version_type
 ORDER BY cast(a1.cv AS bigint) DESC) AS rank_num,
 province_name(a1.province_alias) AS province_name,
 a1.program_set_id AS programset_id,
 a2.programset_name,
 a2.type_name AS programset_type,
 a1.cv,
 a1.uv,
 cast(a1.pt/360 as decimal(20,2)) pt,
 row_number() over (partition by a1.province_alias,a1.city_code,a1.version_type 
order by cast(a1.uv as bigint) desc ) as rank_num2,
 row_number() over (partition by a1.province_alias,a1.city_code,a1.version_type 
order by cast(a1.pt as bigint) desc ) as rank_num3,
 a1.city_code,
 a1.city_name,
 '3' as level,
 a2.cp_code,
 a2.cp_name,
 '20200815'as dt,
 a1.province_alias,
 a1.version_type
FROM temp.dmp_device_vod_valid_day_v1_20200815_hn a1
LEFT JOIN temp.dmp_device_vod_valid_day_v2_20200815_hn a2 ON 
a1.program_set_id=a2.programset_id
WHERE a2.programset_name IS NOT NULL ) zz
where rank_num<1000 or rank_num2<1000 or rank_num3<1000
;

 

This sql gets 76742 rows in mr, but 76681 rows in tez.How to fix it?

I think the problem maybe lies in row_number.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24079) Illegal reflective access in StringInternUtils on JDK 9+

2020-08-26 Thread David Phillips (Jira)
David Phillips created HIVE-24079:
-

 Summary: Illegal reflective access in StringInternUtils on JDK 9+
 Key: HIVE-24079
 URL: https://issues.apache.org/jira/browse/HIVE-24079
 Project: Hive
  Issue Type: Bug
Reporter: David Phillips


{{StringInternUtils}} causes an illegal reflective access warning on JDK 9+.
{code:java}
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by 
org.apache.hadoop.hive.common.StringInternUtils 
(file:/Users/dphillips/.m2/repository/org/apache/hive/hive-common/3.1.2/hive-common-3.1.2.jar)
 to field java.net.URI.string
WARNING: Please consider reporting this to the maintainers of 
org.apache.hadoop.hive.common.StringInternUtils
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)