[jira] [Created] (HIVE-21483) HoS would fail when scratch dir is using remote HDFS
Dapeng Sun created HIVE-21483:
-
Summary: HoS would fail when scratch dir is using remote HDFS
Key: HIVE-21483
URL: https://issues.apache.org/jira/browse/HIVE-21483
Project: Hive
Issue Type: Bug
Reporter: Dapeng Sun
Assignee: Dapeng Sun
HoS would fail when scratch dir is using remote HDFS:
public static URI uploadToHDFS(URI source, HiveConf conf) throws IOException {
Path localFile = new Path(source.getPath());
Path remoteFile = new
Path(SessionState.get().getSparkSession().getHDFSSessionDir(),
getFileName(source));
-FileSystem fileSystem = FileSystem.get(conf);
+FileSystem fileSystem = remoteFile.getFileSystem(conf);
// Overwrite if the remote file already exists. Whether the file can be
added
// on executor is up to spark, i.e. spark.files.overwrite
fileSystem.copyFromLocalFile(false, true, localFile, remoteFile);
Path fullPath = fileSystem.getFileStatus(remoteFile).getPath();
r
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20063) Global limit concurrent connections of HiveServer2
Dapeng Sun created HIVE-20063: - Summary: Global limit concurrent connections of HiveServer2 Key: HIVE-20063 URL: https://issues.apache.org/jira/browse/HIVE-20063 Project: Hive Issue Type: Improvement Components: HiveServer2 Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-17823) Fix subquery Qtest of Hive on Spark
Dapeng Sun created HIVE-17823: - Summary: Fix subquery Qtest of Hive on Spark Key: HIVE-17823 URL: https://issues.apache.org/jira/browse/HIVE-17823 Project: Hive Issue Type: Bug Reporter: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-17756) Introduce subquery test case for Hive on Spark
Dapeng Sun created HIVE-17756: - Summary: Introduce subquery test case for Hive on Spark Key: HIVE-17756 URL: https://issues.apache.org/jira/browse/HIVE-17756 Project: Hive Issue Type: Sub-task Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-17000) Upgrade Hive to PARQUET 1.9.0
Dapeng Sun created HIVE-17000: - Summary: Upgrade Hive to PARQUET 1.9.0 Key: HIVE-17000 URL: https://issues.apache.org/jira/browse/HIVE-17000 Project: Hive Issue Type: Improvement Components: Serializers/Deserializers Affects Versions: 3.0.0 Reporter: Dapeng Sun Assignee: Dapeng Sun Parquet 1.9.0 is released and added many new features, such as PARQUET-601 Add support in Parquet to configure the encoding used by ValueWriters We should upgrade Parquet dependence to 1.9.0 and bring these optimizations to Hive. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HIVE-13545) Add GLOBAL Type to Entity
Dapeng Sun created HIVE-13545:
-
Summary: Add GLOBAL Type to Entity
Key: HIVE-13545
URL: https://issues.apache.org/jira/browse/HIVE-13545
Project: Hive
Issue Type: Bug
Affects Versions: 1.3.0, 2.1.0
Reporter: Dapeng Sun
Assignee: Dapeng Sun
{{ql/src/java/org/apache/hadoop/hive/ql/hooks/Entity.java}} don't have the
{{GLOBAL}} type, it should be matched with
{{org.apache.hadoop.hive.ql.security.authorization.plugin.HivePrivilegeObject.HivePrivilegeObjectType}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HIVE-12917) Document for Hive authorization V2
Dapeng Sun created HIVE-12917: - Summary: Document for Hive authorization V2 Key: HIVE-12917 URL: https://issues.apache.org/jira/browse/HIVE-12917 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-12495) Lock/unlock table should add database and table information to inputs and outputs of authz hook
Dapeng Sun created HIVE-12495: - Summary: Lock/unlock table should add database and table information to inputs and outputs of authz hook Key: HIVE-12495 URL: https://issues.apache.org/jira/browse/HIVE-12495 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-12367) Lock/unlock database should add current database to inputs and outputs of authz hook
Dapeng Sun created HIVE-12367: - Summary: Lock/unlock database should add current database to inputs and outputs of authz hook Key: HIVE-12367 URL: https://issues.apache.org/jira/browse/HIVE-12367 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-11780) Hive support "set role none"
Dapeng Sun created HIVE-11780: - Summary: Hive support "set role none" Key: HIVE-11780 URL: https://issues.apache.org/jira/browse/HIVE-11780 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-11498) HIVE Authorization v2 should not check permission for dummy entity
Dapeng Sun created HIVE-11498: - Summary: HIVE Authorization v2 should not check permission for dummy entity Key: HIVE-11498 URL: https://issues.apache.org/jira/browse/HIVE-11498 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Assignee: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-11190) ConfVars.METASTORE_FILTER_HOOK in authorization V2 should not be hard code when the value is not default
Dapeng Sun created HIVE-11190: - Summary: ConfVars.METASTORE_FILTER_HOOK in authorization V2 should not be hard code when the value is not default Key: HIVE-11190 URL: https://issues.apache.org/jira/browse/HIVE-11190 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Assignee: Dapeng Sun ConfVars.METASTORE_FILTER_HOOK in authorization V2 should not be hard code when the value is not default. it will cause user failed to customize the METASTORE_FILTER_HOOK -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-11179) HIVE should allow custom converting from HivePrivilegeObjectDesc to privilegeObject for different authorizers
Dapeng Sun created HIVE-11179:
-
Summary: HIVE should allow custom converting from
HivePrivilegeObjectDesc to privilegeObject for different authorizers
Key: HIVE-11179
URL: https://issues.apache.org/jira/browse/HIVE-11179
Project: Hive
Issue Type: Improvement
Reporter: Dapeng Sun
Assignee: Dapeng Sun
HIVE should allow custom converting from HivePrivilegeObjectDesc to
privilegeObject for different authorizers:
There is a case in Apache Sentry: Sentry support uri and server level
privilege, but in hive side, it uses
{{AuthorizationUtils.getHivePrivilegeObject(privSubjectDesc)}} to do the
converting, and the code in {{getHivePrivilegeObject()}} only handle the scenes
for table and database
{noformat}
privSubjectDesc.getTable() ? HivePrivilegeObjectType.TABLE_OR_VIEW :
HivePrivilegeObjectType.DATABASE;
{noformat}
A solution is move this method to {{HiveAuthorizer}}, so that a custom
Authorizer could enhance it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9661) Refine debug log with schema information for the method of creating session directories
[ https://issues.apache.org/jira/browse/HIVE-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317493#comment-14317493 ] Dapeng Sun commented on HIVE-9661: -- +1 Refine debug log with schema information for the method of creating session directories --- Key: HIVE-9661 URL: https://issues.apache.org/jira/browse/HIVE-9661 Project: Hive Issue Type: Bug Reporter: Ferdinand Xu Assignee: Ferdinand Xu Priority: Minor Attachments: HIVE-9661.patch For a session, the scratch directory can be either a local path or a hdfs scratch path. The method name createRootHDFSDir is quite confusing. So add the schema information to the debug log for the troubleshooting need. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9661) Refine debug log with schema information for the method of creating session directories
[ https://issues.apache.org/jira/browse/HIVE-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317487#comment-14317487 ] Dapeng Sun commented on HIVE-9661: -- Thank [~Ferd] for the improvement, we know if the path of hive.exec.scratchdir was not writable, we will use this message to find the root cause, printing the schema info is very important for debug. Refine debug log with schema information for the method of creating session directories --- Key: HIVE-9661 URL: https://issues.apache.org/jira/browse/HIVE-9661 Project: Hive Issue Type: Bug Reporter: Ferdinand Xu Assignee: Ferdinand Xu Priority: Minor Attachments: HIVE-9661.patch For a session, the scratch directory can be either a local path or a hdfs scratch path. The method name createRootHDFSDir is quite confusing. So add the schema information to the debug log for the troubleshooting need. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) The data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Resolution: Duplicate
Status: Resolved (was: Patch Available)
The data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Affects Versions: 0.15.0
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, if writing
{{String}} to the field in output, it will case to {{bigint}} by force, the
output will print a null at the grantTime field, This blocks a conponent
like SENTRY, who want to custom the output of {{show grant}}, a simple patch
to fix it. About the default format of grant_time's output in HIVE will
discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.009.patch Updated the patch base on HIVE-9064 SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch, HIVE-9018.009.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Description: Currently the data type of grant_time is defined as
bigint, if writing {{String}} to the field in output, it will case to
{{bigint}} by force, the output will print a null at the grantTime field,
This blocks a conponment like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it. About the default format of grant_time's
output in HIVE will discuss in HIVE-9018 (was: Currently the data type of
{{grant_time}} is defined as {{bigint}}, it will block a conponment like
SENTRY, who want to custom the output of {{show grant}}, a simple patch to fix
it.
About the default format of grant_time's output in HIVE will discuss in
HIVE-9018)
the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, if writing
{{String}} to the field in output, it will case to {{bigint}} by force, the
output will print a null at the grantTime field, This blocks a conponment
like SENTRY, who want to custom the output of {{show grant}}, a simple patch
to fix it. About the default format of grant_time's output in HIVE will
discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Description: Currently the data type of grant_time is defined as
bigint, if writing {{String}} to the field in output, it will case to
{{bigint}} by force, the output will print a null at the grantTime field,
This blocks a conponent like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it. About the default format of grant_time's
output in HIVE will discuss in HIVE-9018 (was: Currently the data type of
grant_time is defined as bigint, if writing {{String}} to the field in
output, it will case to {{bigint}} by force, the output will print a null at
the grantTime field, This blocks a conponment like SENTRY, who want to custom
the output of {{show grant}}, a simple patch to fix it. About the default
format of grant_time's output in HIVE will discuss in HIVE-9018)
the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, if writing
{{String}} to the field in output, it will case to {{bigint}} by force, the
output will print a null at the grantTime field, This blocks a conponent
like SENTRY, who want to custom the output of {{show grant}}, a simple patch
to fix it. About the default format of grant_time's output in HIVE will
discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Affects Version/s: 0.15.0
the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Affects Versions: 0.15.0
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, if writing
{{String}} to the field in output, it will case to {{bigint}} by force, the
output will print a null at the grantTime field, This blocks a conponent
like SENTRY, who want to custom the output of {{show grant}}, a simple patch
to fix it. About the default format of grant_time's output in HIVE will
discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9064) The data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Summary: The data type of grant_time in ShowGrantDesc and RoleDDLDesc
should be string (was: the data type of grant_time in ShowGrantDesc and
RoleDDLDesc should be string)
The data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Affects Versions: 0.15.0
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, if writing
{{String}} to the field in output, it will case to {{bigint}} by force, the
output will print a null at the grantTime field, This blocks a conponent
like SENTRY, who want to custom the output of {{show grant}}, a simple patch
to fix it. About the default format of grant_time's output in HIVE will
discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[
https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239332#comment-14239332
]
Dapeng Sun commented on HIVE-9018:
--
Good suggestion! Do you think it is possible to add a configuration
{{dataformat}}, pass the argument {{dataformat}} to
{{writeHiveRoleGrantInfo()}} and print the data format like this:
{code:java|borderStyle=solid}
SimpleDateFormat simpleDateFormat = new SimpleDateFormat(dd/MM/ HH:mm:ss);
Date grantTime = testMode ? new Date(-1) :new Date(roleGrant.getGrantTime() *
1000L);
appendNonNull(builder, simpleDateFormat.format(grantTime));
{code}
SHOW GRANT ROLE in Hive should return grant_time in human readable format
---
Key: HIVE-9018
URL: https://issues.apache.org/jira/browse/HIVE-9018
Project: Hive
Issue Type: Improvement
Reporter: Dapeng Sun
Priority: Minor
Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch,
HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch,
HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch
Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds
since epoch. It would be nice if this were in human readable format.
Current output: 1411801585902000
Desired output: Sat, Sep 27 2014 00:06:25.902
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239335#comment-14239335 ] Dapeng Sun commented on HIVE-9018: -- Thank you for your response. @[~navis] SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-9064) the data type of granttime in ShowGrantDesc and RoleDDLDesc should be string
Dapeng Sun created HIVE-9064: Summary: the data type of granttime in ShowGrantDesc and RoleDDLDesc should be string Key: HIVE-9064 URL: https://issues.apache.org/jira/browse/HIVE-9064 Project: Hive Issue Type: Bug Reporter: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[ https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9064: - Summary: the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string (was: the data type of granttime in ShowGrantDesc and RoleDDLDesc should be string) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string --- Key: HIVE-9064 URL: https://issues.apache.org/jira/browse/HIVE-9064 Project: Hive Issue Type: Bug Reporter: Dapeng Sun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[ https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9064: - Attachment: HIVE-9064.patch the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string --- Key: HIVE-9064 URL: https://issues.apache.org/jira/browse/HIVE-9064 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Attachments: HIVE-9064.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[ https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9064: - Status: Patch Available (was: Open) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string --- Key: HIVE-9064 URL: https://issues.apache.org/jira/browse/HIVE-9064 Project: Hive Issue Type: Bug Reporter: Dapeng Sun Attachments: HIVE-9064.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Description: Currently the data type of grant_time is defined as
bigint, it will block a conponment like SENTRY, who want to custom the output
of {{show grant}}, a simple patch to fix it. About the default format of
grant_time's output in HIVE will discuss in HIVE-9018
the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of grant_time is defined as bigint, it will
block a conponment like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it. About the default format of grant_time's
output in HIVE will discuss in HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9064) the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be string
[
https://issues.apache.org/jira/browse/HIVE-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dapeng Sun updated HIVE-9064:
-
Description:
Currently the data type of {{grant_time}} is defined as {{bigint}}, it will
block a conponment like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it.
About the default format of grant_time's output in HIVE will discuss in
HIVE-9018
was:Currently the data type of grant_time is defined as bigint, it will
block a conponment like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it. About the default format of grant_time's
output in HIVE will discuss in HIVE-9018
the data type of grant_time in ShowGrantDesc and RoleDDLDesc should be
string
---
Key: HIVE-9064
URL: https://issues.apache.org/jira/browse/HIVE-9064
Project: Hive
Issue Type: Bug
Reporter: Dapeng Sun
Attachments: HIVE-9064.patch
Currently the data type of {{grant_time}} is defined as {{bigint}}, it will
block a conponment like SENTRY, who want to custom the output of {{show
grant}}, a simple patch to fix it.
About the default format of grant_time's output in HIVE will discuss in
HIVE-9018
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.009.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.009.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.008.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: (was: HIVE-9018.009.patch) SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239079#comment-14239079 ] Dapeng Sun commented on HIVE-9018: -- Hi @[~Ferd] would you help looking into it. SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-6204) The result of show grant / show role should be tabular format
[
https://issues.apache.org/jira/browse/HIVE-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239081#comment-14239081
]
Dapeng Sun commented on HIVE-6204:
--
Hello @[~navis], I created a jira HIVE-9018 may related with this. would you
help to review when time allows.
The result of show grant / show role should be tabular format
-
Key: HIVE-6204
URL: https://issues.apache.org/jira/browse/HIVE-6204
Project: Hive
Issue Type: Improvement
Components: Authorization
Reporter: Navis
Assignee: Navis
Priority: Minor
Fix For: 0.13.0
Attachments: HIVE-6204.1.patch.txt, HIVE-6204.2.patch.txt,
HIVE-6204.3.patch.txt
{noformat}
hive show grant role role1 on all;
OK
database default
table src
principalName role1
principalType ROLE
privilege Create
grantTime Wed Dec 18 14:17:56 KST 2013
grantor navis
database default
table srcpart
principalName role1
principalType ROLE
privilege Update
grantTime Wed Dec 18 14:18:28 KST 2013
grantor navis
{noformat}
This should be something like below, especially for JDBC clients.
{noformat}
hive show grant role role1 on all;
OK
default src role1 ROLECreate false
1387343876000 navis
default srcpart role1 ROLEUpdate false
1387343908000 navis
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.007.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.007.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.005.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.006.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.007.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.008.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch, HIVE-9018.005.patch, HIVE-9018.006.patch, HIVE-9018.007.patch, HIVE-9018.008.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.003.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: (was: HIVE-9018.002.patch) SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: (was: HIVE-9018.patch) SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.004.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[
https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234996#comment-14234996
]
Dapeng Sun commented on HIVE-9018:
--
Changed UnitTests for the new data format of {{grantTime}}
SHOW GRANT ROLE in Hive should return grant_time in human readable format
---
Key: HIVE-9018
URL: https://issues.apache.org/jira/browse/HIVE-9018
Project: Hive
Issue Type: Improvement
Reporter: Dapeng Sun
Priority: Minor
Attachments: HIVE-9018.003.patch, HIVE-9018.004.patch
Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds
since epoch. It would be nice if this were in human readable format.
Current output: 1411801585902000
Desired output: Sat, Sep 27 2014 00:06:25.902
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
Dapeng Sun created HIVE-9018: Summary: SHOW GRANT ROLE in Hive should return grant_time in human readable format Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Status: Patch Available (was: Open) SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.002.patch SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.002.patch, HIVE-9018.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return grant_time in human readable format
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Description: Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 SHOW GRANT ROLE in Hive should return grant_time in human readable format --- Key: HIVE-9018 URL: https://issues.apache.org/jira/browse/HIVE-9018 Project: Hive Issue Type: Improvement Reporter: Dapeng Sun Priority: Minor Attachments: HIVE-9018.002.patch, HIVE-9018.patch Currently, SHOW GRANT ROLE will return the 'grant_time' in microseconds since epoch. It would be nice if this were in human readable format. Current output: 1411801585902000 Desired output: Sat, Sep 27 2014 00:06:25.902 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-5317) Implement insert, update, and delete in Hive with full ACID support
[
https://issues.apache.org/jira/browse/HIVE-5317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152764#comment-14152764
]
Dapeng Sun commented on HIVE-5317:
--
Hi Owen Alan
The feature is great!
I have a question, if the cluster enable security(Kerberos), does
{{ZooKeeperHiveLockManager}} support a security Zookeeper?
Implement insert, update, and delete in Hive with full ACID support
---
Key: HIVE-5317
URL: https://issues.apache.org/jira/browse/HIVE-5317
Project: Hive
Issue Type: New Feature
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Fix For: 0.14.0
Attachments: InsertUpdatesinHive.pdf
Many customers want to be able to insert, update and delete rows from Hive
tables with full ACID support. The use cases are varied, but the form of the
queries that should be supported are:
* INSERT INTO tbl SELECT …
* INSERT INTO tbl VALUES ...
* UPDATE tbl SET … WHERE …
* DELETE FROM tbl WHERE …
* MERGE INTO tbl USING src ON … WHEN MATCHED THEN ... WHEN NOT MATCHED THEN
...
* SET TRANSACTION LEVEL …
* BEGIN/END TRANSACTION
Use Cases
* Once an hour, a set of inserts and updates (up to 500k rows) for various
dimension tables (eg. customer, inventory, stores) needs to be processed. The
dimension tables have primary keys and are typically bucketed and sorted on
those keys.
* Once a day a small set (up to 100k rows) of records need to be deleted for
regulatory compliance.
* Once an hour a log of transactions is exported from a RDBS and the fact
tables need to be updated (up to 1m rows) to reflect the new data. The
transactions are a combination of inserts, updates, and deletes. The table is
partitioned and bucketed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
