[jira] [Commented] (HIVE-9991) Cannot do a SELECT on external tables that are on S3 due to Encryption error
[ https://issues.apache.org/jira/browse/HIVE-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365779#comment-14365779 ] Hive QA commented on HIVE-9991: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12705104/HIVE-9991.1.patch {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 7770 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_encryption_unencrypted_nonhdfs_external_tables org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3058/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3058/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3058/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12705104 - PreCommit-HIVE-TRUNK-Build Cannot do a SELECT on external tables that are on S3 due to Encryption error Key: HIVE-9991 URL: https://issues.apache.org/jira/browse/HIVE-9991 Project: Hive Issue Type: Bug Affects Versions: 1.0.0 Reporter: Sergio Peña Assignee: Sergio Peña Attachments: HIVE-9991.1.patch, HIVE-9991.2.patch I cannot do any select query on external tables that are not part of HDFS. For example S3. {code} Select * from my_table limit 10; FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020 {code} This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error. To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9991) Cannot do a SELECT on external tables that are on S3 due to Encryption error
[ https://issues.apache.org/jira/browse/HIVE-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365606#comment-14365606 ] Xuefu Zhang commented on HIVE-9991: --- +1 pending on test Cannot do a SELECT on external tables that are on S3 due to Encryption error Key: HIVE-9991 URL: https://issues.apache.org/jira/browse/HIVE-9991 Project: Hive Issue Type: Bug Affects Versions: 1.0.0 Reporter: Sergio Peña Assignee: Sergio Peña Attachments: HIVE-9991.1.patch I cannot do any select query on external tables that are not part of HDFS. For example S3. {code} Select * from my_table limit 10; FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020 {code} This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error. To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9991) Cannot do a SELECT on external tables that are on S3 due to Encryption error
[ https://issues.apache.org/jira/browse/HIVE-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366556#comment-14366556 ] Hive QA commented on HIVE-9991: --- {color:green}Overall{color}: +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12705207/HIVE-9991.4.patch {color:green}SUCCESS:{color} +1 7771 tests passed Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3065/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3065/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3065/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12705207 - PreCommit-HIVE-TRUNK-Build Cannot do a SELECT on external tables that are on S3 due to Encryption error Key: HIVE-9991 URL: https://issues.apache.org/jira/browse/HIVE-9991 Project: Hive Issue Type: Bug Affects Versions: 1.0.0 Reporter: Sergio Peña Assignee: Sergio Peña Attachments: HIVE-9991.1.patch, HIVE-9991.2.patch, HIVE-9991.3.patch, HIVE-9991.4.patch I cannot do any select query on external tables that are not part of HDFS. For example S3. {code} Select * from my_table limit 10; FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020 {code} This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error. To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9991) Cannot do a SELECT on external tables that are on S3 due to Encryption error
[ https://issues.apache.org/jira/browse/HIVE-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366213#comment-14366213 ] Xuefu Zhang commented on HIVE-9991: --- [~spena], it seems the above failed test has a result diff. You might need to regenerate the test output. Cannot do a SELECT on external tables that are on S3 due to Encryption error Key: HIVE-9991 URL: https://issues.apache.org/jira/browse/HIVE-9991 Project: Hive Issue Type: Bug Affects Versions: 1.0.0 Reporter: Sergio Peña Assignee: Sergio Peña Attachments: HIVE-9991.1.patch, HIVE-9991.2.patch, HIVE-9991.3.patch I cannot do any select query on external tables that are not part of HDFS. For example S3. {code} Select * from my_table limit 10; FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020 {code} This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error. To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema. -- This message was sent by Atlassian JIRA (v6.3.4#6332)