[jira] [Updated] (HAWQ-1078) Implement hawqsync-falcon DR utility.
[ https://issues.apache.org/jira/browse/HAWQ-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Goden Yao updated HAWQ-1078: Issue Type: New Feature (was: Improvement) > Implement hawqsync-falcon DR utility. > - > > Key: HAWQ-1078 > URL: https://issues.apache.org/jira/browse/HAWQ-1078 > Project: Apache HAWQ > Issue Type: New Feature > Components: Command Line Tools >Reporter: Kyle R Dunn >Assignee: Lei Chang > Fix For: backlog > > Attachments: hawq-dr-design.pdf > > > HAWQ currently offers no DR functionality. This JIRA is for tracking the > design and development of a hawqsync-falcon utility, which uses a combination > of Falcon-based HDFS replication and custom automation in Python for allowing > both the HAWQ master catalog and corresponding HDFS data to be replicated to > a remote cluster for DR functionality. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-1083) Do not use CURLOPT_RESOLVE when call curl
[ https://issues.apache.org/jira/browse/HAWQ-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Goden Yao updated HAWQ-1083: Assignee: Oleksandr Diachenko (was: Lei Chang) > Do not use CURLOPT_RESOLVE when call curl > - > > Key: HAWQ-1083 > URL: https://issues.apache.org/jira/browse/HAWQ-1083 > Project: Apache HAWQ > Issue Type: Bug > Components: PXF >Reporter: Oleksandr Diachenko >Assignee: Oleksandr Diachenko > Fix For: 2.0.1.0-incubating > > > CURLOPT_RESOLVE option is available since 7.21.3 curl release, so if user has > lower version of curl it won't work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HAWQ-1079) PXF service fails to start
[
https://issues.apache.org/jira/browse/HAWQ-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleksandr Diachenko resolved HAWQ-1079.
---
Resolution: Fixed
Fix Version/s: (was: backlog)
2.0.1.0-incubating
> PXF service fails to start
> --
>
> Key: HAWQ-1079
> URL: https://issues.apache.org/jira/browse/HAWQ-1079
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Oleksandr Diachenko
>Assignee: Oleksandr Diachenko
> Fix For: 2.0.1.0-incubating
>
>
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/PXF/3.0.0/package/scripts/pxf.py",
> line 132, in
> Pxf().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 280, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/PXF/3.0.0/package/scripts/pxf.py",
> line 54, in start
> self.__execute_service_command("restart")
> File
> "/var/lib/ambari-agent/cache/common-services/PXF/3.0.0/package/scripts/pxf.py",
> line 76, in __execute_service_command
> logoutput=True)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 273, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 71, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of 'service pxf-service
> restart' returned 1. /var/pxf /
> $CATALINA_PID was set but the specified file does not exist. Is Tomcat
> running? Stop aborted.
> /var/pxf /var/pxf /
> touch: cannot touch `/var/log/pxf/catalina.out': No such file or directory
> /var/pxf/pxf-service/bin/catalina.sh: line 387: /var/log/pxf/catalina.out: No
> such file or directory
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (HAWQ-1080) make unittest-check fails on local dev environment
[
https://issues.apache.org/jira/browse/HAWQ-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleksandr Diachenko resolved HAWQ-1080.
---
Resolution: Fixed
> make unittest-check fails on local dev environment
> --
>
> Key: HAWQ-1080
> URL: https://issues.apache.org/jira/browse/HAWQ-1080
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Oleksandr Diachenko
>Assignee: Oleksandr Diachenko
> Fix For: 2.0.1.0-incubating
>
>
> {code}
> $ make unittest-check
> {code}
> ...
> {code}
> emanager -c -o pxfheaders_test.o pxfheaders_test.c
> pxfheaders_test.c:124:1: error: conflicting types for 'expect_churl_headers'
> expect_churl_headers(const char *key, const char *value)
> ^
> pxfheaders_test.c:40:2: note: previous implicit declaration is here
> expect_churl_headers("X-GP-SEGMENT-ID", mock_extvar->GP_SEGMENT_ID);
> ^
> pxfheaders_test.c:139:1: error: conflicting types for
> 'expect_churl_headers_alignment'
> expect_churl_headers_alignment()
> ^
> pxfheaders_test.c:43:2: note: previous implicit declaration is here
> expect_churl_headers_alignment();
> ^
> pxfheaders_test.c:159:1: error: conflicting types for 'store_gucs'
> store_gucs()
> ^
> pxfheaders_test.c:152:2: note: previous implicit declaration is here
> store_gucs();
> ^
> pxfheaders_test.c:166:1: error: conflicting types for 'setup_gphd_uri'
> setup_gphd_uri()
> ^
> pxfheaders_test.c:153:2: note: previous implicit declaration is here
> setup_gphd_uri();
> ^
> pxfheaders_test.c:176:1: error: conflicting types for 'setup_input_data'
> setup_input_data()
> ^
> pxfheaders_test.c:154:2: note: previous implicit declaration is here
> setup_input_data();
> ^
> pxfheaders_test.c:184:1: error: conflicting types for 'setup_external_vars'
> setup_external_vars()
> ^
> pxfheaders_test.c:155:2: note: previous implicit declaration is here
> setup_external_vars();
> ^
> pxfheaders_test.c:193:6: error: conflicting types for 'expect_external_vars'
> void expect_external_vars()
> ^
> pxfheaders_test.c:38:2: note: previous implicit declaration is here
> expect_external_vars();
> ^
> pxfheaders_test.c:220:6: error: conflicting types for 'restore_gucs'
> void restore_gucs()
> ^
> pxfheaders_test.c:217:2: note: previous implicit declaration is here
> restore_gucs();
> ^
> 8 errors generated.
> make[3]: *** [pxfheaders_test.o] Error 1
> make[2]: *** [unittest-check] Error 2
> make[1]: *** [unittest-check] Error 2
> make: *** [unittest-check] Error 2
> {code}
> ...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] incubator-hawq pull request #949: HAWQ-1080. Fixed unit-tests on local envir...
Github user sansanichfb closed the pull request at: https://github.com/apache/incubator-hawq/pull/949 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #906: HAWQ-964. Support for OR and NOT Logical O...
Github user kavinderd commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/906#discussion_r82033272
--- Diff:
pxf/pxf-api/src/main/java/org/apache/hawq/pxf/api/FilterParser.java ---
@@ -396,4 +387,12 @@ private Operation reverseOp(Operation operation) {
operatorTranslationMap.put(8, Operation.HDOP_LIKE);
return operatorTranslationMap;
}
+
+static private Map
initLogicalOperatorTransMap() {
+Map integerLogicalOperationMap = new
HashMap<>();
--- End diff --
That's true. I like that idea. @shivzone any objections to @denalex
suggestion?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-hawq pull request #906: HAWQ-964. Support for OR and NOT Logical O...
Github user kavinderd commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/906#discussion_r82033359
--- Diff:
pxf/pxf-api/src/main/java/org/apache/hawq/pxf/api/FilterParser.java ---
@@ -220,6 +193,24 @@ public Object parse(String filter) throws Exception {
// Store result on stack
operandsStack.push(result);
break;
+case 'l':
+LogicalOperation logicalOperation =
logicalOperationTranslationMap.get(safeToInt(parseNumber()));
+
+if (logicalOperation == null) {
+throw new FilterStringSyntaxException("unknown op
ending at " + index);
+}
+
+if (logicalOperation == LogicalOperation.HDOP_NOT) {
+Object exp = operandsStack.pop();
+result = filterBuilder.build(logicalOperation,
exp);
+} else {
--- End diff --
Ok, I'll add the check
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-hawq pull request #906: HAWQ-964. Support for OR and NOT Logical O...
Github user kavinderd commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/906#discussion_r82032792
--- Diff:
pxf/pxf-hbase/src/main/java/org/apache/hawq/pxf/plugins/hbase/HBaseFilterBuilder.java
---
@@ -71,14 +74,19 @@ public HBaseFilterBuilder(HBaseTupleDescription
tupleDescription) {
* @throws Exception if parsing failed
*/
public Filter getFilterObject(String filterString) throws Exception {
-FilterParser parser = new FilterParser(this);
-Object result = parser.parse(filterString);
+// First check for NOT, HBase does not support this
+if (filterString.contains(NOT_OP)) {
--- End diff --
Hmm, that's possible. I'll test and fix if needed
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-hawq pull request #906: HAWQ-964. Support for OR and NOT Logical O...
Github user kavinderd commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/906#discussion_r82032692
--- Diff:
pxf/pxf-hbase/src/main/java/org/apache/hawq/pxf/plugins/hbase/HBaseFilterBuilder.java
---
@@ -71,14 +74,19 @@ public HBaseFilterBuilder(HBaseTupleDescription
tupleDescription) {
* @throws Exception if parsing failed
*/
public Filter getFilterObject(String filterString) throws Exception {
-FilterParser parser = new FilterParser(this);
-Object result = parser.parse(filterString);
+// First check for NOT, HBase does not support this
+if (filterString.contains(NOT_OP)) {
+return null;
+} else {
--- End diff --
Ok, sounds good
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
