[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

[radarwave]

Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
LGTM
+1


---

[jira] [Commented] (HAWQ-1514) TDE feature makes libhdfs3 require openssl1.1

[Hongxu Ma (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347938#comment-16347938
 ] 

Hongxu Ma commented on HAWQ-1514:
-

We open a PR to check the openssl version in hawq configure (more detailed: 
find the needed function).

It prompt an error message if the check failed.

 

> TDE feature makes libhdfs3 require openssl1.1
> -
>
> Key: HAWQ-1514
> URL: https://issues.apache.org/jira/browse/HAWQ-1514
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: libhdfs
>Reporter: Yi Jin
>Assignee: WANG Weinan
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> New TDE feature delivered in libhdfs3 requires specific version of openssl, 
> at least per my test, 1.0.21 does not work, and 1.1 source code built library 
> passed.
> So maybe we need some build and installation instruction improvement. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

[wengyanqing]

Github user wengyanqing commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
LGTM


---

[jira] [Resolved] (HAWQ-1580) Change PXF Port to 5888 for GPDB environments

[Lav Jain (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain resolved HAWQ-1580.

   Resolution: Fixed
Fix Version/s: 2.3.0.0-incubating

> Change PXF Port to 5888 for GPDB environments
> -
>
> Key: HAWQ-1580
> URL: https://issues.apache.org/jira/browse/HAWQ-1580
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> Currently PXF server listens on port 51200 which could be occupied by 
> background GPDB processes. This causes CI to fail whenever 51200 is not 
> available. This change is to make PXF server not use a dynamic/ephemeral port 
> by setting it to 5888 (< 1).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HAWQ-1545) pxf-private.classpath file for TARs refers to generic jackson libraries

[Lav Jain (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain resolved HAWQ-1545.

   Resolution: Fixed
Fix Version/s: 2.3.0.0-incubating

> pxf-private.classpath file for TARs refers to generic jackson libraries
> ---
>
> Key: HAWQ-1545
> URL: https://issues.apache.org/jira/browse/HAWQ-1545
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> JSON profile requires Jackson libraries version 1.9 (and above). The 
> unit-tests and automation tests fail with Jackson 1.8.8, which seems to be 
> the default for Cloudera tarball based distribution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] incubator-hawq pull request #1334: HAWQ-1584. Don't ignore exceptions during...

[lavjain]

Github user lavjain closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1334


---

[GitHub] incubator-hawq pull request #1334: HAWQ-1584. Don't ignore exceptions during...

[lavjain]

GitHub user lavjain reopened a pull request:

https://github.com/apache/incubator-hawq/pull/1334

HAWQ-1584. Don't ignore exceptions during bridge.endIteration when writing 
to HDFS



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lavjain/incubator-hawq fix_writable

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1334.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1334


commit b0e86b7d89f5087582ad89d405ebbba6d962241d
Author: lavjain 
Date:   2018-01-30T07:16:14Z

HAWQ-1584. Do not ignore exceptions during bridge.endIteration when writing 
to HDFS




---

[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

[radarwave]

Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
Thanks @weinan003 help handle the openssl version issue. I think we should 
modify configure.in then generate configure.


---

[GitHub] incubator-hawq pull request #1336: HAWQ-1514. TDE feature makes libhdfs3 req...

[weinan003]

GitHub user weinan003 opened a pull request:

https://github.com/apache/incubator-hawq/pull/1336

HAWQ-1514. TDE feature makes libhdfs3 require openssl1.1

1. use environment HDFS_DEPENDENCY_INSTALL_PREFIX to indicate "libhdfs" 
used openssl path
2. do function check before HAWQ compilation in configure file

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/weinan003/incubator-hawq hdfs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1336.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1336


commit 13272f5d2d68ec702f2ae88c1e587e9b08eca923
Author: Weinan Wang 
Date:   2018-01-31T08:47:04Z

HAWQ-1514. TDE feature makes libhdfs3 require openssl1.1




---

[jira] [Assigned] (HAWQ-1584) Propagate any errors when closing stream for PXF writable tables

[Lav Jain (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain reassigned HAWQ-1584:
--

Assignee: Lav Jain  (was: Ed Espino)

> Propagate any errors when closing stream for PXF writable tables 
> -
>
> Key: HAWQ-1584
> URL: https://issues.apache.org/jira/browse/HAWQ-1584
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
>
> PXF ignores any errors when closing the stream, which does not affect reading 
> HDFS data. However, in case of write HDFS might return an error and data 
> might not get written. Therefore, any errors when closing the input stream 
> must be passed to PXF client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)