[jira] [Created] (HAWQ-1511) Add TDE-related properties into function-test.xml
Hongxu Ma created HAWQ-1511: --- Summary: Add TDE-related properties into function-test.xml Key: HAWQ-1511 URL: https://issues.apache.org/jira/browse/HAWQ-1511 Project: Apache HAWQ Issue Type: Sub-task Components: libhdfs Reporter: Hongxu Ma Assignee: Radar Lei Fix For: 2.3.0.0-incubating include: * dfs.encryption.key.provider.uri * hadoop.security.crypto.buffer.size -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HAWQ-1510) Add TDE-related functionality into hawq command line tools
[ https://issues.apache.org/jira/browse/HAWQ-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongxu Ma reassigned HAWQ-1510: --- Assignee: Hongxu Ma (was: Radar Lei) > Add TDE-related functionality into hawq command line tools > -- > > Key: HAWQ-1510 > URL: https://issues.apache.org/jira/browse/HAWQ-1510 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Command Line Tools >Reporter: Hongxu Ma >Assignee: Hongxu Ma > Fix For: 2.3.0.0-incubating > > > 1, hawq init > the only way to enable tde in hawq: > user should give a key name(already created by hadoop key command) parameter > when execuate the init command, it makes the whole hawq_default directory as > an encryption zone. > note: > cannot support transfer the existed(and non-empty) hawq_default directory > into an encryption zone. > 2, hawq state > show the encryption zone info if user enable tde in hawq. > 3, hawq register > cannot register file in different encryption zones / un-encryption zones. > 4, hawq extract > give user a warning of the table data is stored in encryption zone if user > enable tde in hawq. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HAWQ-1511) Add TDE-related properties into function-test.xml
[ https://issues.apache.org/jira/browse/HAWQ-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongxu Ma reassigned HAWQ-1511: --- Assignee: Hongxu Ma (was: Radar Lei) > Add TDE-related properties into function-test.xml > - > > Key: HAWQ-1511 > URL: https://issues.apache.org/jira/browse/HAWQ-1511 > Project: Apache HAWQ > Issue Type: Sub-task > Components: libhdfs >Reporter: Hongxu Ma >Assignee: Hongxu Ma > Fix For: 2.3.0.0-incubating > > > include: > * dfs.encryption.key.provider.uri > * hadoop.security.crypto.buffer.size -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HAWQ-1510) Add TDE-related functionality into hawq command line tools
Hongxu Ma created HAWQ-1510: --- Summary: Add TDE-related functionality into hawq command line tools Key: HAWQ-1510 URL: https://issues.apache.org/jira/browse/HAWQ-1510 Project: Apache HAWQ Issue Type: Sub-task Components: Command Line Tools Reporter: Hongxu Ma Assignee: Radar Lei Fix For: 2.3.0.0-incubating 1, hawq init the only way to enable tde in hawq: user should give a key name(already created by hadoop key command) parameter when execuate the init command, it makes the whole hawq_default directory as an encryption zone. note: cannot support transfer the existed(and non-empty) hawq_default directory into an encryption zone. 2, hawq state show the encryption zone info if user enable tde in hawq. 3, hawq register cannot register file in different encryption zones / un-encryption zones. 4, hawq extract give user a warning of the table data is stored in encryption zone if user enable tde in hawq. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (HAWQ-1506) Support multi-append a file within encryption zone
[ https://issues.apache.org/jira/browse/HAWQ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongxu Ma closed HAWQ-1506. --- Resolution: Fixed fixed > Support multi-append a file within encryption zone > -- > > Key: HAWQ-1506 > URL: https://issues.apache.org/jira/browse/HAWQ-1506 > Project: Apache HAWQ > Issue Type: Sub-task > Components: libhdfs >Reporter: Hongxu Ma >Assignee: Hongxu Ma > Fix For: 2.3.0.0-incubating > > > Currently, multi-append (*serializable*) can cause write the incorrect > content. > Reproduction method: > # Open a file with O_APPEND flag in encryption zone directory. > # Call hdfsWrite() twice. > # Then read all file contents => only the first write content is correct. > So we need to fix it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HAWQ-1193) TDE support in HAWQ
[ https://issues.apache.org/jira/browse/HAWQ-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongxu Ma reassigned HAWQ-1193: --- Assignee: Hongxu Ma (was: Ivan Weng) > TDE support in HAWQ > --- > > Key: HAWQ-1193 > URL: https://issues.apache.org/jira/browse/HAWQ-1193 > Project: Apache HAWQ > Issue Type: New Feature > Components: libhdfs >Reporter: Hongxu Ma >Assignee: Hongxu Ma > Fix For: backlog > > Attachments: HAWQ_TDE_Design_ver0.1.pdf, HAWQ_TDE_Design_ver0.2 .pdf > > > TDE(transparently data encrypted) has been supported after hadoop 2.6: > http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html > https://issues.apache.org/jira/browse/HDFS-6134 > Use TDE can promiseļ¼ > 1, hdfs file is encrypted. > 2, network transfer between hdfs and libhdfs client is encrypted. > So hawq will update libhdfs3 to support it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HAWQ-1509) Support TDE read function
[ https://issues.apache.org/jira/browse/HAWQ-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongxu Ma reassigned HAWQ-1509: --- Assignee: Amy (was: Hongxu Ma) > Support TDE read function > - > > Key: HAWQ-1509 > URL: https://issues.apache.org/jira/browse/HAWQ-1509 > Project: Apache HAWQ > Issue Type: Sub-task > Components: libhdfs >Reporter: Hongxu Ma >Assignee: Amy > Fix For: 2.3.0.0-incubating > > > Currently, we have already supported TDE write. > Then will support TDE read in this JIRA. -- This message was sent by Atlassian JIRA (v6.4.14#64029)