[jira] [Commented] (IMPALA-7003) Support erasure-coding in impala

[Quanlong Huang (Jira)]

[ 
https://issues.apache.org/jira/browse/IMPALA-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494361#comment-17494361
 ] 

Quanlong Huang commented on IMPALA-7003:


Note that Impala already supports the basic functionality on erasure-coding. 
It's just turned off by default because Impala lacks metrics, observability and 
DDL commands related to erasure coding.

You can turn on this feature by setting query option ALLOW_ERASURE_CODED_FILES 
to true.
Doc: 
[https://impala.apache.org/docs/build/html/topics/impala_allow_erasure_coded_files.html]

> Support erasure-coding in impala
> 
>
> Key: IMPALA-7003
> URL: https://issues.apache.org/jira/browse/IMPALA-7003
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend, Infrastructure
>Affects Versions: Impala 3.1.0
>Reporter: Tianyi Wang
>Priority: Major
>
> This is the parent Jira for the erasure coding feature



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Commented] (IMPALA-7003) Support erasure-coding in impala

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/IMPALA-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479800#comment-16479800
 ] 

ASF subversion and git services commented on IMPALA-7003:
-

Commit 51bca9099789fdb48d06a6f0574647d0a9029f0d in impala's branch 
refs/heads/2.x from [~tianyiwang]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=51bca90 ]

Ignore "IMPALA-7003: Deflake erasure coding data loading"

The commit message in IMPALA-7003 mistakenly didn't include
"not for 2.x".

Change-Id: Ic9beafd4b0f0fc163ebe969fc39b4fdb6b27c0fa
Reviewed-on: http://gerrit.cloudera.org:8080/10445
Reviewed-by: Joe McDonnell 
Tested-by: Tianyi Wang 


> Support erasure-coding in impala
> 
>
> Key: IMPALA-7003
> URL: https://issues.apache.org/jira/browse/IMPALA-7003
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend, Infrastructure
>Affects Versions: Impala 3.0
>Reporter: Tianyi Wang
>Priority: Critical
>
> This is the parent Jira for the erasure coding feature



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Commented] (IMPALA-7003) Support erasure-coding in impala

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/IMPALA-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479799#comment-16479799
 ] 

ASF subversion and git services commented on IMPALA-7003:
-

Commit 51bca9099789fdb48d06a6f0574647d0a9029f0d in impala's branch 
refs/heads/2.x from [~tianyiwang]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=51bca90 ]

Ignore "IMPALA-7003: Deflake erasure coding data loading"

The commit message in IMPALA-7003 mistakenly didn't include
"not for 2.x".

Change-Id: Ic9beafd4b0f0fc163ebe969fc39b4fdb6b27c0fa
Reviewed-on: http://gerrit.cloudera.org:8080/10445
Reviewed-by: Joe McDonnell 
Tested-by: Tianyi Wang 


> Support erasure-coding in impala
> 
>
> Key: IMPALA-7003
> URL: https://issues.apache.org/jira/browse/IMPALA-7003
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend, Infrastructure
>Affects Versions: Impala 3.0
>Reporter: Tianyi Wang
>Priority: Critical
>
> This is the parent Jira for the erasure coding feature



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Commented] (IMPALA-7003) Support erasure-coding in impala

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/IMPALA-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476769#comment-16476769
 ] 

ASF subversion and git services commented on IMPALA-7003:
-

Commit 13a1acd7e42b533c39b9f4eea1c17823bde4c1c5 in impala's branch 
refs/heads/master from [~tianyiwang]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=13a1acd ]

IMPALA-7003: Deflake erasure coding data loading

Erasure coding data loading is flaky in two ways:
1. HBase sometimes doesn't work because of HBase-19369
2. Nested data loading sometimes fails because the HDFS namenode cannot
   find enough good datanodes.

For problem 1, this patch enables erasure coding only on /test-warehouse
directory. For problem 2, this patch sets
dfs.namenode.redundancy.considerLoad to false, preventing namenode from
excluding heavily-loaded datanodes.

Change-Id: I219106cd3ec7ffab7a834700f2a722b165e5f66c
Reviewed-on: http://gerrit.cloudera.org:8080/10362
Reviewed-by: Alex Behm 
Tested-by: Impala Public Jenkins 


> Support erasure-coding in impala
> 
>
> Key: IMPALA-7003
> URL: https://issues.apache.org/jira/browse/IMPALA-7003
> Project: IMPALA
>  Issue Type: Improvement
>  Components: Frontend, Infrastructure
>Affects Versions: Impala 3.0
>Reporter: Tianyi Wang
>Priority: Critical
>
> This is the parent Jira for the erasure coding feature



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org