nandakumar131 opened a new pull request #1083: HDDS-1791. Update
network-tests/src/test/blockade/README.md file
URL: https://github.com/apache/hadoop/pull/1083
`hadoop-ozone/fault-injection-test/network-tests/src/test/blockade/README.md`
has to be updated after #1068
mukul1987 commented on a change in pull request #1072: HDDS-1766.
ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed
by Mukul Kumar Singh.
URL: https://github.com/apache/hadoop/pull/1072#discussion_r302923915
##
File path:
nandakumar131 merged pull request #1080: HDDS-1752 Use concurrent set
implementation for node to pipelines ma…
URL: https://github.com/apache/hadoop/pull/1080
This is an automated message from the Apache Git Service.
To
nandakumar131 commented on a change in pull request #1008: HDDS-1713.
ReplicationManager fail to find proper node topology based…
URL: https://github.com/apache/hadoop/pull/1008#discussion_r302894199
##
File path:
hadoop-yetus commented on issue #1035: HDDS-1735. Create separate unit and
integration test executor dev-support script
URL: https://github.com/apache/hadoop/pull/1035#issuecomment-510844929
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies
between DDB and S3
URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510855815
thanks. Gabor, you do explicitly need to do that +1 for the record
elek commented on issue #1032: [HDDS-1201] Reporting corrupted containers info
to SCM
URL: https://github.com/apache/hadoop/pull/1032#issuecomment-510806166
This patch introduced new checkstyle errors.
I recommend to add ozone label to the jira to get clear reports from the
elek commented on issue #1029: HDDS-1384. TestBlockOutputStreamWithFailures is
failing
URL: https://github.com/apache/hadoop/pull/1029#issuecomment-510809738
Thanks @arp7 the review, I am merging it to the trunk right now.
Remaining unit test failures are not related (AssertionErrors +
nandakumar131 opened a new pull request #1082: HDDS-1790. Fix checkstyle issues
in TestDataScrubber.
URL: https://github.com/apache/hadoop/pull/1082
There are 4 Checkstyle issues in TestDataScrubber that has to be fixed
```
[ERROR]
hadoop-yetus commented on issue #1082: HDDS-1790. Fix checkstyle issues in
TestDataScrubber.
URL: https://github.com/apache/hadoop/pull/1082#issuecomment-510851545
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
bgaborg commented on issue #1079: HADOOP-16380: test to show that it is the
root directory where the "tombstone problem" can be replicated
URL: https://github.com/apache/hadoop/pull/1079#issuecomment-510833679
thanks Steve for creating a test that reproduces the issue. I'm looking into
mukul1987 commented on a change in pull request #1076: HDDS-1782. Add an option
to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul
Kumar Singh.
URL: https://github.com/apache/hadoop/pull/1076#discussion_r302944648
##
File path:
Sahil Kaw created HADOOP-16428:
--
Summary: Distcp make use of S3a Committers, be it magic or staging
Key: HADOOP-16428
URL: https://issues.apache.org/jira/browse/HADOOP-16428
Project: Hadoop Common
bshashikant opened a new pull request #1084: HDDS-1492. Generated chunk size
name too long.
URL: https://github.com/apache/hadoop/pull/1084
This is an automated message from the Apache Git Service.
To respond to the
zeroflag commented on issue #940: HADOOP-16341. ShutDownHookManager: Regressed
performance on Hook remo…
URL: https://github.com/apache/hadoop/pull/940#issuecomment-510801697
retest this please
This is an automated message
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883662#comment-16883662
]
Yikun Jiang commented on HADOOP-13363:
--
I also prefer to upgrade the protobuf to v3, and protobuf
hadoop-yetus commented on issue #1035: HDDS-1735. Create separate unit and
integration test executor dev-support script
URL: https://github.com/apache/hadoop/pull/1035#issuecomment-510837233
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
lokeshj1703 commented on issue #1072: HDDS-1766. ContainerStateMachine is
unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh.
URL: https://github.com/apache/hadoop/pull/1072#issuecomment-510837155
@mukul1987 The changes look good to me. +1.
bgaborg removed a comment on issue #1079: HADOOP-16380: test to show that it is
the root directory where the "tombstone problem" can be replicated
URL: https://github.com/apache/hadoop/pull/1079#issuecomment-510833679
thanks Steve for creating a test that reproduces the issue. I'm looking
mukul1987 commented on a change in pull request #1076: HDDS-1782. Add an option
to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul
Kumar Singh.
URL: https://github.com/apache/hadoop/pull/1076#discussion_r302922551
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883565#comment-16883565
]
Sahil Kaw commented on HADOOP-16428:
[~ste...@apache.org] Can you please help me with this? Thanks
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Kaw updated HADOOP-16428:
---
Description:
Currently, I don't see Distcp make use of S3a Committers, be it Magic or
Staging and
elek closed pull request #1029: HDDS-1384. TestBlockOutputStreamWithFailures is
failing
URL: https://github.com/apache/hadoop/pull/1029
This is an automated message from the Apache Git Service.
To respond to the message,
[
https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-16384.
-
Resolution: Fixed
Fix Version/s: 3.3.0
> S3A: Avoid inconsistencies between DDB
elek commented on issue #1035: HDDS-1735. Create separate unit and integration
test executor dev-support script
URL: https://github.com/apache/hadoop/pull/1035#issuecomment-510870453
> @elek I was trying to merge, but seems like we have some conflicts.
Perhaps due to the fact that I
[
https://issues.apache.org/jira/browse/HADOOP-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883809#comment-16883809
]
Steve Loughran commented on HADOOP-16425:
-
HADOOP-16384 does this, though without any promises
hadoop-yetus commented on issue #1076: HDDS-1782. Add an option to
MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar
Singh.
URL: https://github.com/apache/hadoop/pull/1076#issuecomment-510887805
:broken_heart: **-1 overall**
| Vote |
[
https://issues.apache.org/jira/browse/HADOOP-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-16397.
-
Resolution: Fixed
Fix Version/s: 3.3.0
> Hadoop S3Guard Prune command to
[
https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883744#comment-16883744
]
Hudson commented on HADOOP-16384:
-
FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16902 (See
[
https://issues.apache.org/jira/browse/HADOOP-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-16406.
-
Resolution: Fixed
Fix Version/s: 3.3.0
>
elek closed pull request #1083: HDDS-1791. Update
network-tests/src/test/blockade/README.md file
URL: https://github.com/apache/hadoop/pull/1083
This is an automated message from the Apache Git Service.
To respond to the
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883808#comment-16883808
]
Steve Loughran commented on HADOOP-16428:
-
the s3a committers aim to eliminate the two renames
adoroszlai commented on a change in pull request #1076: HDDS-1782. Add an
option to MiniOzoneChaosCluster to read files multiple times. Contributed by
Mukul Kumar Singh.
URL: https://github.com/apache/hadoop/pull/1076#discussion_r303020363
##
File path:
zeroflag commented on issue #1086: HADOOP-16341. ShutDownHookManager: Regressed
performance on Hook remo…
URL: https://github.com/apache/hadoop/pull/1086#issuecomment-510932548
@steveloughran could you review it? It's the same as #940 but with the fix
for the flaky test.
[
https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16384:
Summary: S3A: Avoid inconsistencies between DDB and S3 (was: HADOOP-16384:
S3A: Avoid
elek closed pull request #1082: HDDS-1790. Fix checkstyle issues in
TestDataScrubber.
URL: https://github.com/apache/hadoop/pull/1082
This is an automated message from the Apache Git Service.
To respond to the message,
[
https://issues.apache.org/jira/browse/HADOOP-16415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883813#comment-16883813
]
Steve Loughran commented on HADOOP-16415:
-
Thinking for of this
We're running the same
hgadre commented on issue #1032: [HDDS-1201] Reporting corrupted containers
info to SCM
URL: https://github.com/apache/hadoop/pull/1032#issuecomment-510906972
@elek sorry about that. I have filed HDDS-1794 to fix this.
This
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Kaw updated HADOOP-16428:
---
Summary: Distcp don't make use of S3a Committers, be it magic or staging
(was: Distcp make use of
anuengineer merged pull request #1035: HDDS-1735. Create separate unit and
integration test executor dev-support script
URL: https://github.com/apache/hadoop/pull/1035
This is an automated message from the Apache Git
bgaborg commented on issue #1003: HADOOP-16384: Avoid inconsistencies between
DDB and S3
URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510856266
+1; these improvements will make the s3a more stable.
This is an
adoroszlai opened a new pull request #1085: HDDS-1785. OOM error in Freon due
to the concurrency handling
URL: https://github.com/apache/hadoop/pull/1085
## What changes were proposed in this pull request?
Change concurrency in Freon `RandomKeyGenerator`:
* create a worker
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16428:
Component/s: tools/distcp
> Distcp make use of S3a Committers, be it magic or staging
>
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16428:
Fix Version/s: (was: 3.1.2)
> Distcp make use of S3a Committers, be it magic or
adoroszlai commented on issue #1085: HDDS-1785. OOM error in Freon due to the
concurrency handling
URL: https://github.com/apache/hadoop/pull/1085#issuecomment-510916323
@elek @iamcaoxudong please review
This is an automated
hadoop-yetus commented on issue #1085: HDDS-1785. OOM error in Freon due to the
concurrency handling
URL: https://github.com/apache/hadoop/pull/1085#issuecomment-510942107
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Luis Pedrosa updated HADOOP-16417:
---
Description:
*** NOTE: apparently a hack around is use any string as password.
hadoop-yetus commented on issue #1084: HDDS-1492. Generated chunk size name too
long.
URL: https://github.com/apache/hadoop/pull/1084#issuecomment-510867630
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1083: HDDS-1791. Update
network-tests/src/test/blockade/README.md file
URL: https://github.com/apache/hadoop/pull/1083#issuecomment-510877178
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1085: HDDS-1785. OOM error in Freon due to the
concurrency handling
URL: https://github.com/apache/hadoop/pull/1085#issuecomment-510894889
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
elek commented on issue #1032: [HDDS-1201] Reporting corrupted containers info
to SCM
URL: https://github.com/apache/hadoop/pull/1032#issuecomment-510924348
Oh, no worries at all. It's a problem with the build system if these minor
problems are not clearly visible immediately on the PR.
Steve Loughran created HADOOP-16429:
---
Summary: DynamoDBMetaStore deleteSubtree to delete leaf nodes first
Key: HADOOP-16429
URL: https://issues.apache.org/jira/browse/HADOOP-16429
Project: Hadoop
Steve Loughran created HADOOP-16430:
---
Summary: S3AFilesystem.delete to incrementally update s3guard with
deletions
Key: HADOOP-16430
URL: https://issues.apache.org/jira/browse/HADOOP-16430
Project:
lokeshj1703 opened a new pull request #1087: ContainerStateMachine should have
its own executors for executing applyTransaction calls
URL: https://github.com/apache/hadoop/pull/1087
Currently ContainerStateMachine uses the executors provided by
XceiverServerRatis for executing
[
https://issues.apache.org/jira/browse/HADOOP-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883919#comment-16883919
]
Masatake Iwasaki commented on HADOOP-16417:
---
WASB allows accessing public container of
hadoop-yetus commented on issue #1086: HADOOP-16341. ShutDownHookManager:
Regressed performance on Hook remo…
URL: https://github.com/apache/hadoop/pull/1086#issuecomment-510952612
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16384:
Summary: HADOOP-16384: S3A: Avoid inconsistencies between DDB and S3 (was:
[
https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883737#comment-16883737
]
Steve Loughran commented on HADOOP-16384:
-
Given a +1 by Gabor in the PR; committing with a
steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies
between DDB and S3
URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510862114
thanks for all the testing -committed to trunk
This is an
steveloughran closed pull request #1003: HADOOP-16384: Avoid inconsistencies
between DDB and S3
URL: https://github.com/apache/hadoop/pull/1003
This is an automated message from the Apache Git Service.
To respond to the
zeroflag opened a new pull request #1086: HADOOP-16341. ShutDownHookManager:
Regressed performance on Hook remo…
URL: https://github.com/apache/hadoop/pull/1086
…vals after HADOOP-15679
Continuation of #940. Taking it over Gopal.
bshashikant commented on a change in pull request #1071: HDDS-1779.
TestWatchForCommit tests are flaky.
URL: https://github.com/apache/hadoop/pull/1071#discussion_r302947780
##
File path:
bshashikant commented on a change in pull request #1071: HDDS-1779.
TestWatchForCommit tests are flaky.
URL: https://github.com/apache/hadoop/pull/1071#discussion_r302947487
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883825#comment-16883825
]
Steve Loughran commented on HADOOP-11890:
-
bq. Anything trying to semi-intelligently split/join
hadoop-yetus commented on issue #1086: HADOOP-16341. ShutDownHookManager:
Regressed performance on Hook remo…
URL: https://github.com/apache/hadoop/pull/1086#issuecomment-510953576
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884156#comment-16884156
]
Steve Loughran commented on HADOOP-16428:
-
I'm saying: its hard to show any benefits over the
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883990#comment-16883990
]
Tsuyoshi Ozawa commented on HADOOP-13363:
-
I'm happy that Anu, Yikun, and Steven resume the
[
https://issues.apache.org/jira/browse/HADOOP-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884021#comment-16884021
]
Sahil Kaw commented on HADOOP-16428:
Thanks [~ste...@apache.org] , so that means its because of the
hadoop-yetus commented on issue #1087: ContainerStateMachine should have its
own executors for executing applyTransaction calls
URL: https://github.com/apache/hadoop/pull/1087#issuecomment-510957462
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime |
hadoop-yetus commented on issue #1071: HDDS-1779. TestWatchForCommit tests are
flaky.
URL: https://github.com/apache/hadoop/pull/1071#issuecomment-510999876
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1088: HDDS-1689. Implement S3 Create Bucket
request to use Cache and DoubleBuffer.
URL: https://github.com/apache/hadoop/pull/1088#issuecomment-511077933
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
xiaoyuyao commented on issue #1074: HDDS-1544. Support default Acls for volume,
bucket, keys and prefix. Contributed by Ajay Kumar.
URL: https://github.com/apache/hadoop/pull/1074#issuecomment-511053477
TestOzoneNativeAuthorizer failure is related. The Prefix_Lock is not
reentrant. The
bharatviswa504 opened a new pull request #1088: HDDS-1689. Implement S3 Create
Bucket request to use Cache and DoubleBuffer.
URL: https://github.com/apache/hadoop/pull/1088
This is an automated message from the Apache Git
DadanielZ commented on issue #823: HADOOP-16315. ABFS: transform full UPN for
named user in AclStatus
URL: https://github.com/apache/hadoop/pull/823#issuecomment-511058397
rerun the tests, all passed:
xns account:
Tests run: 41, Failures: 0, Errors: 0, Skipped: 0
Tests run: 393,
[
https://issues.apache.org/jira/browse/HADOOP-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884255#comment-16884255
]
Da Zhou commented on HADOOP-16404:
--
Arun met some env issues, so I ran the tests with this patch.
hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService
compatible with HA model
URL: https://github.com/apache/hadoop/pull/1063#issuecomment-511052962
Fixed failing tests and add unit tests.
This is an
xiaoyuyao closed pull request #1066: HDDS-1776. Fix image name in some ozone
docker-compose files. Contrib…
URL: https://github.com/apache/hadoop/pull/1066
This is an automated message from the Apache Git Service.
To
hadoop-yetus commented on issue #823: HADOOP-16315. ABFS: transform full UPN
for named user in AclStatus
URL: https://github.com/apache/hadoop/pull/823#issuecomment-511069737
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1063: HDDS-1775. Make OM KeyDeletingService
compatible with HA model
URL: https://github.com/apache/hadoop/pull/1063#issuecomment-511079591
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on a change in pull request #1063: HDDS-1775. Make OM
KeyDeletingService compatible with HA model
URL: https://github.com/apache/hadoop/pull/1063#discussion_r303188169
##
File path:
hadoop-yetus commented on issue #1088: HDDS-1689. Implement S3 Create Bucket
request to use Cache and DoubleBuffer.
URL: https://github.com/apache/hadoop/pull/1088#issuecomment-511080754
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
81 matches
Mail list logo
