[jira] [Commented] (RATIS-111) RaftLogWorker may throw IllegalStateException

2017-08-25 Thread Tsz Wo Nicholas Sze (JIRA)

[ 
https://issues.apache.org/jira/browse/RATIS-111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142406#comment-16142406
 ] 

Tsz Wo Nicholas Sze commented on RATIS-111:
---

TestRaftWithHadoopRpc.testWithLoad may timeout after the patch.  Will test it 
more.

> RaftLogWorker may throw IllegalStateException
> -
>
> Key: RATIS-111
> URL: https://issues.apache.org/jira/browse/RATIS-111
> Project: Ratis
>  Issue Type: Bug
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
> Attachments: 
> org.apache.ratis.server.simulation.TestNotLeaderExceptionWithSimulation-output.txt,
>  r111_20170823.patch, r111_20170824b.patch, r111_20170824c.patch, 
> r111_20170824.patch
>
>
> {code}
> Exception in thread "RaftLogWorker for Storage Directory 
> /Users/szetszwo/hadoop/incubator-ratis/ratis-server/target/test/data/e19600c7a0228b58/MiniRaftClusterWithSimulatedRpc/s3/group-E1192218-3981-4FC5-90BF-4CFB0D270F6B"
>  2017-08-22 15:52:47,983 INFO  impl.RaftServerImpl 
> (RaftLogWorker.java:execute(278)) - RaftLogWorker-s4 finalizing log segment 
> /Users/szetszwo/hadoop/incubator-ratis/ratis-server/target/test/data/e19600c7a0228b58/MiniRaftClusterWithSimulatedRpc/s4/group-E1192218-3981-4FC5-90BF-4CFB0D270F6B/current/log_inprogress_0
> org.apache.ratis.util.ExitUtils$ExitException: RaftLogWorker for Storage 
> Directory 
> /Users/szetszwo/hadoop/incubator-ratis/ratis-server/target/test/data/e19600c7a0228b58/MiniRaftClusterWithSimulatedRpc/s3/group-E1192218-3981-4FC5-90BF-4CFB0D270F6B
>  failed.
>   at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:88)
>   at 
> org.apache.ratis.server.storage.RaftLogWorker.run(RaftLogWorker.java:185)
>   at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.IllegalStateException: File 
> /Users/szetszwo/hadoop/incubator-ratis/ratis-server/target/test/data/e19600c7a0228b58/MiniRaftClusterWithSimulatedRpc/s3/group-E1192218-3981-4FC5-90BF-4CFB0D270F6B/current/log_inprogress_0
>  does not exist.
>   at org.apache.ratis.util.Preconditions.assertTrue(Preconditions.java:60)
>   at 
> org.apache.ratis.server.storage.RaftLogWorker$FinalizeLogSegment.execute(RaftLogWorker.java:280)
>   at 
> org.apache.ratis.server.storage.RaftLogWorker.run(RaftLogWorker.java:155)
>   ... 1 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (RATIS-112) testRevertConfigurationChange may fail

2017-08-25 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/RATIS-112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze reassigned RATIS-112:
-

Assignee: Tsz Wo Nicholas Sze

> testRevertConfigurationChange may fail
> --
>
> Key: RATIS-112
> URL: https://issues.apache.org/jira/browse/RATIS-112
> Project: Ratis
>  Issue Type: Bug
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
> Attachments: 
> org.apache.ratis.hadooprpc.TestRaftReconfigurationWithHadoopRpc-output.txt, 
> r112_20170825.patch
>
>
> RaftReconfigurationBaseTest.testRevertConfigurationChange may fail once a 
> while.  It usually happens with TestRaftReconfigurationWithHadoopRpc although 
> it also happens with other RPCs.
> When it happens, it fails with AssertionError at line 577, i.e. newState 
> remains false.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (RATIS-112) testRevertConfigurationChange may fail

2017-08-25 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/RATIS-112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated RATIS-112:
--
Attachment: r112_20170825.patch

r112_20170825.patch:
- changes ServerImplUtils.newRaftServer to attempt multiple times to avoid 
temporary bind exception;
- rewrites testRevertConfigurationChange so that it can tolerate unexpected 
leader changes.

> testRevertConfigurationChange may fail
> --
>
> Key: RATIS-112
> URL: https://issues.apache.org/jira/browse/RATIS-112
> Project: Ratis
>  Issue Type: Bug
>Reporter: Tsz Wo Nicholas Sze
> Attachments: 
> org.apache.ratis.hadooprpc.TestRaftReconfigurationWithHadoopRpc-output.txt, 
> r112_20170825.patch
>
>
> RaftReconfigurationBaseTest.testRevertConfigurationChange may fail once a 
> while.  It usually happens with TestRaftReconfigurationWithHadoopRpc although 
> it also happens with other RPCs.
> When it happens, it fails with AssertionError at line 577, i.e. newState 
> remains false.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (RATIS-113) Add Async send interface to RaftClient

2017-08-25 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/RATIS-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze reassigned RATIS-113:
-

Assignee: Mukul Kumar Singh

> Add Async send interface to RaftClient
> --
>
> Key: RATIS-113
> URL: https://issues.apache.org/jira/browse/RATIS-113
> Project: Ratis
>  Issue Type: Bug
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
>
> Raft Client currently only has a sync interface, an sync interface is needed 
> for ozone



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (RATIS-4) Setup jenkins

2017-08-25 Thread Elek, Marton (JIRA)

[ 
https://issues.apache.org/jira/browse/RATIS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141689#comment-16141689
 ] 

Elek, Marton commented on RATIS-4:
--

Final patch has been uploaded. It contains:

1. Script to  build the whole project in docker container (based on hadoop 
scripts)

2. yetus based test-patch script (based on hadoop version)

3. Jenkinsfile to define the build (using docker for build)

4.  .travis file to test in on github forks.

As I see the jenkins jobs are not maintained by the INFRA team but by the 
member of the projects, so most probably we need an ASF member with permission 
to the jenkins who can create the jobs (pre-patch/oncommit). If more help is 
needed, I would be happy to participate in a call to help to test the proposed 
scripts...

> Setup jenkins 
> --
>
> Key: RATIS-4
> URL: https://issues.apache.org/jira/browse/RATIS-4
> Project: Ratis
>  Issue Type: Task
>Reporter: Enis Soztutar
>Assignee: Elek, Marton
> Attachments: RATIS-4.001.patch, RATIS-4.002.patch, RATIS-4.003.patch
>
>
> Jenkins unit test builds should be set up. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (RATIS-113) Add Async send interface to RaftClient

2017-08-25 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created RATIS-113:
---

 Summary: Add Async send interface to RaftClient
 Key: RATIS-113
 URL: https://issues.apache.org/jira/browse/RATIS-113
 Project: Ratis
  Issue Type: Bug
Reporter: Mukul Kumar Singh


Raft Client currently only has a sync interface, an sync interface is needed 
for ozone



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)