[jira] [Commented] (IGNITE-4541) Create test for Hadoop running in external JVM
[
https://issues.apache.org/jira/browse/IGNITE-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851566#comment-15851566
]
Ivan Veselovsky commented on IGNITE-4541:
-
Created 2 versions of this fix:
"Full" version: all the tests suite is running in multi-JVM mode, branch
ignite-4541, prq 1490 , build passed on TC, but ~10 tests are disabled -- 2
problems are still pending.
"Lingt" version: only TeraSort test is running in Multi-JVM mode, branch
ignite-4541b, prq 1497, waiting for TC results, but locally tests pass. This is
ready for review if tests are ok on TC.
> Create test for Hadoop running in external JVM
> --
>
> Key: IGNITE-4541
> URL: https://issues.apache.org/jira/browse/IGNITE-4541
> Project: Ignite
> Issue Type: Task
> Components: hadoop
>Affects Versions: 1.8
>Reporter: Vladimir Ozerov
>Assignee: Ivan Veselovsky
> Fix For: 2.0
>
>
> *Problem*
> Currently we run all Hadoop tests in synthetic "single JVM" mode. This way we
> miss lots of potential issues. We need to be able to run them in real
> distributed mode, but on a single machine.
> *Simplified solution*
> 1) Start N external nodes
> 2) Submit a job to these nodes and validate the result
> We can start with simple Teragen->Terasort->Teravalidate scenario.
> Please look through {{Process}} and {{ProcessBuilder}} classes usages - most
> probably we already have all necessary infrastructure to start nodes in
> external JVM.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4541) Create test for Hadoop running in external JVM
[
https://issues.apache.org/jira/browse/IGNITE-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850316#comment-15850316
]
Ivan Veselovsky commented on IGNITE-4541:
-
https://github.com/apache/ignite/pull/1490
> Create test for Hadoop running in external JVM
> --
>
> Key: IGNITE-4541
> URL: https://issues.apache.org/jira/browse/IGNITE-4541
> Project: Ignite
> Issue Type: Task
> Components: hadoop
>Affects Versions: 1.8
>Reporter: Vladimir Ozerov
>Assignee: Ivan Veselovsky
> Fix For: 2.0
>
>
> *Problem*
> Currently we run all Hadoop tests in synthetic "single JVM" mode. This way we
> miss lots of potential issues. We need to be able to run them in real
> distributed mode, but on a single machine.
> *Simplified solution*
> 1) Start N external nodes
> 2) Submit a job to these nodes and validate the result
> We can start with simple Teragen->Terasort->Teravalidate scenario.
> Please look through {{Process}} and {{ProcessBuilder}} classes usages - most
> probably we already have all necessary infrastructure to start nodes in
> external JVM.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4541) Create test for Hadoop running in external JVM
[
https://issues.apache.org/jira/browse/IGNITE-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821471#comment-15821471
]
Ivan Veselovsky commented on IGNITE-4541:
-
Tests (at least
org.apache.ignite.internal.processors.hadoop.impl.HadoopTeraSortTest) works
using {code} #isMultiJvm() { return true; } {code} override after very small
corrections.
> Create test for Hadoop running in external JVM
> --
>
> Key: IGNITE-4541
> URL: https://issues.apache.org/jira/browse/IGNITE-4541
> Project: Ignite
> Issue Type: Task
> Components: hadoop
>Affects Versions: 1.8
>Reporter: Vladimir Ozerov
>Assignee: Ivan Veselovsky
> Fix For: 2.0
>
>
> *Problem*
> Currently we run all Hadoop tests in synthetic "single JVM" mode. This way we
> miss lots of potential issues. We need to be able to run them in real
> distributed mode, but on a single machine.
> *Simplified solution*
> 1) Start N external nodes
> 2) Submit a job to these nodes and validate the result
> We can start with simple Teragen->Terasort->Teravalidate scenario.
> Please look through {{Process}} and {{ProcessBuilder}} classes usages - most
> probably we already have all necessary infrastructure to start nodes in
> external JVM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
