[
https://issues.apache.org/jira/browse/TEZ-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355656#comment-14355656
]
Bikas Saha commented on TEZ-2190:
---------------------------------
I believe that is by design because the following code in DAG.java during dag
building takes care of setting parallelism based on data source descriptor
number of shards. So the bug might be somewhere else?
{code} if (dataSources.size() == 1) {
DataSourceDescriptor dataSource = dataSources.get(0);
if (vertexParallelism == -1 && dataSource.getNumberOfShards() > -1) {
vertexParallelism = dataSource.getNumberOfShards();
}
if (vertexLocationHint == null && dataSource.getLocationHint() != null)
{
vertexLocationHint = dataSource.getLocationHint();
}
}{code}
> TestOrderedWordCount fails when generateSplitsInClient set to true
> ------------------------------------------------------------------
>
> Key: TEZ-2190
> URL: https://issues.apache.org/jira/browse/TEZ-2190
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Hitesh Shah
> Assignee: Hitesh Shah
> Attachments: TEZ-2190.1.patch
>
>
> numTasks for the map stage is unset in this scenario leading to the following
> error:
> {code}
> java.lang.IllegalStateException: initialmap has -1 tasks but does not have
> input initializers, 1-1 uninited sources or custom vertex manager to set it
> at runtime
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
