Try to make the value smaller. For example 1024.

________________________________
??????: 35925138 <[email protected]>
????????: 2017??4??14?? 16:25:41
??????: dev
????: ??????????: ??????????: Error: java.io.IOException: Unable to initialize 
any output collector

????????????????????hadoop??????????????????????2047??????????2048




------------------ ???????? ------------------
??????: "roger shi";<[email protected]>;
????????: 2017??4??13??(??????) ????4:30
??????: "dev"<[email protected]>;

????: ????: ??????????: Error: java.io.IOException: Unable to initialize any 
output collector



It seems the hadoop environment configuration issue.


One possible reason is the configuration "mapreduce.task.io.sort.mb" of this 
failed job is too large. For the detailed information please refer to 
https://issues.apache.org/jira/browse/MAPREDUCE-6194.

Bubble up final exception in failures during creation of 
...<https://issues.apache.org/jira/browse/MAPREDUCE-6194>
issues.apache.org
MAPREDUCE-5974 added in ability to instantiate multiple OCs, but if none of 
them are able to load it "throws" only a final a generic message: "Unable to 
initialize ...



________________________________
??????: 35925138 <[email protected]>
????????: 2017??4??13?? 15:13:45
??????: dev
????: ??????????: Error: java.io.IOException: Unable to initialize any output 
collector

????????????????????????????????????




------------------ ???????? ------------------
??????: "roger shi";<[email protected]>;
????????: 2017??4??13??(??????) ????2:51
??????: "dev"<[email protected]>;

????: ????: Error: java.io.IOException: Unable to initialize any output 
collector



Could you please attach the complete stack trace of the error?

________________________________
??????: 35925138 <[email protected]>
????????: 2017??4??13?? 13:45:09
??????: dev
????: Error: java.io.IOException: Unable to initialize any output collector

????kylin??????1.6.0 hadoop??????2.6.0??build cube????????Step Name: 
Redistribute Flat Hive Table ??????????????????
kylin??????????????????
no counters for job job_1492049582227_0011


????hadoop????userlog??????????????????????
2017-04-13 11:23:33,758 ERROR [IPC Server handler 1 on 43772] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1492049582227_0011_m_000000_0 - exited : java.io.IOException: Unable to 
initialize any output collector
        at 
org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:412)
        at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
        at 
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:695)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)


??????????????????????????????????????????

Reply via email to