[
https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933202#comment-14933202
]
Feng Yuan commented on HIVE-9067:
---------------------------------
hi Prasanth Jayachandran ,i have try it again,and i still cant get it through,i
get these two errors:
when i try "insert into table orc_table select * from test_table;"--example in
HIVE-9080.
i get:
[Error 30017]: Skipping stats aggregation by error
org.apache.hadoop.hive.ql.metadata.HiveException: [Error 30001]: StatsPublisher
cannot be initialized. There was a error in the initialization of
StatsPublisher, and retrying might help. If you dont want the query to fail
because accurate statistics could not be collected, set
hive.stats.reliable=false
when try this: alter table orc_table concatenate,get:
Error: java.lang.IllegalArgumentException: Column has wrong number of index
entries found: 0 expected: 1
at
org.apache.hadoop.hive.ql.io.orc.WriterImpl$TreeWriter.writeStripe(WriterImpl.java:726)
at
org.apache.hadoop.hive.ql.io.orc.WriterImpl$StructTreeWriter.writeStripe(WriterImpl.java:1614)
at
org.apache.hadoop.hive.ql.io.orc.WriterImpl.flushStripe(WriterImpl.java:1996)
at
org.apache.hadoop.hive.ql.io.orc.WriterImpl.close(WriterImpl.java:2288)
at
org.apache.hadoop.hive.ql.exec.OrcFileMergeOperator.closeOp(OrcFileMergeOperator.java:215)
at
org.apache.hadoop.hive.ql.io.merge.MergeFileMapper.close(MergeFileMapper.java:98)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.DDLTask
if there anything i need to done?
can you gave me some suggestions?
thank you and have a good day!!
> OrcFileMergeOperator may create merge file that does not match properties of
> input files
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-9067
> URL: https://issues.apache.org/jira/browse/HIVE-9067
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.14.0, 0.15.0, 0.14.1
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Minor
> Labels: Orc
> Fix For: 1.0.0
>
> Attachments: HIVE-9067.1.patch, HIVE-9067.2.patch
>
>
> OrcFileMergeOperator creates a new ORC file and appends the stripes from
> smaller orc file. This new ORC file creation should retain the same
> configuration as the small ORC files. Currently it does not set the orc row
> index stride and file version. Also merging of stripe statistics to file
> statistics was incorrect leading to issues like in HIVE-9080
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
