[
https://issues.apache.org/jira/browse/MAPREDUCE-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Song Jiacheng updated MAPREDUCE-7347:
-------------------------------------
Description:
For now, Native task can not be used by Hive job, because we need to register
the key.
And as we all know, HiveKey, which is the key in Hive job, is a child class of
BytesWritable.
So all we need to do is just to register the HiveKey as BytesWritable.
This solution has already used online in our cluster, we got tens of thousands
sqls submitted to the cluster.
was:
For now, Native task can not be used by Hive job, because we need to register
the key.
And as we all know, HiveKey, which is the key in Hive job, is a child class of
BytesWritable.
So what we need to do is just register the HiveKey as BytesWritable.
This solution has already used online in our cluster, we got tens of thousands
sqls submitted to the cluster.
> Add a Hive platform to Nativetask
> ---------------------------------
>
> Key: MAPREDUCE-7347
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7347
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: nativetask
> Affects Versions: 3.2.1
> Reporter: Song Jiacheng
> Priority: Major
> Attachments: MAPREDUCE-7347.v1.patch
>
>
> For now, Native task can not be used by Hive job, because we need to register
> the key.
> And as we all know, HiveKey, which is the key in Hive job, is a child class
> of BytesWritable.
> So all we need to do is just to register the HiveKey as BytesWritable.
> This solution has already used online in our cluster, we got tens of
> thousands sqls submitted to the cluster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]