> On Feb. 28, 2014, 11:26 p.m., Gunther Hagleitner wrote:
> > serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java,
> >  line 309
> > <https://reviews.apache.org/r/18230/diff/10/?file=507272#file507272line309>
> >
> >     this doesn't seem to belong in the serde. this is a helper for the map 
> > join key only. (e.g.: field < 8, etc) you should be able to just use the 
> > existing public interface, right?

I will have to add at least one static method. But yeah, made it a simple 
pass-thru to already existing private static method; moved all the key-specific 
stuff to keys


> On Feb. 28, 2014, 11:26 p.m., Gunther Hagleitner wrote:
> > serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java,
> >  line 236
> > <https://reviews.apache.org/r/18230/diff/10/?file=507272#file507272line236>
> >
> >     this doesn't seem to belong here. it's not a general purpose serde 
> > method... in the vectorizedreducesink we seem to just break the row group 
> > into rows and serialize with the unchanged serde. can we do this here too?

I can see if it works... looks convoluted from perf perspective, writable is 
created, then writer does bunch of stuff to get back raw value. If it works I 
guess we can keep it and speed up by getting raw value later, if needed


- Sergey


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18230/#review35866
-----------------------------------------------------------


On Feb. 28, 2014, 10:04 p.m., Sergey Shelukhin wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18230/
> -----------------------------------------------------------
> 
> (Updated Feb. 28, 2014, 10:04 p.m.)
> 
> 
> Review request for hive, Gunther Hagleitner and Jitendra Pandey.
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> See JIRA
> 
> 
> Diffs
> -----
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6802b4d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/AbstractMapJoinOperator.java 
> 3cfaacf 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableLoader.java 988cc57 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java 
> 8b25300 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/JoinUtil.java 46e37c2 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java 9948583 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HashTableLoader.java 5cf347b 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinKey.java 
> 2ac0928 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinKeyBytes.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinKeyObject.java 
> PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinTableContainerSerDe.java
>  0279f7c 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/HashTableLoader.java 295854d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorHashKeyWrapperBatch.java
>  581046e 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorMapJoinOperator.java 
> 2466a3b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorSMBMapJoinOperator.java
>  997202f 
>   
> ql/src/test/org/apache/hadoop/hive/ql/exec/persistence/TestMapJoinEqualityTableContainer.java
>  d17b656 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/persistence/TestMapJoinKey.java 
> a103a51 
>   
> ql/src/test/org/apache/hadoop/hive/ql/exec/persistence/TestMapJoinTableContainer.java
>  40bf006 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/persistence/Utilities.java 
> 22eca50 
>   
> serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java
>  fcded96 
>   
> serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/OutputByteBuffer.java
>  7bfe473 
>   serde/src/java/org/apache/hadoop/hive/serde2/io/HiveDecimalWritable.java 
> 67cb1e8 
>   
> serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java 
> f9b4031 
>   
> serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryUtils.java 
> c583ae2 
> 
> Diff: https://reviews.apache.org/r/18230/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Reply via email to