Definitely go for a pull request!
On Mon, Jan 19, 2015 at 10:10 AM, Mick Davies <[email protected]> wrote: > > Looking at Parquet code - it looks like hooks are already in place to > support this. > > In particular PrimitiveConverter has methods hasDictionarySupport and > addValueFromDictionary for this purpose. These are not used by > CatalystPrimitiveConverter. > > I think that it would be pretty straightforward to add this. Has anyone > considered this? Shall I get a pull request together for it. > > Mick > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Optimize-encoding-decoding-strings-when-using-Parquet-tp10141p10195.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
