Raw binary should work fine - if it's BytesWritable then on the Scala side it will be converted into Array[Byte] and MsgPack will pass it through. On the Python side you can use your custom lib to deserialize the RDD of (k, [byte]).
It would be great if you could test the PR to see if it works for this case. -- You received this message because you are subscribed to the Google Groups "Spark Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
