How is this issue going? Is there any Jira ticket about this? Thanks, Dongjin
On Sat, Mar 24, 2018 at 1:39 PM, Himanshu Mohan < himanshu.mo...@aexp.com.invalid> wrote: > I agree > > > > > > > > Thanks > > Himanshu > > > > *From:* Li Jin [mailto:ice.xell...@gmail.com] > *Sent:* Friday, March 23, 2018 8:24 PM > *To:* dev <dev@spark.apache.org> > *Subject:* MatrixUDT and VectorUDT in Spark ML > > > > Hi All, > > > > I came across these two types MatrixUDT and VectorUDF in Spark ML when > doing feature extraction and preprocessing with PySpark. However, when > trying to do some basic operations, such as vector multiplication and > matrix multiplication, I had to go down to Python UDF. > > > > It seems to be it would be very useful to have built-in operators on these > types just like first class Spark SQL types, e.g., > > > > df.withColumn('v', df.matrix_column * df.vector_column) > > > > I wonder what are other people's thoughts on this? > > > > Li > > ------------------------------ > American Express made the following annotations > ------------------------------ > > "This message and any attachments are solely for the intended recipient > and may contain confidential or privileged information. If you are not the > intended recipient, any disclosure, copying, use, or distribution of the > information included in this message and any attachments is prohibited. If > you have received this communication in error, please notify us by reply > e-mail and immediately and permanently delete this message and any > attachments. Thank you." > > American Express a ajouté le commentaire suivant le > Ce courrier et toute pièce jointe qu'il contient sont réservés au seul > destinataire indiqué et peuvent renfermer des renseignements confidentiels > et privilégiés. Si vous n'êtes pas le destinataire prévu, toute > divulgation, duplication, utilisation ou distribution du courrier ou de > toute pièce jointe est interdite. Si vous avez reçu cette communication par > erreur, veuillez nous en aviser par courrier et détruire immédiatement le > courrier et les pièces jointes. Merci. > ------------------------------ > > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <http://github.com/dongjinleekr>linkedin: kr.linkedin.com/in/dongjinleekr <http://kr.linkedin.com/in/dongjinleekr>slideshare: www.slideshare.net/dongjinleekr <http://www.slideshare.net/dongjinleekr>*
