[GitHub] [spark] maropu commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-16 Thread GitBox
maropu commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-659340965 > Would that alleviate your concern about SPIP @maropu? Yea, the descison sounds reasonable to me. This

[GitHub] [spark] maropu commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-14 Thread GitBox
maropu commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-658506540 > We want to produce a transparent replacement for .cache, .persist and the SQL CACHE operator using GPUs for acceleration. Caching data right now is slow on the CPU. .cache is

[GitHub] [spark] maropu commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-12 Thread GitBox
maropu commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-657188271 Hi, @revans2 , thanks for the work. I have two questions now; > The use case we have right now is in connection with https://github.com/NVIDIA/spark-rapids where we would like