Dear: Wechat group "Apache Linkis(incubating) community Development group "chat records are as follows: 微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下:
————— 2022-11-24 ————— Amphibious Wolf 19:55 Amphibious Wolf 19:55 This code conflicts with spark 3 Amphibious Wolf 19:56 Amphibious Wolf 19:56 Amphibious Wolf 19:56 Anyone with spark3 Mr. Flash 20:09 Bao Yang should be spark3 Xu Ling 20:16 To recompile, you cannot replace it directly Amphibious Wolf 20:16 [Grin] Xu Ling 20:19 Linkis should get rid of json4s and better replaced with Jackson, it doesn't support multiple versions of spark without running Xu Ling 20:19 Scala's version compatibility is terrible Amphibious Wolf 20:20 JavaCollectionSerializer This seems to be the basic class Amphibious Wolf 20:20 Org. Apache. Linkis. RPC. The transform of the bag Amphibious Wolf 20:21 Yes, multi-version spark is a problem Mr. Flash 20:22 Right now, it feels like multiple versions of each engine are difficult peacewong@WDS 20:22 Now the dependency is not that deep, it's already replaceable, rpc doesn't depend on this anymore. Amphibious Wolf 20:22 We recently upgraded from hadoop2.6 to 3.3 peacewong@WDS 20:22 We're gonna have to take out the json4s peacewong@WDS 20:22 [strong] 两栖狼 19:55 两栖狼 19:55 这个代码在spark 3中有冲突 两栖狼 19:56 两栖狼 19:56 两栖狼 19:56 有用spark3的同学吗 闪电先生 20:09 鲍洋同学应该是spark3 许灵 20:16 要重新编译，不能直接替换 两栖狼 20:16 [Grin] 许灵 20:19 Linkis应该去掉json4s最好用Jackson 替换，不跑无法支持多版本的spark 许灵 20:19 Scala的版本兼容性太差了 两栖狼 20:20 JavaCollectionSerializer 这个好像是比较基础的类 两栖狼 20:20 org.apache.linkis.rpc.transform 包里的 两栖狼 20:21 是的 多版本spark 是个问题 闪电先生 20:22 现在感觉，每个引擎的多版本都是很困难的 peacewong@WDS 20:22 现在依赖没那么深了，已经是可以替换的了，rpc不依赖这个了的。 两栖狼 20:22 我们最近hadoop2.6 往 3.3 升级呢 peacewong@WDS 20:22 是得干掉下json4s了 peacewong@WDS 20:22 [强] -- Best Regards ------ 康悦 ritakang GitHub：Ritakang0451 E-mail：rita0...@163.com
