[
https://issues.apache.org/jira/browse/HUDI-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-2919:
----------------------------------
Labels: developer-experience (was: )
> Migrate Hudi to Bazel
> ---------------------
>
> Key: HUDI-2919
> URL: https://issues.apache.org/jira/browse/HUDI-2919
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Alexey Kudinkin
> Priority: Major
> Labels: developer-experience
>
> Even though Maven claims that it supports incremental builds, that is not
> what i personally observed in a day to day operations: even single file
> change trickles down into *whole project* being rebuilt which is currently
> taking about {*}6.5 mins{*}.
> This is a substantial productivity drain, so migration to more modern Build
> System (like Bazel), while not easy, should bring the fruits quite fast,
> paying itself off well over by just how much time we would be saving on not
> waiting for these builds to complete.
>
> {code:java}
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary for Hudi 0.11.0-SNAPSHOT:
> [INFO]
> [INFO] Hudi ............................................... SUCCESS [ 5.150
> s]
> [INFO] hudi-common ........................................ SUCCESS [ 18.957
> s]
> [INFO] hudi-aws ........................................... SUCCESS [ 4.052
> s]
> [INFO] hudi-timeline-service .............................. SUCCESS [ 5.437
> s]
> [INFO] hudi-client ........................................ SUCCESS [ 0.291
> s]
> [INFO] hudi-client-common ................................. SUCCESS [ 13.902
> s]
> [INFO] hudi-hadoop-mr ..................................... SUCCESS [ 5.227
> s]
> [INFO] hudi-spark-client .................................. SUCCESS [ 23.578
> s]
> [INFO] hudi-sync-common ................................... SUCCESS [ 1.630
> s]
> [INFO] hudi-hive-sync ..................................... SUCCESS [ 10.545
> s]
> [INFO] hudi-spark-datasource .............................. SUCCESS [ 0.090
> s]
> [INFO] hudi-spark-common_2.12 ............................. SUCCESS [ 17.497
> s]
> [INFO] hudi-spark3_2.12 ................................... SUCCESS [ 10.558
> s]
> [INFO] hudi-spark_2.12 .................................... SUCCESS [ 46.709
> s]
> [INFO] hudi-utilities_2.12 ................................ SUCCESS [ 9.061
> s]
> [INFO] hudi-utilities-bundle_2.12 ......................... SUCCESS [ 18.046
> s]
> [INFO] hudi-cli ........................................... SUCCESS [ 16.890
> s]
> [INFO] hudi-java-client ................................... SUCCESS [ 3.887
> s]
> [INFO] hudi-flink-client .................................. SUCCESS [ 10.512
> s]
> [INFO] hudi-spark2_2.12 ................................... SUCCESS [ 15.522
> s]
> [INFO] hudi-dla-sync ...................................... SUCCESS [ 2.017
> s]
> [INFO] hudi-sync .......................................... SUCCESS [ 0.075
> s]
> [INFO] hudi-hadoop-mr-bundle .............................. SUCCESS [ 6.188
> s]
> [INFO] hudi-hive-sync-bundle .............................. SUCCESS [ 1.783
> s]
> [INFO] hudi-spark3-bundle_2.12 ............................ SUCCESS [ 17.597
> s]
> [INFO] hudi-presto-bundle ................................. SUCCESS [ 4.982
> s]
> [INFO] hudi-timeline-server-bundle ........................ SUCCESS [ 6.391
> s]
> [INFO] hudi-hadoop-docker ................................. SUCCESS [ 2.110
> s]
> [INFO] hudi-hadoop-base-docker ............................ SUCCESS [ 1.404
> s]
> [INFO] hudi-hadoop-namenode-docker ........................ SUCCESS [ 1.124
> s]
> [INFO] hudi-hadoop-datanode-docker ........................ SUCCESS [ 1.090
> s]
> [INFO] hudi-hadoop-history-docker ......................... SUCCESS [ 1.098
> s]
> [INFO] hudi-hadoop-hive-docker ............................ SUCCESS [ 2.019
> s]
> [INFO] hudi-hadoop-sparkbase-docker ....................... SUCCESS [ 0.993
> s]
> [INFO] hudi-hadoop-sparkmaster-docker ..................... SUCCESS [ 1.106
> s]
> [INFO] hudi-hadoop-sparkworker-docker ..................... SUCCESS [ 1.063
> s]
> [INFO] hudi-hadoop-sparkadhoc-docker ...................... SUCCESS [ 1.031
> s]
> [INFO] hudi-hadoop-presto-docker .......................... SUCCESS [ 1.103
> s]
> [INFO] hudi-integ-test .................................... SUCCESS [ 14.574
> s]
> [INFO] hudi-integ-test-bundle ............................. SUCCESS [ 33.876
> s]
> [INFO] hudi-examples ...................................... SUCCESS [ 9.117
> s]
> [INFO] hudi-flink_2.12 .................................... SUCCESS [ 5.476
> s]
> [INFO] hudi-kafka-connect ................................. SUCCESS [ 3.303
> s]
> [INFO] hudi-flink-bundle_2.12 ............................. SUCCESS [ 21.331
> s]
> [INFO] hudi-kafka-connect-bundle .......................... SUCCESS [ 15.754
> s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 06:34 min
> [INFO] Finished at: 2021-12-02T12:06:21-08:00
> [INFO]
> ------------------------------------------------------------------------
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)