[ 
https://issues.apache.org/jira/browse/METRON-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922340#comment-16922340
 ] 

Dale Richardson commented on METRON-2246:
-----------------------------------------

 

Original code performance (On 2019 MacBook Pro):


{{mvn package -DskipTests -T 2C -P HDP-2.5.0.0,mpack}}
{{cd metron-deployment/}}
{{time mvn clean package -Pbuild-rpms -T 2C}}{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] Reactor Summary:}}
{{[INFO] }}
{{[INFO] metron-deployment 0.7.2 ............................ SUCCESS [ 0.763 
s]}}
{{[INFO] metron-rpm 0.7.2 ................................... SUCCESS [12:21 
min]}}
{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] BUILD SUCCESS}}
{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] Total time: 12:22 min (Wall Clock)}}
{{[INFO] Finished at: 2019-09-04T18:35:12+10:00}}
{{[INFO] 
------------------------------------------------------------------------}}

{{real 12m23.361s}}
{{user 0m11.263s}}
{{sys 0m8.577s}}

{{This PR:}}

{{mvn package -DskipTests -T 2C -P HDP-2.5.0.0,mpack}}
{{cd metron-deployment/}}
{{time mvn clean package -Pbuild-rpms -T 2C}}{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] Reactor Summary:}}
{{[INFO] }}
{{[INFO] metron-deployment 0.7.2 ............................ SUCCESS [ 0.848 
s]}}
{{[INFO] metron-rpm 0.7.2 ................................... SUCCESS [09:28 
min]}}
{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] BUILD SUCCESS}}
{{[INFO] 
------------------------------------------------------------------------}}
{{[INFO] Total time: 09:29 min (Wall Clock)}}
{{[INFO] Finished at: 2019-09-04T19:16:38+10:00}}
{{[INFO] 
------------------------------------------------------------------------}}{{real
 9m30.377s}}
{{user 0m10.831s}}
{{sys 0m7.999s}}

> rpm-docker: minimise use of bind mounts due to performance
> ----------------------------------------------------------
>
>                 Key: METRON-2246
>                 URL: https://issues.apache.org/jira/browse/METRON-2246
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: Dale Richardson
>            Priority: Minor
>
> Docker bind mounts on MacOS have a reputation for being extremely slow.  The 
> rpm-docker module uses bind mounts to share out the rpm-docker project 
> directory to the RPM creation docker image, which then uses it as a workspace 
> when creating the METRON RPMS, and means of pushing the resulting RPM's back 
> to the hosting build box.
> Bind mounts remain the most convenient way of bulk file export from a docker 
> image, but the processes can be sped up by building the rpm-docker image with 
> the input file already included, so that any file I/O by the rpm building 
> process in its workspace does not suffer a performance penalty.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to