We have written a python scheduler which is using the mmlsfileset command. By options we can decide how many filesets are backed up in parallel.

Stephan

On 9/6/23 11:44, Christian Petersson wrote:
Just a follow up question, how do you backup multiple filesets?
We have a 50 filesets to backup, at the moment do we have a text file that contains all of them and we run a for loop. But that is not at all scalable.

Is it any other ways that are much better?

/Christian

ons 6 sep. 2023 kl. 11:35 skrev Marcus Koenig <[email protected] <mailto:[email protected]>>:

    I'm using this one liner to get the progress

    grep 'mmbackup:Backup job finished'|cut -d ":" -f 6|awk '{print
    $1}'|awk '{s+=$1}END{print s}'

    That can be compared to the files identified during the scan.

    On Wed, 6 Sept 2023, 21:29 Stephan Graf, <[email protected]
    <mailto:[email protected]>> wrote:

        Hi

        I think it should be possible because mmbackup know, how many
        files are
        to be backed up, which have been already processed and how many are
        still to go.

        BTW it would also be nice to have an option in mmbackup to generate
        machine readable log file like JSON or CSV.

        But the right way to ask for a new feature or to look if there is
        already a request open is the IBM IDEA portal:

        https://ideas.ibm.com <https://ideas.ibm.com>

        Stephan

        On 9/6/23 11:02, Jonathan Buzzard wrote:
         >
         > Would it be possible to have the mmbackup output display the
        percentage
         > output progress when backing up files?
         >
         > So at the top we you see something like this
         >
         > Tue Sep  5 23:13:35 2023 mmbackup:changed=747204,
        expired=427702,
         > unsupported=0 for server [XXXX]
         >
         > Then after it does the expiration you see during the backup
        lines like
         >
         > Wed Sep  6 02:43:53 2023 mmbackup:Backing up files: 527024
        backed up,
         > 426018 expired, 4408 failed. (Backup job exit with 4)
         >
         > It would IMHO be helpful if it looked like
         >
         > Wed Sep  6 02:43:53 2023 mmbackup:Backing up files: 527024
        (70.5%)
         > backed up, 426018 (100%) expired, 4408 failed. (Backup job
        exit with 4)
         >
         > Just based on the number of files. Though as I look at it now
        I am
         > curious about the discrepancy in the number of files expired,
        given that
         > the expiration stage allegedly concluded with no errors?
         >
         > Tue Sep  5 23:21:49 2023 mmbackup:Completed policy expiry run
        with 0
         > policy errors, 0 files failed, 0 severe errors, returning rc=0.
         > Tue Sep  5 23:21:49 2023 mmbackup:Policy for expiry returned
        0 Highest
         > TSM error 0
         >
         >
         >
         > JAB.
         >

-- Stephan Graf
        Juelich Supercomputing Centre

        Phone:  +49-2461-61-6578
        Fax:    +49-2461-61-6656
        E-mail: [email protected] <mailto:[email protected]>
        WWW: http://www.fz-juelich.de/jsc/ <http://www.fz-juelich.de/jsc/>
        
---------------------------------------------------------------------------------------------
        
---------------------------------------------------------------------------------------------
        Forschungszentrum Juelich GmbH
        52425 Juelich
        Sitz der Gesellschaft: Juelich
        Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
        Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
        Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt
        (Vorsitzender),
        Karsten Beneke (stellv. Vorsitzender), Dr. Astrid Lambrecht,
        Prof. Dr. Frauke Melchior
        
---------------------------------------------------------------------------------------------
        
---------------------------------------------------------------------------------------------
        _______________________________________________
        gpfsug-discuss mailing list
        gpfsug-discuss at gpfsug.org <http://gpfsug.org>
        http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
        <http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org>

    _______________________________________________
    gpfsug-discuss mailing list
    gpfsug-discuss at gpfsug.org <http://gpfsug.org>
    http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
    <http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org>


_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org

--
Stephan Graf
Juelich Supercomputing Centre

Phone:  +49-2461-61-6578
Fax:    +49-2461-61-6656
E-mail: [email protected]
WWW:    http://www.fz-juelich.de/jsc/
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Dr. Astrid Lambrecht,
Prof. Dr. Frauke Melchior
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org

Reply via email to