Happy to help. :)

Marius

On 02/09/2018 09:53 PM, Rich Stivers wrote:

Many Thanks for the info, Marius. That's an impressive number of files. You've given me a number of ideas on how to restructure my rdimport scripts.


On 2/9/2018 12:27, Marius wrote:

Somewhere between 1000-1500 per run, maybe. With larger groups of files, I usually split them up in multiple runs. Though I use *.<ext> as <filespec> instead of specifying each file name.

Marius
On 02/09/2018 08:20 PM, Rich Stivers wrote:

Marius:

Thanks for the suggestion - I'll try it.  In one day, what is the maximum number of files you have imported this way?

Rich


On 2/9/2018 00:59, Marius wrote:

The rdimport <filespec> parameter does accept multiple filenames, so you could specify the list of files with one rdimport-command (with i.e. --metadata-pattern (and --xml?) parameter(s)).

I usually put a group of files in one folder for each group/scheduler-code and use rdimport with --metadata-pattern. Many times --metadata-pattern doesn't like just " - " so I use rename to replace " - " with "_-_" on files to seperate artist from title etc.
Marius
On 02/09/2018 05:03 AM, Rich Stivers wrote:

Our site has thousands of files to import into Rivendell so I wrote a bash script to generate a large list of rdimport's. Here's a very short sample -

rdimport --log-mode --normalization-level=-12 --autotrim-level=-29 --segue-level=-20 --set-string-artist="Fort Worth Doughboys (Bob Wills)" --set-string-title="Sunbonnet Sue" --set-string-album="San Antonio Rose" --set-string-label="Bear Family" COUNTRY "/home/rd/music_import/temp/COUNTRY/Bob Wills & His Texas Playboys - San Antonio Rose - Bear Family/01/01 - Fort Worth Doughboys (Bob Wills) - Sunbonnet Sue.flac" rdimport --log-mode --normalization-level=-12 --autotrim-level=-29 --segue-level=-20 --set-string-artist="Fort Worth Doughboys (Bob Wills)" --set-string-title="Nancy Jane" --set-string-album="San Antonio Rose" --set-string-label="Bear Family" COUNTRY "/home/rd/music_import/temp/COUNTRY/Bob Wills & His Texas Playboys - San Antonio Rose - Bear Family/01/02 - Fort Worth Doughboys (Bob Wills) - Nancy Jane.flac" rdimport --log-mode --normalization-level=-12 --autotrim-level=-29 --segue-level=-20 --set-string-artist="Bob Wills & His Texas Playboys" --set-string-title="Osage Stomp" --set-string-album="San Antonio Rose" --set-string-label="Bear Family" COUNTRY "/home/rd/music_import/temp/COUNTRY/Bob Wills & His Texas Playboys - San Antonio Rose - Bear Family/01/03 - Osage Stomp.flac"

I usually save the output of import scripts into a log file like this -import-script |& tee logfile.txt

This method works fine for lists less than 600-700 files. If the list is longer it could eventually hang the terminal window, and partially hang linux. Once the PC is in this state, existing terminal windows still operate normally, but I can't create any new terminal windows. I can't do a simple restart after the terminal window hangs. I must do a complete power-down then startup to put the workstation back to normal. Sometimes it takes a couple of power-downs/startups to return the PC to normal operation.

The number of rdimport'ed files is accumulative for the entire PC once it boots. So if I import 500 files successfully, then try to import another 500 in the same terminal window, the system will hang. If I import 500 files successfully, then try to import another 500 in a different terminal window, the system will hang.

While my rdimport script is running, Gnome System Monitor says memory usage is at most 10%-15% of 4GB. CPU usage is 100% but that is expected. I've looked in /var/log/messages but found nothing I could understand that would give me a clue to why linux get in a semi-hung state.

Has anyone seen/solved a problem like this before? I'm in a quandary as to how to determine the cause of this (ill-formed script?, Rivendell problem?, linux performance issue?, etc.).

I'm running the latest version of Rivendell and Centos 6, originally built from the appliance disk.

I'm also interested in how all of you use rdimport to import large quantities of files.

Thanks for reading this long post! All comments welcome.

Rich Stivers
KKUP-FM 91.5
Cupertino/San Jose CA




_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

_______________________________________________
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Reply via email to