|
Many Thanks for the info, Marius. That's an impressive number of
files. You've given me a number of ideas on how to restructure my
rdimport scripts.
On 2/9/2018 12:27, Marius wrote:
Somewhere between 1000-1500 per run, maybe. With larger groups
of files, I usually split them up in multiple runs. Though I use
*.<ext> as <filespec> instead of specifying each
file name.
Marius
On 02/09/2018 08:20 PM, Rich Stivers
wrote:
Marius:
Thanks for the suggestion - I'll try it. In one day, what is
the maximum number of files you have imported this way?
Rich
On 2/9/2018 00:59, Marius wrote:
The rdimport <filespec> parameter does accept
multiple filenames, so you could specify the list of files
with one rdimport-command (with i.e. --metadata-pattern (and
--xml?) parameter(s)).
I usually put a group of files in one folder for each
group/scheduler-code and use rdimport with --metadata-pattern.
Many times --metadata-pattern doesn't like just " - " so I use
rename to replace " - " with "_-_" on files to seperate artist
from title etc.
Marius
On 02/09/2018 05:03 AM, Rich
Stivers wrote:
Our site has thousands of files to import into
Rivendell so I wrote a bash script to generate a large
list of rdimport's. Here's a very short sample -
rdimport --log-mode --normalization-level=-12
--autotrim-level=-29 --segue-level=-20
--set-string-artist="Fort Worth Doughboys (Bob Wills)"
--set-string-title="Sunbonnet Sue"
--set-string-album="San Antonio Rose"
--set-string-label="Bear Family" COUNTRY
"/home/rd/music_import/temp/COUNTRY/Bob Wills & His
Texas Playboys - San Antonio Rose - Bear Family/01/01 -
Fort Worth Doughboys (Bob Wills) - Sunbonnet Sue.flac"
rdimport --log-mode --normalization-level=-12
--autotrim-level=-29 --segue-level=-20
--set-string-artist="Fort Worth Doughboys (Bob Wills)"
--set-string-title="Nancy Jane" --set-string-album="San
Antonio Rose" --set-string-label="Bear Family" COUNTRY
"/home/rd/music_import/temp/COUNTRY/Bob Wills & His
Texas Playboys - San Antonio Rose - Bear Family/01/02 -
Fort Worth Doughboys (Bob Wills) - Nancy Jane.flac"
rdimport --log-mode --normalization-level=-12
--autotrim-level=-29 --segue-level=-20
--set-string-artist="Bob Wills & His Texas Playboys"
--set-string-title="Osage Stomp" --set-string-album="San
Antonio Rose" --set-string-label="Bear Family" COUNTRY
"/home/rd/music_import/temp/COUNTRY/Bob Wills & His
Texas Playboys - San Antonio Rose - Bear Family/01/03 -
Osage Stomp.flac"
I usually save the output of import scripts into
a log file like this - import-script |& tee
logfile.txt
This method works fine for lists less than
600-700 files. If the list is longer it could eventually
hang the terminal window, and partially hang linux. Once
the PC is in this state, existing terminal windows still
operate normally, but I can't create any new terminal
windows. I can't do a simple restart after the terminal
window hangs. I must do a complete power-down then
startup to put the workstation back to normal. Sometimes
it takes a couple of power-downs/startups to return the
PC to normal operation.
The number of rdimport'ed files is accumulative
for the entire PC once it boots. So if I import 500
files successfully, then try to import another 500 in
the same terminal window, the system will hang. If I
import 500 files successfully, then try to import
another 500 in a different terminal window, the system
will hang.
While my rdimport script is running, Gnome System
Monitor says memory usage is at most 10%-15% of 4GB. CPU
usage is 100% but that is expected. I've looked in
/var/log/messages but found nothing I could understand
that would give me a clue to why linux get in a
semi-hung state.
Has anyone seen/solved a problem like this
before? I'm in a quandary as to how to determine the
cause of this (ill-formed script?, Rivendell problem?,
linux performance issue?, etc.).
I'm running the latest version of Rivendell and
Centos 6, originally built from the appliance disk.
I'm also interested in how all of you use
rdimport to import large quantities of files.
Thanks for reading this long post! All comments
welcome.
Rich Stivers
KKUP-FM 91.5
Cupertino/San Jose CA
_______________________________________________
Rivendell-dev mailing list
[email protected]
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
_______________________________________________
Rivendell-dev mailing list
[email protected]
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
_______________________________________________
Rivendell-dev mailing list
[email protected]
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
_______________________________________________
Rivendell-dev mailing list
[email protected]
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
|
_______________________________________________
Rivendell-dev mailing list
[email protected]
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
