Re: [RDD] RDImport question

[Rob Landry]

On Mon, 22 Aug 2022, chris cottingham wrote:

Will rdimport traverse sub folders? Do I need to have all the audio I 
want to import in the root of the import folder?


It will not look in subfolders.

I wrote a Perl script to manage my Rivendell imports. I did so because 1) 
I want to keep a log of all uploads and what happens to them; and 2) I 
want unimportable files moved into /home/rd/dropbox/bad.


Upload folders are set up in /home/rd/dropbox; each has the name of a 
corresponding Rivendell group, e.g. /home/rd/dropbox/NEWS, 
/home/rd/dropbox/SPOTS, etc. In addition, there is a /home/rd/dropbox/bad 
and a /home/rd/dropbox/[call letters]; these are not scanned by the 
script. The [call letters] folder has subfolders "traffic", "music", and 
"aired" and is used for daily logs; depending on the station, there may be 
additional subfolders. Nothing in the bad or [call letters] folders are 
scanned by the script.


The script will normally assign any file it finds to a new cart; however, 
if the file's name is a cart number, it will be imported into that cart, 
wiping out any existing cuts.


If the file's name is a cart number followed by a letter (e.g. 
"4101a.wav"), it will be imported into the cart as an additional cut, 
leaving in place any cuts already in the cart.


This makes it easy to import an entire rotation at once; for instance, 
carts uploaded as 4109.mp3, 4109a.mp3, 4109b.mp3, and 4109c.mp3 will be 
imported in that order, the first one wiping out any previous cuts in the 
cart and the others being imported as additional cuts after it. This is a 
big time saver.


If Enforce Cart Range is selected for a group and a file is uploaded with 
a number not eligible for the group, the import will fail and the file 
will go into bad. This is to prevent someone overwriting, say, a song with 
a newscast. I also don't have upload folders in /home/rd/dropbox for 
groups that don't need them.


I take precautions to insure only authorized uploads are allowed.

If anyone is interested, I'll be happy to post the script.


Rob

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport question

[David Henderson]

I think it only looks in the folder specified. We have several different 
folders for different types of audio, just make a new dropbox rule for 
each folder, then whenever audio is copied into that folder, it should 
get picked up. If you have told Rivendell to convert from MP3 to WAV 
then it will do that too.


---
Kind regards,

David Henderson

TD9 Radio - Community Radio for Hawick


www.td9radio.online
www.twitter.com/TD9Radio
www.facebook.com/TD9Radio

TD9 Radio is a Scottish Charitable Incorporated Organisation (SCIO) - 
registered with OSCR - SC051870.


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport question

[chris cottingham]

Will rdimport traverse sub folders? Do I need to have all the audio I want to 
import in the root of the import folder?

It’s my understanding that rdimport will import mp3 files and read the 
metadata. It will also “wrap” the imported mp3 files as a “wav” file. Is this 
true as well?

Thanks!!
Sent from my iPhone
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Dave B]

I’m going to bulk rename the files and adjust my script accordingly. That seems 
be the easiest way to go. Thanks for the input.

Sent from my iPad

> On Jul 11, 2021, at 1:00 AM, Robert Jeffares  
> wrote:
> 
> 
> The audio filename is going to be xx_001.wav 
> 
> Artist and Title are stored in MySQL [or MariaDB ]  where [] are allowed in 
> strings.
> 
> --set-string-artist=should work with []" <--tested and it does
> 
> --set-string-title="same"
> 
> I just checked this on a copy of the same OS.  If the source audio filename 
> has [] brackets in it  rdimport does not work.
> 
> I tried with wildcard complete and \[ escapes. 
> 
> *BUT*  using --set-string-artist= allows [] to be used.
> 
> I have tried various bash tricks to no avail. 
> 
> I would be for changing the filenames using sed to replace [ with  a phrase 
> like 'b4'  and ] with a phrase like 'b8' and using the import script to 
> substitute occurrences in the   --set-string-artist="" string. Simple enough 
> to use an if then test like if grep -q artist_part_of_filename 'b4' then 
> replace b4 with a [ in the string being used for artist="" 
> 
> Or you can get into mysql and do a global replace where b4  and b8 occurs in 
> the title;
> 
> Migrating from one library to another can be a challenge. If you have less 
> then 20 you can do them by hand but anything more is a bash proposition or 
> perl or python or whatever rocks your boat!
> 
> If you go the MySQL route make a copy of the DB before you attempt any 
> changes.
> 
> regards
> 
> Robert
> 
> 
> 
> 
> 
> 
> 
>> On 11/07/21 12:59 am, Dave B wrote:
>> I should also note that the title and outcue (set in the script like 
>> --set-string-title="my title") may also contain brackets but that doesn't 
>> appear to be a problem. It's only setting a filename with brackets that's 
>> problematic.
>> 
>> Using the latest Rivendell version on CentOS 7.
>> 
>> On Jul 10, 2021 6:38 AM, Dave B  wrote:
>> I'm using the full file names because I'm also setting the talk and segue 
>> markers and scheduler codes, etc via the script. The files do contain 
>> metadata but for some reason rdimport doesn't always read the artist field. 
>> I'll try importing some files using wildcards in the filespec  (*.flac) and 
>> see how that goes.
>> 
>> On Jul 9, 2021 9:46 PM, Robert Jeffares  wrote:
>> Hi Dave,
>> 
>> have you tried rdimport  [options] [GROUP] *.flac ?
>> 
>> or is it falling down in the  --metadata-pattern='%a - %t.flac'
>> 
>> Are you using CentOS or something else?
>> 
>> Do the flac files have metadata?
>> 
>> From memory [] brackets are not usually a problem
>> 
>> regards
>> 
>> Robert
>> 
>> On 10/07/21 7:03 am, Dave wrote:
>> > Hi all,
>> > I'm about to use rdimport to import a couple of music libraries into 
>> > Rivendell via a shell script. In testing it works great except for the 
>> > fact rdimport does not like file names containing an open bracket ([). 
>> > For example, if I enter the file name using a double quote as "'N Sync 
>> > - This I Promise You [Radio Edit].flac" it will fail. If I use singles 
>> > quotes and escape the single quote in the file name it also fails. 
>> > '\''N Sync - This I Promise You [Radio Edit].flac'. I've tried 
>> > escaping the bracket to no avail. The only way I can import these 
>> > files via rdimport is to rename the file without the brackets. I can 
>> > import files with brackets manually via the rdlibrary GUIwith no 
>> > problem. Any suggestions?
>> >
>> > Thanks,
>> > Dave
>> > ___
>> > Rivendell-dev mailing list
>> > Rivendell-dev@lists.rivendellaudio.org
>> > http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>> 
>> -- 
>> Robert Jeffares
>> Communication Consultants
>> 64 Warner Park Avenue
>> Laingholm
>> Auckland
>> New Zealand 0604
>> +64 9 817 6358
>> 
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>> 
>> 
>> 
> -- 
> Robert Jeffares
> Communication Consultants
> 64 Warner Park Avenue
> Laingholm
> Auckland
> New Zealand 0604
> +64 9 817 6358
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Robert Jeffares]

The audio filename is going to be xx_001.wav

Artist and Title are stored in MySQL [or MariaDB ]  where [] are allowed 
in strings.


--set-string-artist=should work with []" <--tested and it does

--set-string-title="same"

I just checked this on a copy of the same OS.  If the *source audio 
filename* has [] brackets in it  rdimport does not work.


I tried with wildcard complete and \[ escapes.

*BUT*  using --set-string-artist= allows [] to be used.

I have tried various bash tricks to no avail.

I would be for changing the filenames using sed to replace [ with  a 
phrase like 'b4'  and ] with a phrase like 'b8' and using the import 
script to substitute occurrences in the --set-string-artist="" string. 
Simple enough to use an if then test like if grep -q 
artist_part_of_filename 'b4' then replace b4 with a [ in the string 
being used for artist=""


Or you can get into mysql and do a global replace where b4  and b8 
occurs in the title;


Migrating from one library to another can be a challenge. If you have 
less then 20 you can do them by hand but anything more is a bash 
proposition or perl or python or whatever rocks your boat!


If you go the MySQL route make a copy of the DB before you attempt any 
changes.


regards

Robert




On 11/07/21 12:59 am, Dave B wrote:
I should also note that the title and outcue (set in the script like 
--set-string-title="my title") may also contain brackets but that 
doesn't appear to be a problem. It's only setting a filename with 
brackets that's problematic.


Using the latest Rivendell version on CentOS 7.

On Jul 10, 2021 6:38 AM, Dave B  wrote:

I'm using the full file names because I'm also setting the talk
and segue markers and scheduler codes, etc via the script. The
files do contain metadata but for some reason rdimport doesn't
always read the artist field. I'll try importing some files using
wildcards in the filespec  (*.flac) and see how that goes.

On Jul 9, 2021 9:46 PM, Robert Jeffares
 wrote:

Hi Dave,

have you tried rdimport  [options] [GROUP] *.flac ?

or is it falling down in the --metadata-pattern='%a - %t.flac'

Are you using CentOS or something else?

Do the flac files have metadata?

From memory [] brackets are not usually a problem

regards

Robert

On 10/07/21 7:03 am, Dave wrote:
> Hi all,
> I'm about to use rdimport to import a couple of music
libraries into
> Rivendell via a shell script. In testing it works great
except for the
> fact rdimport does not like file names containing an open
bracket ([).
> For example, if I enter the file name using a double quote
as "'N Sync
> - This I Promise You [Radio Edit].flac" it will fail. If I
use singles
> quotes and escape the single quote in the file name it also
fails.
> '\''N Sync - This I Promise You [Radio Edit].flac'. I've tried
> escaping the bracket to no avail. The only way I can import
these
> files via rdimport is to rename the file without the
brackets. I can
> import files with brackets manually via the rdlibrary
GUIwith no
> problem. Any suggestions?
>
> Thanks,
> Dave
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

-- 
Robert Jeffares

Communication Consultants
64 Warner Park Avenue
Laingholm
Auckland
New Zealand 0604
+64 9 817 6358

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev




--
Robert Jeffares
Communication Consultants
64 Warner Park Avenue
Laingholm
Auckland
New Zealand 0604
+64 9 817 6358

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Mike Carroll]

Square brackets are glob characters in file names (they're a regex list
indicator).  Maybe try disabling file globbing? That disables all of the
file expansion characters.  "set -f" to turn off, "set +f" to turn back on.

Mike

On Sat, Jul 10, 2021 at 10:17 AM Dave  wrote:

> rdimport will successfully import these files using the form rdimport
> [options] [GROUP] *.flac
>
> I can only think that the brackets are being interpreted by the script
> in some way and sending bad information to rdimport.
>
> On 7/9/2021 9:46 PM, Robert Jeffares wrote:
> > Hi Dave,
> >
> > have you tried rdimport  [options] [GROUP] *.flac ?
> >
> > or is it falling down in the  --metadata-pattern='%a - %t.flac'
> >
> > Are you using CentOS or something else?
> >
> > Do the flac files have metadata?
> >
> > From memory [] brackets are not usually a problem
> >
> > regards
> >
> > Robert
> >
> > On 10/07/21 7:03 am, Dave wrote:
> >> Hi all,
> >> I'm about to use rdimport to import a couple of music libraries into
> >> Rivendell via a shell script. In testing it works great except for
> >> the fact rdimport does not like file names containing an open bracket
> >> ([). For example, if I enter the file name using a double quote as
> >> "'N Sync - This I Promise You [Radio Edit].flac" it will fail. If I
> >> use singles quotes and escape the single quote in the file name it
> >> also fails. '\''N Sync - This I Promise You [Radio Edit].flac'. I've
> >> tried escaping the bracket to no avail. The only way I can import
> >> these files via rdimport is to rename the file without the brackets.
> >> I can import files with brackets manually via the rdlibrary GUIwith
> >> no problem. Any suggestions?
> >>
> >> Thanks,
> >> Dave
> >> ___
> >> Rivendell-dev mailing list
> >> Rivendell-dev@lists.rivendellaudio.org
> >> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
> >
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Dave]

rdimport will successfully import these files using the form rdimport  
[options] [GROUP] *.flac


I can only think that the brackets are being interpreted by the script 
in some way and sending bad information to rdimport.


On 7/9/2021 9:46 PM, Robert Jeffares wrote:

Hi Dave,

have you tried rdimport  [options] [GROUP] *.flac ?

or is it falling down in the  --metadata-pattern='%a - %t.flac'

Are you using CentOS or something else?

Do the flac files have metadata?

From memory [] brackets are not usually a problem

regards

Robert

On 10/07/21 7:03 am, Dave wrote:

Hi all,
I'm about to use rdimport to import a couple of music libraries into 
Rivendell via a shell script. In testing it works great except for 
the fact rdimport does not like file names containing an open bracket 
([). For example, if I enter the file name using a double quote as 
"'N Sync - This I Promise You [Radio Edit].flac" it will fail. If I 
use singles quotes and escape the single quote in the file name it 
also fails. '\''N Sync - This I Promise You [Radio Edit].flac'. I've 
tried escaping the bracket to no avail. The only way I can import 
these files via rdimport is to rename the file without the brackets. 
I can import files with brackets manually via the rdlibrary GUIwith 
no problem. Any suggestions?


Thanks,
Dave
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Dave B]

I'm using the full file names because I'm also setting the talk and segue markers and scheduler codes, etc via the script. The files do contain metadata but for some reason rdimport doesn't always read the artist field. I'll try importing some files using wildcards in the filespec  (*.flac) and see how that goes.On Jul 9, 2021 9:46 PM, Robert Jeffares  wrote:Hi Dave,
have you tried rdimport  [options] [GROUP] *.flac ?
or is it falling down in the  --metadata-pattern='%a - %t.flac'
Are you using CentOS or something else?
Do the flac files have metadata?
 From memory [] brackets are not usually a problem
regards
Robert
On 10/07/21 7:03 am, Dave wrote:
> Hi all,
> I'm about to use rdimport to import a couple of music libraries into 
> Rivendell via a shell script. In testing it works great except for the 
> fact rdimport does not like file names containing an open bracket ([). 
> For example, if I enter the file name using a double quote as "'N Sync 
> - This I Promise You [Radio Edit].flac" it will fail. If I use singles 
> quotes and escape the single quote in the file name it also fails. 
> '\''N Sync - This I Promise You [Radio Edit].flac'. I've tried 
> escaping the bracket to no avail. The only way I can import these 
> files via rdimport is to rename the file without the brackets. I can 
> import files with brackets manually via the rdlibrary GUIwith no 
> problem. Any suggestions?
>
> Thanks,
> Dave
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
-- 
Robert Jeffares
Communication Consultants
64 Warner Park Avenue
Laingholm
Auckland
New Zealand 0604
+64 9 817 6358
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport fails on file names with brackets

[Robert Jeffares]

Hi Dave,

have you tried rdimport  [options] [GROUP] *.flac ?

or is it falling down in the  --metadata-pattern='%a - %t.flac'

Are you using CentOS or something else?

Do the flac files have metadata?

From memory [] brackets are not usually a problem

regards

Robert

On 10/07/21 7:03 am, Dave wrote:

Hi all,
I'm about to use rdimport to import a couple of music libraries into 
Rivendell via a shell script. In testing it works great except for the 
fact rdimport does not like file names containing an open bracket ([). 
For example, if I enter the file name using a double quote as "'N Sync 
- This I Promise You [Radio Edit].flac" it will fail. If I use singles 
quotes and escape the single quote in the file name it also fails. 
'\''N Sync - This I Promise You [Radio Edit].flac'. I've tried 
escaping the bracket to no avail. The only way I can import these 
files via rdimport is to rename the file without the brackets. I can 
import files with brackets manually via the rdlibrary GUIwith no 
problem. Any suggestions?


Thanks,
Dave
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Robert Jeffares
Communication Consultants
64 Warner Park Avenue
Laingholm
Auckland
New Zealand 0604
+64 9 817 6358

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport fails on file names with brackets

[Dave]

Hi all,
I'm about to use rdimport to import a couple of music libraries into 
Rivendell via a shell script. In testing it works great except for the 
fact rdimport does not like file names containing an open bracket ([). 
For example, if I enter the file name using a double quote as "'N Sync - 
This I Promise You [Radio Edit].flac" it will fail. If I use singles 
quotes and escape the single quote in the file name it also fails. '\''N 
Sync - This I Promise You [Radio Edit].flac'. I've tried escaping the 
bracket to no avail. The only way I can import these files via rdimport 
is to rename the file without the brackets. I can import files with 
brackets manually via the rdlibrary GUIwith no problem. Any suggestions?


Thanks,
Dave
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport Notifications

[Fred Gleason]

On Jun 26, 2021, at 20:28, wa7skg  wrote:

> While working on another issue, I took a look at /var/log/boot.log. I had 
> recently imported a bunch of music to the library with rdimport. I find these 
> entries in boot.log:
> 
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" to 
> 239.192.255.72:20539
> Jun 26 17:00:41 rd2 ripcd: closed connection 4
> Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
> Jun 26 17:00:41 rd2 ripcd: added new connection 4
> Jun 26 17:00:41 rd2 rdxport.cgi: processing RDXPORT_COMMAND_TRIMAUDIO
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" to 
> 239.192.255.72:20539
> Jun 26 17:00:41 rd2 ripcd: closed connection 4
> Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART ADD 35741" to 
> 239.192.255.72:20539
> 
> First, I don't understand why there are a bunch of Rivendell status stuff in 
> the boot.log to begin with.
> 
> Second, where/what is IP address 239.192.255.72 and why is Rivendell sending 
> any notifications to it? Is this a security thing? Is it required? Can I stop 
> it?

As Chris mentioned earlier, those are local (‘administratively scoped’ to be 
precise) multicast messages. Starting with v3.x, Rivendell uses those to notify 
modules that some object (cart, log, whatever) has been added/deleted/changed. 
In the example you quote, cart 35741 was changed. Say, rdairplay(1) had a log 
loaded that included that cart, it would know to update the widgets displaying 
that cart. Likewise, other Rivendell instances can receive these messages and 
keep their views up to date.

Yes, it is required for proper operation. The exact address used for such 
updates can be set in RDAdmin->SystemSettings, although the default value 
should be fine for the overwhelming majority of situations.

As for these entries appearing in ‘boot.log’, I couldn’t say. Doesn’t sound 
right!

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport Notifications

[chris cottingham]

I can’t answer the specific rd questions but I can tell you that the 239. 
Address is a multicast address that is only locally relevant. This address will 
not cross a router boundary and requires igmp to be enabled on your switch the 
function properly. 

I’ll let the other guys chime in on what the multicast address is used for. 

N5CWC, 73



Sent from my iPhone

> On Jun 26, 2021, at 5:29 PM, wa7skg  wrote:
> 
> While working on another issue, I took a look at /var/log/boot.log. I had 
> recently imported a bunch of music to the library with rdimport. I find these 
> entries in boot.log:
> 
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" to 
> 239.192.255.72:20539
> Jun 26 17:00:41 rd2 ripcd: closed connection 4
> Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
> Jun 26 17:00:41 rd2 ripcd: added new connection 4
> Jun 26 17:00:41 rd2 rdxport.cgi: processing RDXPORT_COMMAND_TRIMAUDIO
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" to 
> 239.192.255.72:20539
> Jun 26 17:00:41 rd2 ripcd: closed connection 4
> Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
> Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART ADD 35741" to 
> 239.192.255.72:20539
> 
> First, I don't understand why there are a bunch of Rivendell status stuff in 
> the boot.log to begin with.
> 
> Second, where/what is IP address 239.192.255.72 and why is Rivendell sending 
> any notifications to it? Is this a security thing? Is it required? Can I stop 
> it?
> 
> 
> -- 
> 73,
> Michael WA7SKG
> 
> "Any day you do not learn one new thing is a wasted day."
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport Notifications

[wa7skg]

While working on another issue, I took a look at /var/log/boot.log. I 
had recently imported a bunch of music to the library with rdimport. I 
find these entries in boot.log:


Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" 
to 239.192.255.72:20539

Jun 26 17:00:41 rd2 ripcd: closed connection 4
Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
Jun 26 17:00:41 rd2 ripcd: added new connection 4
Jun 26 17:00:41 rd2 rdxport.cgi: processing RDXPORT_COMMAND_TRIMAUDIO
Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART MODIFY 35741" 
to 239.192.255.72:20539

Jun 26 17:00:41 rd2 ripcd: closed connection 4
Jun 26 17:00:41 rd2 ripcd: cleaned up connection 4
Jun 26 17:00:41 rd2 ripcd: sent notification: "NOTIFY CART ADD 35741" to 
239.192.255.72:20539


First, I don't understand why there are a bunch of Rivendell status 
stuff in the boot.log to begin with.


Second, where/what is IP address 239.192.255.72 and why is Rivendell 
sending any notifications to it? Is this a security thing? Is it 
required? Can I stop it?



--
73,
Michael WA7SKG

"Any day you do not learn one new thing is a wasted day."
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport issue

[David Klann]

Hi Michael,

On 3/4/21 03:26, wa7skg wrote:
>
> Well, I messed up a bit. Had a special situation to load some music for
> a particular purpose. I created a group "Special-M" and assigned cart
> numbers 5-50500 with "Enforced Cart Number" checked. The music was
> copied into a folder and I ran rdimport to load it all into the library.
>

For this and similar reasons, I've chosen to set up new Groups with
specific cart number ranges, but leaving "Enforce Cart Range" unchecked.
This makes it easier to move carts between groups. May not fit your use
case or workflow, but I think there's no harm in *not* enforcing ranges
in a group. I'd love to hear others' thoughts on this.

> Everything ran fine and I thought I was good. My mistake was in not
> counting the songs. I thought there were about 300 songs. Checking after
> rdimport ran showed all 500 cart numbers used. That's when I checked the
> folder and found there were 794 songs. So, I edited the group to allow
> 1000 carts. The question is, how do I now run rdimport again on the
> folder to get the remaining 294 songs loaded? I don't want any
> duplicates and I'm not sure which 500 of the 794 carts loaded.
>
> The only thing that comes to my mind is to delete that group, create a
> new group with enough cart numbers and re-import all 794 songs.
>

If the metadata is "good" in the audio files (and thus in the Rivendell
Library), one *could* write a script to look up Cart titles, artists,
etc. and skip importing them, but for this small number of tracks it
might be easier to, as you say, delete the group (and all the Carts in
it), and start over.

Let me know if you'd like some help with a script. It would be something
like:

   for file in *.ogg ; do
 f_artist=$(get metadata artist from "${file}")
 f_title=$(get metadata title from "${file}")
 f_album=$(get metadata album from "${file}")
 db_cartnum=$(mysql --options Rivendell -e "select NUMBER from CART
where GROUP_NAME = 'your-group-name' and ARTIST='${f_artist}' and TITLE=
'${f_title}' and ALBUM='${f_album}')
 [[ -n "${db_cartnum}" ]] && continue
 rdimport GROUPNAME "${file}"
   done

   ~David

>
> Thanks for your suggestions.
>
> --
> 73,
> Michael WA7SKG


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport issue

[wa7skg]

Well, I messed up a bit. Had a special situation to load some music for 
a particular purpose. I created a group "Special-M" and assigned cart 
numbers 5-50500 with "Enforced Cart Number" checked. The music was 
copied into a folder and I ran rdimport to load it all into the library.


Everything ran fine and I thought I was good. My mistake was in not 
counting the songs. I thought there were about 300 songs. Checking after 
rdimport ran showed all 500 cart numbers used. That's when I checked the 
folder and found there were 794 songs. So, I edited the group to allow 
1000 carts. The question is, how do I now run rdimport again on the 
folder to get the remaining 294 songs loaded? I don't want any 
duplicates and I'm not sure which 500 of the 794 carts loaded.


The only thing that comes to my mind is to delete that group, create a 
new group with enough cart numbers and re-import all 794 songs.



Thanks for your suggestions.

--
73,
Michael WA7SKG

"Any day you do not learn one new thing is a wasted day."
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport 3.5.0 Fails to Import Using Cart Chunk Data

[David Klann]

Greetings Friends!

Just a heads up regarding rdimport(1) on the latest 3.5.0 release of 
Rivendell. Using the "--use-cartchunk-cutid" option to set the Rivendell 
Cart number from the source audio file causes rdimport to fail.

I have opened Github Issue #636 for this. I have also devised a 
work-around, but I do not like the solution.

I believe the problem is with the QString method toUInt(); it seems to 
use the size attribute of the string instead of the string's first NULL 
character to determine the end of the string.

More details in my several comments on the issue at 
https://github.com/ElvishArtisan/rivendell/issues/636

I'll submit a Github pull request with patched code if someone can 
suggest a better method for discerning the actual length of the cart 
number extracted from the Cart Chunk data in the file.

Thanks!

   ~David Klann

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport

[Fred Gleason]

On May 29, 2020, at 11:18, Chester Graham  wrote:

> Also, you have to work on the directory containing the audio files, it will 
> ignore any subdirectories.

Recursion can be done with a little scripting. For example, see:


https://github.com/ElvishArtisan/rivendell-importers/blob/master/audio/nested-import.pl

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport

[Robert Jeffares]

Hi Chris

rdimport --verbose --segue-level=-10 MUSIC /home/rd/music_import/"1987 - 
Alphabet City"/*.mp3


is going to give you what you want. More or less

If the mp3's don't have tags add

--metadata-pattern="%a - %l - %i - %t.mp3"

Questions answered in line.

On 30/05/20 1:17 am, Sojo Gold wrote:

Hi
I'm having a few games with rdimport please could you guys give me a 
heads up!.


My command line;
[rd@rivhsr ~]$ rdimport --verbose --segue-level=-10 MUSIC *.mp3 
/home/rd/music_import/"1987 - Alphabet City"/


My Audio file structure;
music_import/
    1987 - Alphabet City/
 ABC - 
Alphabet City - 01 - Avenue.mp3
 ABC - 
Alphabet City - 02 - When Smokey Sings.mp3
 ABC - 
Alphabet City - 03 - The Night You Murdered Love.mp3

etc...
My verbose output;
rdimport started
RDImport v3.4.0

...
Import Create Dates mode is OFF
Files to process:
  "/home/rd/music_import/1987 - Alphabet City/"
rdimport finished
[rd@rivhsr ~]$
However, there are no carts in RDLibrary

This is where a few questions arose..(which I cannot find in the 
listings or wiki)

1. do I need to be root/sudo

no

2. Do I need to be in the directory of the actual mp3's

no as long asthe path is correct and you have permissions on the files

3. Will this work over a samba/nfs share.

yep
I also tried the Perl importer (nested-import.pl) and found it will 
not work as per /rdimport/ and it will not parse the rdimport options 
like /--autotrim-level=-30/ either.

have no knowledge of this


Some help would be appreciated muchly..
Chris Perkins



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Communication Consultants 2020 Limited
64 Warner Park Avenue
Laingholm
Auckland 0604
New Zealand

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport

[Chester Graham]

On Fri, May 29, 2020 at 9:18 AM Sojo Gold  wrote:

> Hi
> I'm having a few games with rdimport please could you guys give me a heads
> up!.
>
> My command line;
> [rd@rivhsr ~]$ rdimport --verbose --segue-level=-10 MUSIC *.mp3
> /home/rd/music_import/"1987 - Alphabet City"/
>
> My Audio file structure;
> music_import/
> 1987 - Alphabet City/
>  ABC -
> Alphabet City - 01 - Avenue.mp3
>  ABC -
> Alphabet City - 02 - When Smokey Sings.mp3
>  ABC -
> Alphabet City - 03 - The Night You Murdered Love.mp3
>
> etc...
> My verbose output;
> rdimport started
> RDImport v3.4.0
> 
> ...
> Import Create Dates mode is OFF
> Files to process:
>   "/home/rd/music_import/1987 - Alphabet City/"
> rdimport finished
> [rd@rivhsr ~]$
> However, there are no carts in RDLibrary
>
You need to finish the rdiimport string. IE.
  [rd@rivhsr ~]$ rdimport --verbose --segue-level=-10 MUSIC *.mp3
/home/rd/music_import/"1987 - Alphabet City"/*.mp3

Also, you have to work on the directory containing the audio files, it will
ignore any subdirectories.


> This is where a few questions arose..(which I cannot find in the listings
> or wiki)
> 1. do I need to be root/sudo
>
No

> 2. Do I need to be in the directory of the actual mp3's
>
Not if your command includes the path (it appears to)

> 3. Will this work over a samba/nfs share.
>
I don't know

> I also tried the Perl importer (nested-import.pl) and found it will not
> work as per *rdimport* and it will not parse the rdimport options like
> *--autotrim-level=-30* either.
>
> Some help would be appreciated muchly..
> Chris Perkins
>
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport

[Sojo Gold]

Hi
I'm having a few games with rdimport please could you guys give me a 
heads up!.


My command line;
[rd@rivhsr ~]$ rdimport --verbose --segue-level=-10 MUSIC *.mp3 
/home/rd/music_import/"1987 - Alphabet City"/


My Audio file structure;
music_import/
    1987 - Alphabet City/
 ABC - 
Alphabet City - 01 - Avenue.mp3
 ABC - 
Alphabet City - 02 - When Smokey Sings.mp3
 ABC - 
Alphabet City - 03 - The Night You Murdered Love.mp3

etc...
My verbose output;
rdimport started
RDImport v3.4.0

...
Import Create Dates mode is OFF
Files to process:
  "/home/rd/music_import/1987 - Alphabet City/"
rdimport finished
[rd@rivhsr ~]$
However, there are no carts in RDLibrary

This is where a few questions arose..(which I cannot find in the 
listings or wiki)

1. do I need to be root/sudo
2. Do I need to be in the directory of the actual mp3's
3. Will this work over a samba/nfs share.
I also tried the Perl importer (nested-import.pl) and found it will not 
work as per /rdimport/ and it will not parse the rdimport options like 
/--autotrim-level=-30/ either.


Some help would be appreciated muchly..
Chris Perkins


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport Question

[Robert Jeffares]

Hi Phil,

the folders will be on a drive somewhere which you can mount on your 
Rivendell machine.


lets call it /home/rd/tempimport

if you create the folder as rd user the permissions should be OK

$ mkdir /home/rd/tempimport

in a command line window something like

find /home/rd/tempimport -type f -iname '*.wav' -exec rdimport --verbose 
--fix-broken-formats --metadata-pattern=%a-%t.wav 
--set-string-user-defined='wav from from my old library' MUSIC {} \;


run the find /home/rd/tempimport -type f -iname '*.wav' bit first to see 
what it shows you.


You need to set the GROUP and adjust wav or mp3 or whatever and the 
metadata pattern to reflect how the songs are labelled.


That will copy the lot into the MUSIC group.

If your folders and sub folders have songs arranged by categories like 
'Country' you can refine the search and add --set-scheduler-code=country


It's a good idea to create the scheduler code 'country' in RDADMIN > 
Scheduler Codes before you do. Repeat as necessary.


I use the User Defined field to identify the source of music. Handy when 
you are weeding out duplicates.


There are drawbacks with this method. If you stop and restart you will 
get duplicates.


Better method is to copy the whole lot to a temporary folder. That takes 
time. Add --delete-source to the import command.


What's left is what didn't import.

Rivendell will reject audio files for a number of reasons. mp3diags  
mp3gain   mp3info   mp3val will help. Funny characters in filenames can 
be a problem.


Some systems show different characters on filenames. You can use find to 
move [ mv ] all the rejected files into one folder and work through them.


I would run a test on say 20 cuts and then check how they are importing. 
You may need to adjust the metadata pattern. [man rdimport]


You can set segue criteria and all sorts of stuff.

If you have defined GROUPS you can find songs that fit the group and 
import them directly but I prefer to have a single import group then 
work through it to look for duplicates and check levels, tweak segues, 
and set talk over points.


Depending on your previous system there may be an import template 
already created.


Some data may be stored in tags on your library. Smetimes you don't need 
to set metadata.


Be prepared to do a bit of testing, then once it's set up you can import 
several thousand tracks. Don't forget to allocate the GROUP enough Cart 
Numbers



regard

Robert


On 11/03/20 8:43 am, Phil Biehl wrote:


Braintrust,

I have a large number of music files I want to import to Riv that are 
divided up into folders and subfolders. I’m hoping that there is a way 
to get rdimport to process these files, traversing all these 
subfolders. Is there a way to do this?


Thanks,

Phil


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Communication Consultants 2020 Limited
64 Warner Park Avenue
Laingholm
Auckland 0604
New Zealand

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport Question

[Mark Murdock]

I don’t believe so. I did this in batches. I copied files from a folder into 
the music_import folder, imported them with RDImport, deleted the copied files, 
then did another batch until I got through them all. It took a while!

Mark Murdock
KAMB
90 E. 16th St.
Merced, CA 95340
(209) 723-1015
m...@celebrationradio.com<mailto:m...@celebrationradio.com>
Website<https://celebrationradio.com/>



From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Phil Biehl
Sent: Tuesday, March 10, 2020 12:43 PM
To: 'User discussion about the Rivendell Radio Automation System' 

Subject: [RDD] RDImport Question

Braintrust,
I have a large number of music files I want to import to Riv that are divided 
up into folders and subfolders. I’m hoping that there is a way to get rdimport 
to process these files, traversing all these subfolders. Is there a way to do 
this?

Thanks,
Phil
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport Question

[Phil Biehl]

Braintrust,

I have a large number of music files I want to import to Riv that are divided 
up into folders and subfolders. I’m hoping that there is a way to get rdimport 
to process these files, traversing all these subfolders. Is there a way to do 
this?

 

Thanks,

Phil

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport aborted ...?

[Matt Greeney]

Hey guys 

What a Game Eh!

 

I am moving to 3x and on rdimport, I keep getting this error

 

[code] ASSERT: "uint(i) < uint(size())" in file
/usr/include/QtCore/qstring.h, line 699 [/code]

 

Using the string 

[code] rdimport --verbose --autotrim-level=-30 --segue-level=-15
--metadata-pattern=%a_%t MUSIC *.mp3 [/code]

 

Ignore [code][/code]

Outputs:

 

rdimport started

RDImport v3.2.1

Force to Mono is OFF

Normalization level = -13 dB

AutoTrim level = -30 dB

Destination cart is AUTO

Single cart mode is OFF

Delete source mode is OFF

Delete cuts mode is OFF

DropBox mode is OFF

Using metadata pattern: %a_%t

Start Date Offset = 0 days

End Date Offset = 0 days

Broken format workarounds are DISABLED

Import Create Dates mode is OFF

Files to process:

 

(BLAH)

 

[code]ASSERT: "uint(i) < uint(size())" in file
/usr/include/QtCore/qstring.h, line 699 [/code]

Aborted

 

I do not like "Blindly" changing code but I did find this

https://forum.qt.io/topic/76067/error-assert-uint-i-uint-size/3

 

Any help would be appreciated!

Thanks

Matt

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport/export -xml option

[Jacob Niemand]

Hi Mircea,

I am experiencing the same issue.  Rivendell 3.2 on Centos 7.

Jake

On Sun, Dec 15, 2019 at 04:43 Mircea Paun  wrote:

> Hi!
> I exported and imported the same cart with the -xml option.
> There are some things that do not fit or something is wrong in my
> understanding or workflow.
> On exported cart, there are no values in the ISRC field, but appears as
> "Cut 001" on imported cart and obviously,
> when you want to exit from cut edit it tell me: "data il malformated or
> invalid".
> Also, even if they are present in the export, the values in the Song ID
> and Conductor fields do not appear on import.
> And finaly, cart number is loaded consecutive and not from xml value.
> Thanks!
>
> * MIRCEA PAUN *
> +40 724232195
> mircea.p...@gmail.com
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
-- 
96.7kram
P.O. Box 332
109 North 1st Street
Montevideo, MN 56265
__
320-321-9671
www.967kram.com
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport/export -xml option

[Mircea Paun]

Hi!
I exported and imported the same cart with the -xml option.
There are some things that do not fit or something is wrong in my
understanding or workflow.
On exported cart, there are no values in the ISRC field, but appears as
"Cut 001" on imported cart and obviously,
when you want to exit from cut edit it tell me: "data il malformated or
invalid".
Also, even if they are present in the export, the values in the Song ID and
Conductor fields do not appear on import.
And finaly, cart number is loaded consecutive and not from xml value.
Thanks!

* MIRCEA PAUN *
+40 724232195
mircea.p...@gmail.com
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport issue and features

[Gabriele Fergola]

Hello Fred,
i can confirm here rdimport have an issue importing file with filename in
utf8 format.
Will be nice to have also the possibility to check for duplicate just to
not import twice the same song.

At the moment i'm accomplish this by a custom Python script who is
modifying the file name from utf8 in ascii and checking the presence of the
same artist+title in the Rivendell db and if i want also it can check the
fingerprint of the file, but this last is still a working progress.

What do u think about it?

Regards
Gabriele Fergola
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport special characters problem

[Radio 3 Network - Mirco Roppolo]

Hi there, and thanks a lot for creating Rivendell software. We use on 
our radio station since version 1.7.2.


Recently I've installed 3.1.0 version on Ubuntu 18.04 64 bit system.
It's all ok except the RDImport from command line. There are some 
problems with italian characters with accent, like à ù ì ò è



Here's the complete text from terminal:

recorder@recorder:/media/Condivisa/Musica in regia/Lettere 
accentate/Love Songs$ rdimport --verbose --normalization-level=-3 
--autotrim-level=-30 --segue-level=-25 --add-scheduler-code=LOVESONGS 
--metadata-pattern="%i." MUSIC *.mp3 2> errorlog.txt

rdimport started
RDImport v3.1.0
 Force to Mono is OFF
 Normalization level = -3 dB
 AutoTrim level = -30 dB
 Destination cart is AUTO
 Single cart mode is OFF
 Delete source mode is OFF
 Delete cuts mode is OFF
 DropBox mode is OFF
 Adding Scheduler Code(s):
 LOVESONGS
 Using metadata pattern: %i.
 Start Date Offset = 0 days
 End Date Offset = 0 days
 Broken format workarounds are DISABLED
 Import Create Dates mode is OFF
 Files to process:
   "Ana Carolina e Seu Jorge - E' isso a? (2005).mp3"
   "Annalisa - Vincer? (2015).mp3"
   "Cesare Cremonini - L'altra met? (2010).mp3"
   "Chiara - Nessun posto ? casa mia (2017).mp3"
   "Francesco Nuti - Sar? per te (1988).mp3"
   "Giorgia feat Alicia Keys - I will pray (pregher?) (2013).mp3"
   "Miguel Bos? & Julieta Venegas - Morena mia (2007).mp3"
   "Nomadi - La libert? di volare (2000).mp3"
   "Simone Cristicchi - Ti regaler? una rosa (2007).mp3"
   "Zucchero - Cos? celeste (1995).mp3"
 Unable to open "Ana Carolina e Seu Jorge - E' isso a? (2005).mp3", 
skipping...

 Unable to open "Annalisa - Vincer? (2015).mp3", skipping...
 Unable to open "Cesare Cremonini - L'altra met? (2010).mp3", skipping...
 Unable to open "Chiara - Nessun posto ? casa mia (2017).mp3", skipping...
 Unable to open "Francesco Nuti - Sar? per te (1988).mp3", skipping...
 Unable to open "Giorgia feat Alicia Keys - I will pray (pregher?) 
(2013).mp3", skipping...
 Unable to open "Miguel Bos? & Julieta Venegas - Morena mia 
(2007).mp3", skipping...

 Unable to open "Nomadi - La libert? di volare (2000).mp3", skipping...
 Unable to open "Simone Cristicchi - Ti regaler? una rosa (2007).mp3", 
skipping...

 Unable to open "Zucchero - Cos? celeste (1995).mp3", skipping...
rdimport finished


This problem can't exist in the earlier versions we use: 1.7.2 and 2.16.0

If I import songs manually from RDLibrary, all metadata with special 
characters are correctly displayed and no errors found.


How can I solve that?

Thanks so much and greetings from Tuscany, Italy.

--
Mirco Roppolo
Radio 3 Network
FM 91.7 MHz - AM 1602 kHz
www.radio3.net 
Tel. 0577 980 900 - Cell. 368 39 48 237
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[nathaniel.steele]

Doeas anyone here have any opinions on ZFS? Does anyone host their /var/snd on 
a NAS? I’ve been looking at building a  freenas system to use around the 
office, which use ZFS.

 

In the past I used two Rivendell servers, with one rsyncing to the other 
nightly, and backing up the db nightly. I also rsynced to a NAS appliance, so 
the data lived in three places.

 

From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Alan Smith
Sent: Saturday, November 30, 2019 7:03 PM
To: User discussion about the Rivendell Radio Automation System 

Subject: Re: [RDD] RDImport and Disk Space

 

Again, still consider myself very new to this, but what I have started to do is 
use Raid1, and setup postfix to send email/text failure notifications. 

 

I haven't had a real failure yet, but during testing (including simulated 
failure on the bench) it works pretty well.

 

-Alan

 

On 11/30/2019 6:47 PM, Rob Landry wrote:

On Thu, 28 Nov 2019, Lorne Tyndale wrote: 




That's overall good advice, the only things I'd add is that I'm not a 
big fan of Raid 5, I prefer Raid 1 which provides as full 1:1 mirror for 
better redundancy and robustness.  When hard disks cost a lot I could 


I don't like RAID at all. I prefer to build a second, fully functioning RD 
machine and have it mirror the first one. If I lose the first one, I switch to 
the backup. 

My problem with RAID boils down to the reality that most of the RD systems I 
build are for stations with no resident technical person. If a drive in a RAID 
array fails, no one will notice. I'll hear about it when a second drive fails 
and the station goes off the air. 


Rob 





___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org 
<mailto:Rivendell-dev@lists.rivendellaudio.org> 
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

 

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Steve Varholy]

Neat!

Sent from my Sprint Phone.

-- Original message--
From: Sébastien Leblanc
Date: Sat, Nov 30, 2019 9:50 PM
To: Rivendell Users Group;
Cc:
Subject:Re: [RDD] RDImport and Disk Space

On 19-11-27 12 h 16, Steve Varholy wrote:
Mark:

Add another drive, move/copy /var/snd to it and create a symbolic link to the 
new location. Done.



You can also use UnionFS to overlay a new filesystem on a new drive on top of 
the old filesystem. The old filesystem effectively becomes read-only as the 
writes are all redirected to the new filesystem. This lets you progressively 
move old files to the new drive, without any downtime, assuming your system 
supports hotplugging of new drives.


Sébastien
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Sébastien Leblanc]

On 19-11-27 12 h 16, Steve Varholy wrote:
> Mark: 
>
> Add another drive, move/copy /var/snd to it and create a symbolic link
> to the new location. Done.
>

You can also use UnionFS to overlay a new filesystem on a new drive on
top of the old filesystem. The old filesystem effectively becomes
read-only as the writes are all redirected to the new filesystem. This
lets you progressively move old files to the new drive, without any
downtime, assuming your system supports hotplugging of new drives.


Sébastien

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Alan Smith]

Again, still consider myself very new to this, but what I have started 
to do is use Raid1, and setup postfix to send email/text failure 
notifications.


I haven't had a real failure yet, but during testing (including 
simulated failure on the bench) it works pretty well.


-Alan

On 11/30/2019 6:47 PM, Rob Landry wrote:

On Thu, 28 Nov 2019, Lorne Tyndale wrote:


That's overall good advice, the only things I'd add is that I'm not a
big fan of Raid 5, I prefer Raid 1 which provides as full 1:1 mirror for
better redundancy and robustness.  When hard disks cost a lot I could


I don't like RAID at all. I prefer to build a second, fully 
functioning RD machine and have it mirror the first one. If I lose the 
first one, I switch to the backup.


My problem with RAID boils down to the reality that most of the RD 
systems I build are for stations with no resident technical person. If 
a drive in a RAID array fails, no one will notice. I'll hear about it 
when a second drive fails and the station goes off the air.



Rob


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Rob Landry]

On Thu, 28 Nov 2019, Lorne Tyndale wrote:


That's overall good advice, the only things I'd add is that I'm not a
big fan of Raid 5, I prefer Raid 1 which provides as full 1:1 mirror for
better redundancy and robustness.  When hard disks cost a lot I could


I don't like RAID at all. I prefer to build a second, fully functioning RD 
machine and have it mirror the first one. If I lose the first one, I 
switch to the backup.


My problem with RAID boils down to the reality that most of the RD systems 
I build are for stations with no resident technical person. If a drive in 
a RAID array fails, no one will notice. I'll hear about it when a second 
drive fails and the station goes off the air.



Rob

--
Сквозь грозы сияло нам солнце свободы
И Linus великий нам путь озарил;
Нас вырастил Stallman на верность народу,
На труд и на подвиги нас вдохновил.


see the benefit of Raid 5 giving you a little more storage space between
the same number of drives at the cost of a longer rebuild time and the
potential of a bigger loss if more then one drive failed.  But as has
been pointed out, hard disk storage is cheap these days, I don't see the
benefit of doing a Raid 5 array any more.

As mentioned, it is still important to have a full backup strategy.

I'm also not a fan of using USB for primary /var/snd storage.  I've had
too many instances where the USB connection drops, the cable comes lose
over time, or similar.  USB is fine if you're running it as an external
backup drive or portable storage, but I would avoid relying on USB for a
mission critical playout system.  In my view it is just running too much
of a risk.  For similar reasons I don't like using USB sound cards for
primary on-air (or other mission critical) use.

Just my $0.02

Lorne Tyndale





I actually prefer to have /var/snd on a completely separate volume. If 
you have the physical space to do it, I'd mirror the existing 1.5 TB 
drive and build a RAID5 array for /var/snd. You could get an external 4 
drive USB bay to store /var/snd. Playback of stereo audio needs less 
than 1 Mbps, so USB wouldn't be challenged that much.


An automation system is not something you can easily rebuild quickly. It 
pays to have it be fault tolerant to start with. We also rsync backup of 
the entire system to a separate computer. It might be a little paranoid, 
but it's relatively low cost insurance. Our Rivendell system has now 
grown to a number of client stations from a single server. There's 
really only 2 clients that playback. The other clients are used to 
ingest content and build logs. We've really hardened the server. A 
replacement client can be cloned on short notice and the failure of a 
single client isn't going to cripple the operation.


- Bill

On 11/28/19 3:16 AM, drew Roberts wrote:
> Mark,
>
> On Wed, Nov 27, 2019 at 11:53 AM Mark Murdock 
> mailto:m...@celebrationradio.com>> wrote:

>
> So apparently, I need a drive much bigger than 1.5 TB unless I
> want to run compressed files. I wish I had known this going into
> this. The Rivendell System Requirements specify a 1 TB drive.
> Maybe that should be bumped up to 4 TB for music stations that
> want to store uncompressed files.
>
>
> "
>
> Do I have to start over from scratch for the server, or can I
> clone the 1.5 TB drive?
>
> "
>
> You do not have to do either.
>
> You can take a 2 to 4 TB drive for instance. Format it and mount it 
> somewhere temporarily. Copy the audio files in /var/snd to that drive. 
> Now *mount* that drive as /var/snd. Edit your fstab to make this mount 
> on boot.

>
> all the best,
>
> drew
>
> If I clone the drive, won’t it preserve the 50 GB size on
> /dev/mapper/centos-root?
>
> Thanks,
>
> Mark Murdock
>
> KAMB
>
> 90 E. 16^th St.
>
> Merced, CA 95340
>
> (209) 723-1015
>
> m...@celebrationradio.com 
>
> Website 
>
>
> all the best,
>
> drew
> -- 
> Enjoy the *Paradise Island Cam* playing

> *Bahamian Or Nuttin* - https://www.paradiseislandcam.com/
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

--
Bill Putney - WB6RFW

District 2 Commissioner - Port of Port Townsend
Chief Engineer - KPTZ
El Jefe de Contenido - Port Townsend Film Festival
Private Pilot-Single Engine Land | Airframe & Powerplant Mechanic / Inspection 
Authorization___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org

Re: [RDD] RDImport and Disk Space

[Bill Putney]

Lorne,

Yes, a mirrored pair of 4 or 6 TB drives are not so pricey these days. 
When we last did this, we were in the middle of the great hard drive 
famine (in the wake a massive flooding in Thailand) and drive prices 
were pretty high. If they were going to retrofit an existing computer 
that didn't have a lot of storage slots, an external drive bay would be 
the easiest thing to do. If the external drive box provides JBOD over 
USB, using UUID's for the drive assignments solves the sometimes random 
way USB devices are attached and named. I hear trouble with USB 
strangeness in the Windoz world than I do in Linux land. But, there are 
a lot of drive boxes available with ESATA connections and that is 
probably a more reliable interface.


If you had an ESATA connected 4 bay external box, you could put a pair 
of 250 GB SSDs mirrored as the boot drive and a pair of 6 TB spinning 
drives mirrored for the /var/snd volume. Then if you have a spare 
computer, you can just do a fast swap if a power supply dies or the MB 
develops a glitch.


We have a mostly digital environment at KPTZ. Our first Rivendell 
clients used $30 eBay USB to S/PDIF for audio outputs. Those connected 
right to our boards as AES/EBU inputs and worked great until Centos 
forgot to include the drivers for the chips in them in one revision. 
That forced us into buying ASI cards. Didn't sound different on the air 
but cost substantially more.


- Bill

On 11/28/19 10:13 AM, Lorne Tyndale wrote:

Bill,

That's overall good advice, the only things I'd add is that I'm not a
big fan of Raid 5, I prefer Raid 1 which provides as full 1:1 mirror for
better redundancy and robustness.  When hard disks cost a lot I could
see the benefit of Raid 5 giving you a little more storage space between
the same number of drives at the cost of a longer rebuild time and the
potential of a bigger loss if more then one drive failed.  But as has
been pointed out, hard disk storage is cheap these days, I don't see the
benefit of doing a Raid 5 array any more.

As mentioned, it is still important to have a full backup strategy.

I'm also not a fan of using USB for primary /var/snd storage.  I've had
too many instances where the USB connection drops, the cable comes lose
over time, or similar.  USB is fine if you're running it as an external
backup drive or portable storage, but I would avoid relying on USB for a
mission critical playout system.  In my view it is just running too much
of a risk.  For similar reasons I don't like using USB sound cards for
primary on-air (or other mission critical) use.

Just my $0.02

Lorne Tyndale




I actually prefer to have /var/snd on a completely separate volume. If
you have the physical space to do it, I'd mirror the existing 1.5 TB
drive and build a RAID5 array for /var/snd. You could get an external 4
drive USB bay to store /var/snd. Playback of stereo audio needs less
than 1 Mbps, so USB wouldn't be challenged that much.

An automation system is not something you can easily rebuild quickly. It
pays to have it be fault tolerant to start with. We also rsync backup of
the entire system to a separate computer. It might be a little paranoid,
but it's relatively low cost insurance. Our Rivendell system has now
grown to a number of client stations from a single server. There's
really only 2 clients that playback. The other clients are used to
ingest content and build logs. We've really hardened the server. A
replacement client can be cloned on short notice and the failure of a
single client isn't going to cripple the operation.

- Bill

On 11/28/19 3:16 AM, drew Roberts wrote:

Mark,

On Wed, Nov 27, 2019 at 11:53 AM Mark Murdock
mailto:m...@celebrationradio.com>> wrote:

 So apparently, I need a drive much bigger than 1.5 TB unless I
 want to run compressed files. I wish I had known this going into
 this. The Rivendell System Requirements specify a 1 TB drive.
 Maybe that should be bumped up to 4 TB for music stations that
 want to store uncompressed files.


"

 Do I have to start over from scratch for the server, or can I
 clone the 1.5 TB drive?

"

You do not have to do either.

You can take a 2 to 4 TB drive for instance. Format it and mount it
somewhere temporarily. Copy the audio files in /var/snd to that drive.
Now *mount* that drive as /var/snd. Edit your fstab to make this mount
on boot.

all the best,

drew

 If I clone the drive, won’t it preserve the 50 GB size on
 /dev/mapper/centos-root?

 Thanks,

 Mark Murdock

 KAMB

 90 E. 16^th St.

 Merced, CA 95340

 (209) 723-1015

 m...@celebrationradio.com 

 Website 


all the best,

drew
--
Enjoy the *Paradise Island Cam* playing
*Bahamian Or Nuttin* - https://www.paradiseislandcam.com/

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org

Re: [RDD] RDImport and Disk Space

[Lorne Tyndale]

Bill,

That's overall good advice, the only things I'd add is that I'm not a
big fan of Raid 5, I prefer Raid 1 which provides as full 1:1 mirror for
better redundancy and robustness.  When hard disks cost a lot I could
see the benefit of Raid 5 giving you a little more storage space between
the same number of drives at the cost of a longer rebuild time and the
potential of a bigger loss if more then one drive failed.  But as has
been pointed out, hard disk storage is cheap these days, I don't see the
benefit of doing a Raid 5 array any more.

As mentioned, it is still important to have a full backup strategy.

I'm also not a fan of using USB for primary /var/snd storage.  I've had
too many instances where the USB connection drops, the cable comes lose
over time, or similar.  USB is fine if you're running it as an external
backup drive or portable storage, but I would avoid relying on USB for a
mission critical playout system.  In my view it is just running too much
of a risk.  For similar reasons I don't like using USB sound cards for
primary on-air (or other mission critical) use.

Just my $0.02

Lorne Tyndale


> 
> 
> I actually prefer to have /var/snd on a completely separate volume. If 
> you have the physical space to do it, I'd mirror the existing 1.5 TB 
> drive and build a RAID5 array for /var/snd. You could get an external 4 
> drive USB bay to store /var/snd. Playback of stereo audio needs less 
> than 1 Mbps, so USB wouldn't be challenged that much.
> 
> An automation system is not something you can easily rebuild quickly. It 
> pays to have it be fault tolerant to start with. We also rsync backup of 
> the entire system to a separate computer. It might be a little paranoid, 
> but it's relatively low cost insurance. Our Rivendell system has now 
> grown to a number of client stations from a single server. There's 
> really only 2 clients that playback. The other clients are used to 
> ingest content and build logs. We've really hardened the server. A 
> replacement client can be cloned on short notice and the failure of a 
> single client isn't going to cripple the operation.
> 
> - Bill
> 
> On 11/28/19 3:16 AM, drew Roberts wrote:
> > Mark,
> >
> > On Wed, Nov 27, 2019 at 11:53 AM Mark Murdock 
> > mailto:m...@celebrationradio.com>> wrote:
> >
> > So apparently, I need a drive much bigger than 1.5 TB unless I
> > want to run compressed files. I wish I had known this going into
> > this. The Rivendell System Requirements specify a 1 TB drive.
> > Maybe that should be bumped up to 4 TB for music stations that
> > want to store uncompressed files.
> >
> >
> > "
> >
> > Do I have to start over from scratch for the server, or can I
> > clone the 1.5 TB drive?
> >
> > "
> >
> > You do not have to do either.
> >
> > You can take a 2 to 4 TB drive for instance. Format it and mount it 
> > somewhere temporarily. Copy the audio files in /var/snd to that drive. 
> > Now *mount* that drive as /var/snd. Edit your fstab to make this mount 
> > on boot.
> >
> > all the best,
> >
> > drew
> >
> > If I clone the drive, won’t it preserve the 50 GB size on
> > /dev/mapper/centos-root?
> >
> > Thanks,
> >
> > Mark Murdock
> >
> > KAMB
> >
> > 90 E. 16^th St.
> >
> > Merced, CA 95340
> >
> > (209) 723-1015
> >
> > m...@celebrationradio.com 
> >
> > Website 
> >
> >
> > all the best,
> >
> > drew
> > -- 
> > Enjoy the *Paradise Island Cam* playing
> > *Bahamian Or Nuttin* - https://www.paradiseislandcam.com/
> >
> > ___
> > Rivendell-dev mailing list
> > Rivendell-dev@lists.rivendellaudio.org
> > http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
> 
> -- 
> Bill Putney - WB6RFW
> 
> District 2 Commissioner - Port of Port Townsend
> Chief Engineer - KPTZ
> El Jefe de Contenido - Port Townsend Film Festival
> Private Pilot-Single Engine Land | Airframe & Powerplant Mechanic / 
> Inspection Authorization___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Bill Putney]

I actually prefer to have /var/snd on a completely separate volume. If 
you have the physical space to do it, I'd mirror the existing 1.5 TB 
drive and build a RAID5 array for /var/snd. You could get an external 4 
drive USB bay to store /var/snd. Playback of stereo audio needs less 
than 1 Mbps, so USB wouldn't be challenged that much.


An automation system is not something you can easily rebuild quickly. It 
pays to have it be fault tolerant to start with. We also rsync backup of 
the entire system to a separate computer. It might be a little paranoid, 
but it's relatively low cost insurance. Our Rivendell system has now 
grown to a number of client stations from a single server. There's 
really only 2 clients that playback. The other clients are used to 
ingest content and build logs. We've really hardened the server. A 
replacement client can be cloned on short notice and the failure of a 
single client isn't going to cripple the operation.


- Bill

On 11/28/19 3:16 AM, drew Roberts wrote:

Mark,

On Wed, Nov 27, 2019 at 11:53 AM Mark Murdock 
mailto:m...@celebrationradio.com>> wrote:


So apparently, I need a drive much bigger than 1.5 TB unless I
want to run compressed files. I wish I had known this going into
this. The Rivendell System Requirements specify a 1 TB drive.
Maybe that should be bumped up to 4 TB for music stations that
want to store uncompressed files.


"

Do I have to start over from scratch for the server, or can I
clone the 1.5 TB drive?

"

You do not have to do either.

You can take a 2 to 4 TB drive for instance. Format it and mount it 
somewhere temporarily. Copy the audio files in /var/snd to that drive. 
Now *mount* that drive as /var/snd. Edit your fstab to make this mount 
on boot.


all the best,

drew

If I clone the drive, won’t it preserve the 50 GB size on
/dev/mapper/centos-root?

Thanks,

Mark Murdock

KAMB

90 E. 16^th St.

Merced, CA 95340

(209) 723-1015

m...@celebrationradio.com 

Website 


all the best,

drew
--
Enjoy the *Paradise Island Cam* playing
*Bahamian Or Nuttin* - https://www.paradiseislandcam.com/

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Bill Putney - WB6RFW

District 2 Commissioner - Port of Port Townsend
Chief Engineer - KPTZ
El Jefe de Contenido - Port Townsend Film Festival
Private Pilot-Single Engine Land | Airframe & Powerplant Mechanic / Inspection 
Authorization

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Thu, 28 Nov 2019 08:18:53 -0500
"R. Choy"  wrote:

> In /var is the symbolic link:
> lrwxrwxrwx.  1 rivendell rivendell    9 Dec 16  2018 snd -> /sda4/snd
> Is this right?

 That part is fine. It's correct/

 What I'm not seeing in the rest, ( though the e-mail comes through badly 
formatted )is a disk
 mounted on /sda4/snd in the / directory !

 I do see
 /boot/efi/dev/sda2   100G   60G   41G  60% /home/dev/sda4
 in which case ( although the sda2 and sda4 seem wrong ) the symlink should be
 lrwxrwxrwx.  1 rivendell rivendell    9 Dec 16  2018 snd -> /home/dev/sda4/snd
 
 I will say that /home/dev is confusing in itself.

-- 
Cowboy 

Grief is the Reminder that we Loved.
 And were Loved.
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

Here's a snapshot after I issue a cd /var/snd and ls

040220_001.wav  040454_001.wav  040644_001.wav  040863_001.wav 
060001_008.wav
040221_001.wav  040455_001.wav  040644_002.wav  040864_001.wav 
060001_009.wav
040222_001.wav  040456_001.wav  040644_003.wav  040865_001.wav 
060001_010.wav
040223_001.wav  040457_001.wav  040644_004.wav  040866_001.wav 
060001_011.wav

040224_001.wav  040458_001.wav  040644_005.wav  040867_001.wav
040225_001.wav  040459_001.wav  040644_006.wav  040868_001.wav
040226_001.wav  040460_001.wav  040644_007.wav  040869_001.wav
[rd@sgospel snd]$

And also a df-h
[rd@sgospel snd]$ df -h
Filesystem  Size  Used Avail Use% Mounted on
/dev/sda3    25G  3.8G   22G  15% /
devtmpfs    3.8G 0  3.8G   0% /dev
tmpfs   3.8G   44K  3.8G   1% /dev/shm
tmpfs   3.8G   33M  3.8G   1% /run
tmpfs   3.8G 0  3.8G   0% /sys/fs/cgroup
/dev/sda1  1014M   33M  982M   4% /boot/efi
/dev/sda2   100G   60G   41G  60% /home
/dev/sda4   1.7T   42G  1.6T   3% /sda4
tmpfs   770M  4.0K  770M   1% /run/user/1000

In /var is the symbolic link:

lrwxrwxrwx.  1 rivendell rivendell    9 Dec 16  2018 snd -> /sda4/snd

Is this right?

Rick


On 11/28/2019 7:53 AM, Cowboy wrote:

On Wed, 27 Nov 2019 18:35:23 -0500
"R. Choy"  wrote:


There is no "mounted on" /var/snd  only a symbolic link pointing to /sda4 in 
the old
existing /var/snd

  Important distinction...

  symbolic link pointing to /sda4 in the old

  or

  symbolic link pointing to /sda4 **IS** the old

  ??


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Wed, 27 Nov 2019 18:35:23 -0500
"R. Choy"  wrote:

> There is no "mounted on" /var/snd  only a symbolic link pointing to /sda4 in 
> the old
> existing /var/snd

 Important distinction...

 symbolic link pointing to /sda4 in the old

 or

 symbolic link pointing to /sda4 **IS** the old

 ??

-- 
Cowboy 

Grief is the Reminder that we Loved.
 And were Loved.
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[drew Roberts]

Mark,

On Wed, Nov 27, 2019 at 11:53 AM Mark Murdock 
wrote:

> So apparently, I need a drive much bigger than 1.5 TB unless I want to run
> compressed files. I wish I had known this going into this. The Rivendell
> System Requirements specify a 1 TB drive. Maybe that should be bumped up to
> 4 TB for music stations that want to store uncompressed files.
>

"

> Do I have to start over from scratch for the server, or can I clone the
> 1.5 TB drive?
>
"

You do not have to do either.

You can take a 2 to 4 TB drive for instance. Format it and mount it
somewhere temporarily. Copy the audio files in /var/snd to that drive. Now
*mount* that drive as /var/snd. Edit your fstab to make this mount on boot.

all the best,

drew

If I clone the drive, won’t it preserve the 50 GB size on
> /dev/mapper/centos-root?
>
>
>
> Thanks,
>
>
>
> Mark Murdock
>
> KAMB
>
> 90 E. 16th St.
>
> Merced, CA 95340
>
> (209) 723-1015
>
> m...@celebrationradio.com
>
> Website 
>
>
> all the best,

drew
-- 
Enjoy the *Paradise Island Cam* playing
*Bahamian Or Nuttin* - https://www.paradiseislandcam.com/
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

Just /var/snd

I have two rd systems used for my twp streams. This might be a clue though:

I did a df -h and on the working box there is a line:            
'/dev/sda3   1.7T    75G    1.6T   5%   /var/snd' on the working box.


The box that does not load a new log at midnight looks like this: 
'/dev/sda4  1.7T   42G   1.6T    3%  /sda4


There is no "mounted on" /var/snd  only a symbolic link pointing to 
/sda4 in the old existing /var/snd


Could this be a clue?

Rick

On 11/27/2019 6:14 PM, Robert Jeffares wrote:

Hi Rick,

 migrating to CentOS 7 is a good idea. If you have a new machine follow

http://static.paravelsystems.com/rivendell-install-rd3/rivendell-install-rhel7.html 



then copy the contents of /var/snd across to the new machine. rsync 
across the local network will do the job.


Save a copy of the database in RDADMIN to something you can connect to 
the new machine easily.


restore using rddbconfig

Did you move /var/snd or /var/log? /var/snd is not going to affect 
chain log but moving /var/log is definitely going to confuse things!


R

On 28/11/19 11:06 AM, R. Choy wrote:
I understand. But from the OP, everything worked fine until I moved 
/var/log. Around midnight give or take, the end of the log showed it 
was to load the next day log but doesn't. Just stops. I plundered 
through the rd archives and saw a lot of possible problems and 
solutions especially from "cowboy". Applied all of them including 
check box  'Insert CHAIN TO at log end'.


Still doesn't work.

Since this distro was loaded from a centos 5 os Rd appliance disk, 
maybe I should take Fred's advice and start over with a Centos 7 
distro. I'm assuming all I have to do is copy the lastest rdbackup 
and the whole /var/snd music into new machine, restore database?? 
Could it be that easy?


Rick

On 11/27/2019 1:13 PM, Robert Jeffares wrote:


On 28/11/19 2:54 AM, R. Choy wrote:
except it will no longer load the next day's log. 


That's not dependent on /var/snd/

Look in RDADMIN > Manage Services > Service to see that 'Insert 
CHAIN TO at log end' is checked.


This may not happen exactly at midnight unless you have some time 
sync events in the clock for the last hour.



regards

Robert

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

I understand. But from the OP, everything worked fine until I moved 
/var/log. Around midnight give or take, the end of the log showed it was 
to load the next day log but doesn't. Just stops. I plundered through 
the rd archives and saw a lot of possible problems and solutions 
especially from "cowboy". Applied all of them including check box  
'Insert CHAIN TO at log end'.


Still doesn't work.

Since this distro was loaded from a centos 5 os Rd appliance disk, maybe 
I should take Fred's advice and start over with a Centos 7 distro. I'm 
assuming all I have to do is copy the lastest rdbackup and the whole 
/var/snd music into new machine, restore database?? Could it be that easy?


Rick

On 11/27/2019 1:13 PM, Robert Jeffares wrote:


On 28/11/19 2:54 AM, R. Choy wrote:
except it will no longer load the next day's log. 


That's not dependent on /var/snd/

Look in RDADMIN > Manage Services > Service to see that 'Insert CHAIN 
TO at log end' is checked.


This may not happen exactly at midnight unless you have some time sync 
events in the clock for the last hour.



regards

Robert

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

Will try that.

On 11/27/2019 10:26 AM, Rob Landry wrote:


Huh? Logs aren't stored in /var/snd. This shouldn't be happening.

If you create a short log with a CHAIN to itself at the end, and run 
it, will it reload?



Rob


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Rob Landry]

On Wed, 27 Nov 2019, Cowboy wrote:


What *I* would do, ( a little "Cowboy" engineering ) I would create
a directory /home/snd then copy everything from /var/snd into it.
Very non-standard, but it'll work.



Once that's done, delete ( yep, delete ) /var/snd altogether.
rmdir /var/snd



Now link the 1.4T /home/snd partition in place.
You can't make hard links across systems, so
ln -s /home/snd /var/snd


I have done exactly this on more than one system, and it does indeed work.

My preference these days is to go buy a 250 GB solid state drive and 
install Rivendell on that, leaving the 1.5 TB for just audio files. I then 
create a startup.sh script in /root which maps the 1.5 TB drive to 
/var/snd and have root run the script on reboot via a cron job.


In addition to mapping the drive to /var/snd, the startup script can do 
things like starting x11vnc to enable remote desktop access.


The reason I don't use /etc/fstab to map the audio drive is that if the 
drive cannot be mounted for some reason, the machine will not boot and I 
can't troubleshoot it remotely.



Rob

--
Сквозь грозы сияло нам солнце свободы
И Linus великий нам путь озарил;
Нас вырастил Stallman на верность народу,
На труд и на подвиги нас вдохновил.


Check the permissions on /home/snd
/var/snd being a symlink is going to show incorrectly, but the files
that are apparently in it will show correctly.

--
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Wed, 27 Nov 2019 12:28:53 -0600
Alan Smith  wrote:

> Can't parted/gparted move/resize the partitions easily?

 Yes, and no.
 Depends on where on the platters the partitions are, and how
 much data resides therein.

 I prefer to set things up myself, so I know.
 CentOS ( RHEL ) hides it from you, 'cause you're much
 too stup...
 You're obviously not capable of knowing.

 If (*if*) you have enough free unallocated space on the disk,
 time consuming but pretty easy.
 If you don't have free space, then it comes close to impossible.

-- 
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Alan Smith]

Totally ignorant here, just trying to help.

Can't parted/gparted move/resize the partitions easily?

Again, coming from a place of total ignorance, but on Winders machines, 
I often use knoppix to manipulate drive partitions/do data recovery.


-Alan

On 11/27/2019 12:24 PM, Cowboy wrote:

On Wed, 27 Nov 2019 10:19:39 -0700
"Lorne Tyndale"  wrote:


Your problem is clear from the lines:


/dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
/dev/mapper/centos-root   50G   50G   39M 100% /

  Yep !


You have 1.4TB allocated to /home (where you've only used 4.5GB of that
1.4TB), but only 50GB allocated to your root of /

/var/snd is a folder off /  so for sure it'll run out of space quickly.

  CentOS is not very fixable in this regard.
  The philosophy seems to be to blow everything away and start over.
  If you can, then do that.

  What *I* would do, ( a little "Cowboy" engineering ) I would create
  a directory /home/snd then copy everything from /var/snd into it.
  Very non-standard, but it'll work.

  Once that's done, delete ( yep, delete ) /var/snd altogether.
  rmdir /var/snd

  Now link the 1.4T /home/snd partition in place.
  You can't make hard links across systems, so
  ln -s /home/snd /var/snd

  Check the permissions on /home/snd
  /var/snd being a symlink is going to show incorrectly, but the files
  that are apparently in it will show correctly.



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Wed, 27 Nov 2019 10:19:39 -0700
"Lorne Tyndale"  wrote:

> Your problem is clear from the lines:
> 
> > /dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
> > /dev/mapper/centos-root   50G   50G   39M 100% /  

 Yep !

> You have 1.4TB allocated to /home (where you've only used 4.5GB of that
> 1.4TB), but only 50GB allocated to your root of /
> 
> /var/snd is a folder off /  so for sure it'll run out of space quickly.

 CentOS is not very fixable in this regard.
 The philosophy seems to be to blow everything away and start over.
 If you can, then do that.

 What *I* would do, ( a little "Cowboy" engineering ) I would create
 a directory /home/snd then copy everything from /var/snd into it.
 Very non-standard, but it'll work.

 Once that's done, delete ( yep, delete ) /var/snd altogether.
 rmdir /var/snd

 Now link the 1.4T /home/snd partition in place.
 You can't make hard links across systems, so
 ln -s /home/snd /var/snd

 Check the permissions on /home/snd 
 /var/snd being a symlink is going to show incorrectly, but the files
 that are apparently in it will show correctly. 

-- 
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Robert Jeffares]

On 28/11/19 2:54 AM, R. Choy wrote:
except it will no longer load the next day's log. 


That's not dependent on /var/snd/

Look in RDADMIN > Manage Services > Service to see that 'Insert CHAIN TO 
at log end' is checked.


This may not happen exactly at midnight unless you have some time sync 
events in the clock for the last hour.



regards

Robert

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Bill Putney]

Oops, I missed that in the df you posted. Probably the easiest thing to 
do is to move /home back under root and make the current home partition 
the new /var/snd partition. If your Rivendell machines aren't be used as 
general purpose computers, home shouldn't ever get to big. Resizing 
partitions can be a pain to accomplish.


- Bill

On 11/27/19 9:19 AM, Lorne Tyndale wrote:

Mark,

Your problem is clear from the lines:


/dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
/dev/mapper/centos-root   50G   50G   39M 100% /

You have 1.4TB allocated to /home (where you've only used 4.5GB of that
1.4TB), but only 50GB allocated to your root of /

/var/snd is a folder off /  so for sure it'll run out of space quickly.

You'll need to reallocate a bunch of the space currently in /home to
/var/snd

Cheers,

Lorne Tyndale




Here's the output from df -h:

Filesystem   Size  Used Avail Use% Mounted on
devtmpfs 3.8G 0  3.8G   0% /dev
tmpfs3.8G 0  3.8G   0% /dev/shm
tmpfs3.8G   98M  3.7G   3% /run
tmpfs3.8G 0  3.8G   0% /sys/fs/cgroup
/dev/mapper/centos-root   50G   50G   39M 100% /
/dev/sda2   1014M  343M  672M  34% /boot
/dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
/dev/sda1200M   12M  189M   6% /boot/efi
tmpfs771M  4.0K  771M   1% /run/user/42
tmpfs771M  8.0K  771M   1% /run/user/1001

Mark

-Original Message-
From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Cowboy
Sent: Wednesday, November 27, 2019 4:17 AM
To: 'rivendell-dev@lists.rivendellaudio.org' 

Subject: Re: [RDD] RDImport

On Wed, 27 Nov 2019 01:00:27 +
Mark Murdock  wrote:


drive is a 1.5 TB drive, and there's plenty of space left on it, but
when I looked at the properties of /var/snd it said that 49.5 GB had
been used of 53.7 GB, and that there is only 133 MB left (99% used).
Is there a way to expand the space allocated for /var/snd? Is there a solution 
for this?

  The solution depends on the problem !
  You've described the symptom. ;-)

  Please post the output from
  df -h

--
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Bill Putney - WB6RFW

District 2 Commissioner - Port of Port Townsend
Chief Engineer - KPTZ
El Jefe de Contenido - Port Townsend Film Festival
Private Pilot-Single Engine Land | Airframe & Powerplant Mechanic / Inspection 
Authorization

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Bill Putney]

/var is in the root partition. When you ask the system how much space is 
left in /var/snd, it tells you how much space is left in the partition 
it's a part of. Looks like there was only 39 MB available there when you 
did the df -h. Except for /var/snd there shouldn't be anything in the 
root partition that's very big.


My guess is that /var/snd has used up most of that space and you need a 
drive dedicated to /var/snd.


The real question is, where did your 1.5 TB go? If you add up all the 
mounted partitions listed in the df you did, it's less than 70 GB. 
You've got 1.4 TB missing. Maybe the system made a partition for 
/var/snd and it didn't get used?


For some further exploration, do an lsblk to see the device name of the 
drive. Then do a cfdisk /dev//dev/sda >. There should be partitions that add up to the missing space.


If there's a 1.4 TB partition you've found your new home for /var/snd. 
Change the name of /var/snd to /var/old-snd. Create a mount point for 
/var/snd (mkdir /var/snd) and change it's permissions and ownership to 
match the /var/old-snd. In /etc/fstab make an entry for /var/snd using 
the empty partition you found. Mount your new /var/snd (sudo mount -a). 
You can use tar or rsync to copy all the existing sound files over to 
their new home.


That should give you more space to keep sound files in and it will then 
show up when you do a df -h so you can easily keep track of it.


- Bill

On 11/27/19 8:20 AM, Mark Murdock wrote:

Here's the output from df -h:

Filesystem   Size  Used Avail Use% Mounted on
devtmpfs 3.8G 0  3.8G   0% /dev
tmpfs3.8G 0  3.8G   0% /dev/shm
tmpfs3.8G   98M  3.7G   3% /run
tmpfs3.8G 0  3.8G   0% /sys/fs/cgroup
/dev/mapper/centos-root   50G   50G   39M 100% /
/dev/sda2   1014M  343M  672M  34% /boot
/dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
/dev/sda1200M   12M  189M   6% /boot/efi
tmpfs771M  4.0K  771M   1% /run/user/42
tmpfs771M  8.0K  771M   1% /run/user/1001

Mark

-Original Message-
From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Cowboy
Sent: Wednesday, November 27, 2019 4:17 AM
To: 'rivendell-dev@lists.rivendellaudio.org' 

Subject: Re: [RDD] RDImport

On Wed, 27 Nov 2019 01:00:27 +
Mark Murdock  wrote:


drive is a 1.5 TB drive, and there's plenty of space left on it, but
when I looked at the properties of /var/snd it said that 49.5 GB had
been used of 53.7 GB, and that there is only 133 MB left (99% used).
Is there a way to expand the space allocated for /var/snd? Is there a solution 
for this?

  The solution depends on the problem !
  You've described the symptom. ;-)

  Please post the output from
  df -h

--
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


--
Bill Putney - WB6RFW

District 2 Commissioner - Port of Port Townsend
Chief Engineer - KPTZ
El Jefe de Contenido - Port Townsend Film Festival
Private Pilot-Single Engine Land | Airframe & Powerplant Mechanic / Inspection 
Authorization

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

No. Logs are ok where they are. /var/snd has all sound files only. 
Everything works except it won't load the next day logs.


On 11/27/2019 10:26 AM, Rob Landry wrote:


Huh? Logs aren't stored in /var/snd. This shouldn't be happening.

If you create a short log with a CHAIN to itself at the end, and run 
it, will it reload?



Rob


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Lorne Tyndale]

Mark,

Your problem is clear from the lines:

> /dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
> /dev/mapper/centos-root   50G   50G   39M 100% /

You have 1.4TB allocated to /home (where you've only used 4.5GB of that
1.4TB), but only 50GB allocated to your root of /

/var/snd is a folder off /  so for sure it'll run out of space quickly.

You'll need to reallocate a bunch of the space currently in /home to
/var/snd

Cheers,

Lorne Tyndale


> 
> 
> Here's the output from df -h:
> 
> Filesystem   Size  Used Avail Use% Mounted on
> devtmpfs 3.8G 0  3.8G   0% /dev
> tmpfs3.8G 0  3.8G   0% /dev/shm
> tmpfs3.8G   98M  3.7G   3% /run
> tmpfs3.8G 0  3.8G   0% /sys/fs/cgroup
> /dev/mapper/centos-root   50G   50G   39M 100% /
> /dev/sda2   1014M  343M  672M  34% /boot
> /dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
> /dev/sda1200M   12M  189M   6% /boot/efi
> tmpfs771M  4.0K  771M   1% /run/user/42
> tmpfs771M  8.0K  771M   1% /run/user/1001
> 
> Mark
> 
> -Original Message-
> From: rivendell-dev-boun...@lists.rivendellaudio.org 
>  On Behalf Of Cowboy
> Sent: Wednesday, November 27, 2019 4:17 AM
> To: 'rivendell-dev@lists.rivendellaudio.org' 
> 
> Subject: Re: [RDD] RDImport
> 
> On Wed, 27 Nov 2019 01:00:27 +
> Mark Murdock  wrote:
> 
> > drive is a 1.5 TB drive, and there's plenty of space left on it, but 
> > when I looked at the properties of /var/snd it said that 49.5 GB had 
> > been used of 53.7 GB, and that there is only 133 MB left (99% used). 
> > Is there a way to expand the space allocated for /var/snd? Is there a 
> > solution for this?
> 
>  The solution depends on the problem !
>  You've described the symptom. ;-)
> 
>  Please post the output from
>  df -h
> 
> --
> Cowboy
> 
> See more of your friends.
> Become a nudist !
> 
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport and Disk Space

[Steve Varholy]

Mark:

Add another drive, move/copy /var/snd to it and create a symbolic link to the 
new location. Done.

In many instances keeping your audio store on a system drive is disfavored. 
That way a system dusc failure only requires a system reimage.



Sent from my Sprint Phone.

-- Original message--
From: Mark Murdock
Date: Wed, Nov 27, 2019 11:53 AM
To: rivendell-dev@lists.rivendellaudio.org;
Cc:
Subject:[RDD] RDImport and Disk Space

So apparently, I need a drive much bigger than 1.5 TB unless I want to run 
compressed files. I wish I had known this going into this. The Rivendell System 
Requirements specify a 1 TB drive. Maybe that should be bumped up to 4 TB for 
music stations that want to store uncompressed files. Do I have to start over 
from scratch for the server, or can I clone the 1.5 TB drive? If I clone the 
drive, won’t it preserve the 50 GB size on /dev/mapper/centos-root?

Thanks,

Mark Murdock
KAMB
90 E. 16th St.
Merced, CA 95340
(209) 723-1015
m...@celebrationradio.com<mailto:m...@celebrationradio.com>
Website<https://celebrationradio.com/>

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport and Disk Space

[Mark Murdock]

So apparently, I need a drive much bigger than 1.5 TB unless I want to run 
compressed files. I wish I had known this going into this. The Rivendell System 
Requirements specify a 1 TB drive. Maybe that should be bumped up to 4 TB for 
music stations that want to store uncompressed files. Do I have to start over 
from scratch for the server, or can I clone the 1.5 TB drive? If I clone the 
drive, won't it preserve the 50 GB size on /dev/mapper/centos-root?

Thanks,

Mark Murdock
KAMB
90 E. 16th St.
Merced, CA 95340
(209) 723-1015
m...@celebrationradio.com
Website

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Mark Murdock]

Here's the output from df -h:

Filesystem   Size  Used Avail Use% Mounted on
devtmpfs 3.8G 0  3.8G   0% /dev
tmpfs3.8G 0  3.8G   0% /dev/shm
tmpfs3.8G   98M  3.7G   3% /run
tmpfs3.8G 0  3.8G   0% /sys/fs/cgroup
/dev/mapper/centos-root   50G   50G   39M 100% /
/dev/sda2   1014M  343M  672M  34% /boot
/dev/mapper/centos-home  1.4T  4.5G  1.4T   1% /home
/dev/sda1200M   12M  189M   6% /boot/efi
tmpfs771M  4.0K  771M   1% /run/user/42
tmpfs771M  8.0K  771M   1% /run/user/1001

Mark

-Original Message-
From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Cowboy
Sent: Wednesday, November 27, 2019 4:17 AM
To: 'rivendell-dev@lists.rivendellaudio.org' 

Subject: Re: [RDD] RDImport

On Wed, 27 Nov 2019 01:00:27 +
Mark Murdock  wrote:

> drive is a 1.5 TB drive, and there's plenty of space left on it, but 
> when I looked at the properties of /var/snd it said that 49.5 GB had 
> been used of 53.7 GB, and that there is only 133 MB left (99% used). 
> Is there a way to expand the space allocated for /var/snd? Is there a 
> solution for this?

 The solution depends on the problem !
 You've described the symptom. ;-)

 Please post the output from
 df -h

--
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Rob Landry]

Huh? Logs aren't stored in /var/snd. This shouldn't be happening.

If you create a short log with a CHAIN to itself at the end, and run it, 
will it reload?



Rob

--
Сквозь грозы сияло нам солнце свободы
И Linus великий нам путь озарил;
Нас вырастил Stallman на верность народу,
На труд и на подвиги нас вдохновил.

On Wed, 27 Nov 2019, R. Choy wrote:

This happened to me too. I had a linux friend format the unassigned space, 
set up a symbolic link to the new /var/snd, moved all files over, and all was 
well.except it will no longer load the next day's log. So every night 
just before midnight I have to manually load log. Been doing this for over a 
year now. I suspect there's a path or SQL path that doesn't acknowledge the 
new /var/snd___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Wed, 27 Nov 2019 08:46:22 -0500
Fred Gleason  wrote:

> > What's the upside of compression? 
> > When drives were expensive, you
> > could make a case for compression of audio. I just don't see an imparitive 
> > now.  

 The only valid argument I think I could make, would be transferring
 content across a bandwidth constrained network.
 Even then, the argument is for compression during the transfer,
 not on the storage medium.

-- 
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[R. Choy]

This happened to me too. I had a linux friend format the unassigned 
space, set up a symbolic link to the new /var/snd, moved all files over, 
and all was well.except it will no longer load the next day's log. 
So every night just before midnight I have to manually load log. Been 
doing this for over a year now. I suspect there's a path or SQL path 
that doesn't acknowledge the new /var/snd


Rick

On 11/27/2019 7:16 AM, Cowboy wrote:

On Wed, 27 Nov 2019 01:00:27 +
Mark Murdock  wrote:


drive is a 1.5 TB drive, and there's plenty of space left on it, but when I 
looked at the
properties of /var/snd it said that 49.5 GB had been used of 53.7 GB, and that 
there is only 133
MB left (99% used). Is there a way to expand the space allocated for /var/snd? 
Is there a
solution for this?

  The solution depends on the problem !
  You've described the symptom. ;-)

  Please post the output from
  df -h


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Fred Gleason]

On Nov 26, 2019, at 21:18, Robert Jeffares  wrote:

> Some motherboards are not able to manage drives greater than 2TB. There are 
> ways around this. 

It depends on the distro as well. CentOS 7 can handle it easily, but CentOS 6 
not so much. (There are workarounds, but they are fairly terrifying.)

Given that CentOS 6 goes EOL in a year, anyone on that platform really ought to 
be moving up to 7 at this point anyway.

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Jonathan Cohen]

This sounds like the crazy defaults of CentOS where the majority of space can 
end up allocated to /home rather than the system as a whole. You might want to 
check your disk partitioning.

 
Jonathan

 
From: rivendell-dev-boun...@lists.rivendellaudio.org 
 On Behalf Of Mark Murdock
Sent: 27 November 2019 01:00
To: 'rivendell-dev@lists.rivendellaudio.org' 

Subject: [RDD] RDImport

 
OK, need some help. I’ve been using rdimport to import a bunch of songs from 
our SS32 system into Rivendell, and just as I was about to finish up, I started 
getting an error that said, “Audio Converter Error: No space left on device, 
skipping [file name].” The drive is a 1.5 TB drive, and there’s plenty of space 
left on it, but when I looked at the properties of /var/snd it said that 49.5 
GB had been used of 53.7 GB, and that there is only 133 MB left (99% used). Is 
there a way to expand the space allocated for /var/snd? Is there a solution for 
this?

 
Thanks!

 
Mark Murdock

KAMB

90 E. 16th St.

Merced, CA 95340

(209) 723-1015

m...@celebrationradio.com <mailto:m...@celebrationradio.com> 

Website

 

___



Rivendell-dev mailing list



Rivendell-dev@lists.rivendellaudio.org 
<mailto:Rivendell-dev@lists.rivendellaudio.org> 



http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev 
<http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Fred Gleason]

On Nov 26, 2019, at 20:29, Bill Putney  wrote:

> What's the upside of compression? A 10TB disk is ~$200. Most radio station 
> libraries aren't that big, even when PCM storage is used. So, what's the 
> gain? When drives were expensive, you could make a case for compression of 
> audio. I just don't see an imparitive now.

++

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Cowboy]

On Wed, 27 Nov 2019 01:00:27 +
Mark Murdock  wrote:

> drive is a 1.5 TB drive, and there's plenty of space left on it, but when I 
> looked at the
> properties of /var/snd it said that 49.5 GB had been used of 53.7 GB, and 
> that there is only 133
> MB left (99% used). Is there a way to expand the space allocated for 
> /var/snd? Is there a
> solution for this?

 The solution depends on the problem !
 You've described the symptom. ;-)

 Please post the output from
 df -h

-- 
Cowboy

See more of your friends.
Become a nudist !

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Robert Jeffares]

Hi Mark,

you need a bigger drive. I started with 1TB and am now running 4TB which 
cost less that the 1TB at the time it was purchased!


We are at about 80,000 cuts which is a reasonable size.

There are reams of reasons not to use 'compressed' files. #1 is 
compressed = leave stuff out.


I have clients with  systems that use other formats. The difference is 
noticeable.


Some motherboards are not able to manage drives greater than 2TB. There 
are ways around this.


Optimum system has a big drive mounted as /var/snd which stores audio.

Do not panic about audio you have already imported. You can rename 
/var/snd install the new big drive then copy files over.


How many tracks do you have in the WO system? What format are they in? 
You may find they are 22050 sample rate as well as being mp3 @ 128kbs.


Over time if you can get back to the source audio and import that you 
will notice a big difference


regards

Robert Jeffares


On 27/11/19 2:00 PM, Mark Murdock wrote:


OK, need some help. I’ve been using rdimport to import a bunch of 
songs from our SS32 system into Rivendell, and just as I was about to 
finish up, I started getting an error that said, “Audio Converter 
Error: No space left on device, skipping [file name].” The drive is a 
1.5 TB drive, and there’s plenty of space left on it, but when I 
looked at the properties of /var/snd it said that 49.5 GB had been 
used of 53.7 GB, and that there is only 133 MB left (99% used). Is 
there a way to expand the space allocated for /var/snd? Is there a 
solution for this?


Thanks!

Mark Murdock

KAMB

90 E. 16^th St.

Merced, CA 95340

(209) 723-1015

m...@celebrationradio.com 

Website 


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Bill Putney]

We store everything uncompressed. We can use audio stored for later editing 
without cascading compression losses. 

What's the down side to compressed storage? Stacking compression has possibly 
unknowable consequences. Storage and playback is straightforward without coding 
or decoding. If you have compressed files in your automation and then you 
decode that on playback and stream that audio you are decompressing it again. 
Every pass through lossy compression makes the audio quality worse and worse.

What's the upside of compression? A 10TB disk is ~$200. Most radio station 
libraries aren't that big, even when PCM storage is used. So, what's the gain? 
When drives were expensive, you could make a case for compression of audio. I 
just don't see an imparitive now.

We record everything that is broadcast at our station 24/7/365. We do that with 
Apple Lossless  Compression. It statistically saves about 40% in disk size over 
PCM. A year's storage is contained  on a single 3TB disk. Because it's lossless 
we can use it for later production without stacking compression quality losses.

Bill Putney
District 2 Commissioner - Port of Port Townsend
Chief Engineer - KPTZ
El Jefe de Contenido - Port Townsend Film Festival
Private Pilot-Single Engine Land | Airframe & Powerplant / Inspection 
Authorization

> On Nov 26, 2019, at 17:07, Geoff Barkman  wrote:
> 
> Hi Mark.
> What format are you storing your audio files in? Mp2 or pcm wav? A way to 
> work out is a 3 minute audio file is 30 mb if pcm wav, whereas mp2 is about 
> 4mb. Pcm wavs will fill your hard drive quickly. 
> Many thanks
> Geoff Barkman
> 
> 
>> On Wed, Nov 27, 2019, 2:00 PM Mark Murdock  wrote:
>> OK, need some help. I’ve been using rdimport to import a bunch of songs from 
>> our SS32 system into Rivendell, and just as I was about to finish up, I 
>> started getting an error that said, “Audio Converter Error: No space left on 
>> device, skipping [file name].” The drive is a 1.5 TB drive, and there’s 
>> plenty of space left on it, but when I looked at the properties of /var/snd 
>> it said that 49.5 GB had been used of 53.7 GB, and that there is only 133 MB 
>> left (99% used). Is there a way to expand the space allocated for /var/snd? 
>> Is there a solution for this?
>> 
>>  
>> 
>> Thanks!
>> 
>>  
>> 
>> Mark Murdock
>> 
>> KAMB
>> 
>> 90 E. 16th St.
>> 
>> Merced, CA 95340
>> 
>> (209) 723-1015
>> 
>> m...@celebrationradio.com
>> 
>> Website
>> 
>>  
>> 
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport

[Geoff Barkman]

Hi Mark.
What format are you storing your audio files in? Mp2 or pcm wav? A way to
work out is a 3 minute audio file is 30 mb if pcm wav, whereas mp2 is about
4mb. Pcm wavs will fill your hard drive quickly.
Many thanks
Geoff Barkman


On Wed, Nov 27, 2019, 2:00 PM Mark Murdock 
wrote:

> OK, need some help. I’ve been using rdimport to import a bunch of songs
> from our SS32 system into Rivendell, and just as I was about to finish up,
> I started getting an error that said, “Audio Converter Error: No space left
> on device, skipping [file name].” The drive is a 1.5 TB drive, and there’s
> plenty of space left on it, but when I looked at the properties of /var/snd
> it said that 49.5 GB had been used of 53.7 GB, and that there is only 133
> MB left (99% used). Is there a way to expand the space allocated for
> /var/snd? Is there a solution for this?
>
>
>
> Thanks!
>
>
>
> Mark Murdock
>
> KAMB
>
> 90 E. 16th St.
>
> Merced, CA 95340
>
> (209) 723-1015
>
> m...@celebrationradio.com
>
> Website 
>
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport

[Mark Murdock]

OK, need some help. I've been using rdimport to import a bunch of songs from 
our SS32 system into Rivendell, and just as I was about to finish up, I started 
getting an error that said, "Audio Converter Error: No space left on device, 
skipping [file name]." The drive is a 1.5 TB drive, and there's plenty of space 
left on it, but when I looked at the properties of /var/snd it said that 49.5 
GB had been used of 53.7 GB, and that there is only 133 MB left (99% used). Is 
there a way to expand the space allocated for /var/snd? Is there a solution for 
this?

Thanks!

Mark Murdock
KAMB
90 E. 16th St.
Merced, CA 95340
(209) 723-1015
m...@celebrationradio.com
Website

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport error on terminal

[Bruce Lee Mones]

On Fri, Sep 27, 2019 at 12:32 PM Fred Gleason 
wrote:

> On Sep 26, 2019, at 02:42, Bruce Lee Mones 
> wrote:
>
> Incantation: $rdimport --verbose --autotrim-level=-30
> --normalization-level=-16 --segue-level=-13 --autotrim-level=-50
> --metadata-pattern=%t --delete-source ILOKANO *.mp3
>
> Error: ASSERT: "uint(i) < uint(size())" in file
> /usr/include/QtCore/qstring.h, line 699
> Aborted
>
>
> Fixed in git [master bfee1c8].
>
>

Can I do #yum update?

Cheers!!!





> Cheers!
>
>
> |-|
> | Frederick F. Gleason, Jr. | Chief Developer |
> |   | Paravel Systems |
> |-|
> | A room without books is like a body without a soul. |
> | |
> | -- Cicero   |
> |-|
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport error on terminal

[Fred Gleason]

On Sep 26, 2019, at 02:42, Bruce Lee Mones  wrote:

> Incantation: $rdimport --verbose --autotrim-level=-30 
> --normalization-level=-16 --segue-level=-13 --autotrim-level=-50 
> --metadata-pattern=%t --delete-source ILOKANO *.mp3
> 
> Error: ASSERT: "uint(i) < uint(size())" in file 
> /usr/include/QtCore/qstring.h, line 699
> Aborted

Fixed in git [master bfee1c8].

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport error on terminal

[Fred Gleason]

On Sep 26, 2019, at 02:42, Bruce Lee Mones mailto:brucelee.mo...@gmail.com>> wrote:

> Incantation: $rdimport --verbose --autotrim-level=-30 
> --normalization-level=-16 --segue-level=-13 --autotrim-level=-50 
> --metadata-pattern=%t --delete-source ILOKANO *.mp3
> 
> Error: ASSERT: "uint(i) < uint(size())" in file 
> /usr/include/QtCore/qstring.h, line 699
> Aborted

Confirmed here (even with redundant '--autotrim-level’ switch removed).

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport error on terminal

[jm]

Hi

there are twice the arguments --autotrim-level

JM

Le 26/09/2019 ? 08:42, Bruce Lee Mones a ?crit?:

Hello,

Please advise on error encountered while importing audio using 
rdimport on terminal.


Incantation: $rdimport --verbose --autotrim-level=-30 
--normalization-level=-16 --segue-level=-13 --autotrim-level=-50 
--metadata-pattern=%t --delete-source ILOKANO *.mp3


Error: ASSERT: "uint(i) < uint(size())" in file 
/usr/include/QtCore/qstring.h, line 699

Aborted

System:
Rivendell 3.1.0 on CentOS7 using Paravel script
i3-8th Gen, 4Gb RAM

TIA

Bruce

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDImport error on terminal

[Bruce Lee Mones]

Hello,

Please advise on error encountered while importing audio using rdimport on
terminal.

Incantation: $rdimport --verbose --autotrim-level=-30
--normalization-level=-16 --segue-level=-13 --autotrim-level=-50
--metadata-pattern=%t --delete-source ILOKANO *.mp3

Error: ASSERT: "uint(i) < uint(size())" in file
/usr/include/QtCore/qstring.h, line 699
Aborted

System:
Rivendell 3.1.0 on CentOS7 using Paravel script
i3-8th Gen, 4Gb RAM

TIA

Bruce
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] RDimport

[Gabriele Fergola]

Hello Fred,
i noticed rdimport have problem with file in utf8 format.
All the file with an accented letter will not be imported.

Regards
Gabriele
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport segue editor not working correctly

[Fred Gleason]

On Fri, 2019-06-21 at 08:42 +0200, Gabriele Fergola wrote:
> trying rivendell 3.0 I noticed segue editor is affected still from
> the same little bug like 2.0 version.
> Dropboxes still configure rdimport segue level to thousand instead of
> decimal how u can see:
> 
> 16085 ?Sl 0:00 /usr/bin/rdimport --persistent-dropbox-
> id=1 --drop-box --add-scheduler-code=10s --normalization-level=-14 --
> autotrim-level=-40 --segue-level=-1000 --segue-length=2500 --fix-
> broken-formats --delete-source --startdate-offset=0 --enddate-
> offset=0 --log-filename=10s.log --log-directory=/home/rd/Logs --
> verbose 10s /home/rd/music_import/10s/*
> 
> I know Fred u asked me to send the patched to git but I'm really
> sorry I don't know how to send it. I tried but I fail :S  (please
> teach me how to do it and I will)

I've just created a new issue at GitHub for this (#451). You can see it
at:

https://github.com/ElvishArtisan/rivendell/issues/451

The developers will now take a look this as part of our usual bug-
swatting processes. Thanks for letting us know.

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] RDImport segue editor not working correctly

[Gabriele Fergola]

Ok the patch attached to my previous email is not anymore good.

the modification need to be in the file rdservice/startup.cpp:

From
  args.push_back(QString().sprintf("--segue-level=%d",
   q->value(21).toInt()));

to
  args.push_back(QString().sprintf("--segue-level=%d",
   q->value(21).toInt()/100));

Regards
Gabriele

-- Forwarded message -
Da: Gabriele Fergola 
Date: ven 21 giu 2019 alle ore 08:42
Subject: RDImport segue editor not working correctly
To: Rivendell-Dev 


Hello,
trying rivendell 3.0 I noticed segue editor is affected still from the same
little bug like 2.0 version.
Dropboxes still configure rdimport segue level to thousand instead of
decimal how u can see:

16085 ?Sl 0:00 /usr/bin/rdimport --persistent-dropbox-id=1
--drop-box --add-scheduler-code=10s --normalization-level=-14
--autotrim-level=-40* --segue-level=-1000* --segue-length=2500
--fix-broken-formats --delete-source --startdate-offset=0
--enddate-offset=0 --log-filename=10s.log --log-directory=/home/rd/Logs
--verbose 10s /home/rd/music_import/10s/*

I know Fred u asked me to send the patched to git but I'm really sorry I
don't know how to send it. I tried but I fail :S  (please teach me how to
do it and I will)

This was the patch i sent some times ago :

--- rdcatchd/startdropboxes.cpp 2018-12-10 11:01:29.886166332 +0100
+++ rdcatchd/startdropboxes.cpp 2018-12-10 11:01:47.072241190 +0100
@@ -89,7 +89,7 @@
 }
 if(q->value(21).toInt()<1) {
 cmd+=
-  QString().sprintf(" --segue-level=%d",q->value(21).toInt());
+  QString().sprintf(" --segue-level=%d",q->value(21).toInt()/100);
 cmd+=
   QString().sprintf(" --segue-length=%u",q->value(22).toUInt());
 }

Is it possible to put in the next master?


Thanks
Gabriele
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Fred Gleason]

On Nov 19, 2018, at 23:17, ija...@jamcorbroadcast.com wrote:

> Would this also work for voice tracker. 

If you mean the ‘Import’ button on Voice Tracker dialog in rdlogedit(1), then 
I’m afraid not. That feature does not use rdimport(1) (and hence, nor the 
nested_import script).

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[ijames]

Fred

Would this also work for voice tracker. We find ourselves importing 
files manually. I know want to speed up the process. Can you give an 
example of how to start import the files.


Thanks


On 2018-11-16 14:48, Fred Gleason wrote:

On Nov 16, 2018, at 12:50, Richard Elen  wrote:


As I am a novice here, I would be most grateful if you could do me
the favour of providing an example usage of nested-import.pl, just
so that I get it right first time.

The command-line invocation I am using currently would be:

rdimport --verbose --segue-level=-10 --autotrim-level=-30
--normalization-level=-10  MUSIC *

How would I call the Perl script with these parameters?


The usage is very similar to that of rdimport(1) — in fact, it takes
all of the same options. The difference is that the  now
refers to *directories*, rather than files! So, say you had a
directory full of MP3s in a directory called ‘/home/rd/MyMusic’.
You could import the whole batch into a group called ‘MUSIC’ by
doing:

 nested-import.pl MUSIC /home/rd/MyMusic

If ‘/home/rd/MyMusic’ contained subdirectories, it would recurse
down into those as well. And so on.

However, a lot of the real power lies in the fact that all of the
usual rdimport(1) commands can still be given and will work as
expected. Thus, you could do:

 nested-import.pl --segue-level=-10 --autotrim-level=-30
--normalization-level=-10 MUSIC /home/rd/MyMusic

and all of those level parameters would be applied to each import,
just as if you’d done each one individually with rdimport(1).

It works with scheduler codes too. Say Drew has sent you a USB drive
full of Bahamian music, which you’ve mounted at
‘/media/usb_key’. You could create a scheduler code (in
rdadmin(1)) called ‘BHMA’, then import the music by doing:

 nested-import.pl --add-scheduler-code=BHMA MUSIC /media/usb_key

and then every file imported would be tagged with code ‘BHMA’ so
you could program the music scheduler to call for one wherever you
wanted to add a little Caribbean flavor to your music mix. (Of course,
you can also add your standard level parameters to that invocation so
the levels and markers come in just right as well).

Lots of possibilities here. The easiest way to get started is the
experiment with a few files and see what effect turning the various
knobs produce. I wouldn’t try a batch of 5000 files until you have a
good sense of what to expect.

Cheers!

|--|
| Frederick F. Gleason, Jr. |  Chief Developer
|
|   |  Paravel Systems
|
|--|
|  A room without books is like a body without a soul.
|
| -- Cicero
|
|--|
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Richard Elen]

Excellent! Thanks very much for the detailed response, a great help!

-R


On 16-Nov-18 19:48, Fred Gleason wrote:


The usage is very similar to that of rdimport(1)...

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Fred Gleason]

On Nov 16, 2018, at 12:50, Richard Elen  wrote:
> As I am a novice here, I would be most grateful if you could do me the favour 
> of providing an example usage of nested-import.pl, just so that I get it 
> right first time. 
> 
> The command-line invocation I am using currently would be:
> 
> rdimport --verbose --segue-level=-10 --autotrim-level=-30 
> --normalization-level=-10  MUSIC *
> 
> How would I call the Perl script with these parameters?
> 

The usage is very similar to that of rdimport(1) — in fact, it takes all of the 
same options. The difference is that the  now refers to 
*directories*, rather than files! So, say you had a directory full of MP3s in a 
directory called ‘/home/rd/MyMusic’. You could import the whole batch into a 
group called ‘MUSIC’ by doing:

nested-import.pl MUSIC /home/rd/MyMusic

If ‘/home/rd/MyMusic’ contained subdirectories, it would recurse down into 
those as well. And so on.

However, a lot of the real power lies in the fact that all of the usual 
rdimport(1) commands can still be given and will work as expected. Thus, you 
could do:

nested-import.pl --segue-level=-10 --autotrim-level=-30 
--normalization-level=-10 MUSIC /home/rd/MyMusic

and all of those level parameters would be applied to each import, just as if 
you’d done each one individually with rdimport(1).

It works with scheduler codes too. Say Drew has sent you a USB drive full of 
Bahamian music, which you’ve mounted at ‘/media/usb_key’. You could create a 
scheduler code (in rdadmin(1)) called ‘BHMA’, then import the music by doing:

nested-import.pl --add-scheduler-code=BHMA MUSIC /media/usb_key

and then every file imported would be tagged with code ‘BHMA’ so you could 
program the music scheduler to call for one wherever you wanted to add a little 
Caribbean flavor to your music mix. (Of course, you can also add your standard 
level parameters to that invocation so the levels and markers come in just 
right as well).

Lots of possibilities here. The easiest way to get started is the experiment 
with a few files and see what effect turning the various knobs produce. I 
wouldn’t try a batch of 5000 files until you have a good sense of what to 
expect.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Richard Elen]

Fred,

As I am a novice here, I would be most grateful if you could do me the 
favour of providing an example usage of nested-import.pl, just so that I 
get it right first time.


The command-line invocation I am using currently would be:

rdimport --verbose --segue-level=-10 --autotrim-level=-30 
--normalization-level=-10  MUSIC *


How would I call the Perl script with these parameters?

Many thanks

--Richard E


On 16-Nov-18 17:17, Fred Gleason wrote:


  * How do I make it recurse so it crawls the source library and
grabs the content of all my album folders and sub-folders? Only a
few files are in the root: most are in album folders and
sometimes deeper.

rdimport(1) doesn’t do recursion by itself, but can be made to do so 
with a little scripting. See:


https://github.com/ElvishArtisan/rivendell-importers

and take a look at the ‘nested-import.pl’ script.


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Fred Gleason]

On Nov 16, 2018, at 12:37, Richard Elen  wrote:

> Thanks for this! Is there a solution to my other query?

Just use a  of ‘*’.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Richard Elen]

Thanks for this! Is there a solution to my other query?

--Richard E


  * How do I import all audio file types in one go, or at least *.mp3
and *.flac for starters?;
  * How do I make it recurse so it crawls the source library and
grabs the content of all my album folders and sub-folders? Only a
few files are in the root: most are in album folders and
sometimes deeper.

rdimport(1) doesn’t do recursion by itself, but can be made to do so 
with a little scripting. See:


https://github.com/ElvishArtisan/rivendell-importers

and take a look at the ‘nested-import.pl’ script.


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Fred Gleason]

On Nov 16, 2018, at 11:43, Richard Elen  wrote:

> The first thing I see is the message:
> "Session management: None of the authentication protocols specified are 
> supported". 
> What is this telling me?

Useless cruft from your desktop manager. You can safely ignore it.


> Meanwhile, the files appear successfully ingested from the root of the source 
> library. However:
> How do I import all audio file types in one go, or at least *.mp3 and *.flac 
> for starters?;
> How do I make it recurse so it crawls the source library and grabs the 
> content of all my album folders and sub-folders? Only a few files are in the 
> root: most are in album folders and sometimes deeper.
rdimport(1) doesn’t do recursion by itself, but can be made to do so with a 
little scripting. See:

https://github.com/ElvishArtisan/rivendell-importers

and take a look at the ‘nested-import.pl’ script.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Richard Elen]

Hi...

I now have a 2TB drive mounted at /var that can hopefully contain the RD 
music library in WAV format and I'm beginning to import files. As a 
result I have a couple of queries.


I am navigating to the source music library root directory, which is a 
read-only-mounted NTFS partition, and issuing the command:
rdimport --verbose --segue-level=-10 --autotrim-level=-30 
--normalization-level=-10  MUSIC *.mp3


The first thing I see is the message:
"Session management: None of the authentication protocols specified are 
supported".

What is this telling me?

Meanwhile, the files appear successfully ingested from the root of the 
source library. However:


 * How do I import all audio file types in one go, or at least *.mp3
   and *.flac for starters?;
 * How do I make it recurse so it crawls the source library and grabs
   the content of all my album folders and sub-folders? Only a few
   files are in the root: most are in album folders and sometimes deeper.


MTIA for any observations.

Best,
--Richard E
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Fred Gleason]

On Nov 7, 2018, at 10:03, Rob Landry <41001...@interpring.com> wrote:

> A client of mine used to use AudioVault. I spent lots of hours examining AV 
> .wav files to see how the metadata was stored, and was surprised to discover 
> that each file stored its metadata twice: in an AV10 chunk, and again in a 
> CART chunk; Lord only knows why. I was left to guess which one was supposed 
> to be authoritative.

The CART chunk is publicly documented as an AES standard [AES46-2002-(r2007)] 
and is there to facilitate interoperability with other systems (a Good Thing). 
The AV10 chunk is proprietary to AudioVault, and contains additional ‘secret 
sauce’ (things like outcue strings, post marker location, etc) that are not 
included in the standard CART chunk. (Rivendell BTW will recognize and use 
*both* when importing metadata from an AV system). Other vendors have other 
'secret sauce’ chunks of their own that serve similar purposes, ‘SCOT’ and 
‘ENCO’ being two that come to mind immediately (yes, Rivendell can read those 
too).


> AudioVault struck me as a thinly disguised Pandora's box of chaos and 
> contradictions. There were layers on top of layers, each one seemingly 
> written by people who knew nothing about the others.

Conway’s Law in action. [See https://en.wikipedia.org/wiki/Conway's_law]


> Date and time formats varied from file to file; I found one in which the 
> durations of audio files were stored as floating point numbers representing 
> fractions of a day.

My favorite is in a feature of the VMS operating system, where an operator 
could manually specify a system clock offset at boot time. The units of time 
used was the micro-fortnight. (I leave it as an exercise for the student to 
work out a conversion from seconds).


> And underlying it all, like Satan in the pit of Dante's Inferno, was Windows, 
> an operating system written for secretaries and accountants. AVSAT would 
> crash from time to time during Boston Celtics games when it tried to record 
> news headlines into a file that AVAIR had cued up to play at the next break. 
> The Celtics would call for the break, AVAIR would play it, and then there'd 
> be silence... Rivendell would have handled it all seamlessly.

No further comment necessary.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  There is only one thing worse than having your competitors trying   |
|  to inter-operate with your systems - and that is to have your   |
|  competitors *not* trying to inter-operate with your systems.|
|   --Alan(UK), GrokLaw.net|
|--|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Rob Landry]

On Tue, 6 Nov 2018, Fred Gleason wrote:


Thus, in Rivendell, we make a strong separation: the audio store holds audio
and the database holds metadata. Audio in the audio store is *immutable*;
once it’s written, it can never be changed short of being *deleted*.
Information in the database OTOH can be changed at any time. This separation
immediately takes an entire class of hard-to-find-and-fix bugs involving the
synchronization of two non-orthogonal processes off the table while greatly
simplifying the conceptual model of how the overall system works: a major
win in each case.


That makes perfect sense.


It also allows us to use an off-the-shelf RDBMS
(MySQL/MariaDB) that has had hundreds of thousands of man-hours invested in
its design and debugging instead of having to whomp up one of our own (a
major savings of resources). While this does create two sets of data that
each require backup, there are well-understood techniques in the IT industry
for managing such situations.


What I do for several stations is maintain a second Rivendell system at 
the transmitter site. I run a cron job at the studio that periodically 
compares the CART and CUTS tables between the studio and transmitter 
systems; it updates the database at the transmitter with any changes made 
at the studio, and rsync's the corresponding audio files from the stutio 
to the transmitter site.


I have a second cron job running that does the same thing with logs. The 
transmitter site system is therefore up tyo date with the latest songs, 
spots, voice tracks, weather forecasts, etc. and can be put on the air 
with the flick of a relay if anything goes wrong at the studio.


In addition, I have the MySQL database at the studio backup up nightly by 
yet another cron job, and the backups kept for a week before being 
overwritten.



Rob

--
Я там, где ребята толковые,
Я там, где плакаты "Вперёд",
Где песни рабочие новые
Страна трудовая поёт.

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Rob Landry]

Well, the other side of the coin is that if you have two copies of the 
metadata, one in a MySQL database and the other in the file headers, then 
you need some mechanism to keep them synchronized. Otherwise you become 
the proverbial man with two watches who can never be sure what time it is.


A client of mine used to use AudioVault. I spent lots of hours examining 
AV .wav files to see how the metadata was stored, and was surprised to 
discover that each file stored its metadata twice: in an AV10 chunk, and 
again in a CART chunk; Lord only knows why. I was left to guess which one 
was supposed to be authoritative.


AudioVault struck me as a thinly disguised Pandora's box of chaos and 
contradictions. There were layers on top of layers, each one seemingly 
written by people who knew nothing about the others. Date and time formats 
varied from file to file; I found one in which the durations of audio 
files were stored as floating point numbers representing fractions of a 
day.


And underlying it all, like Satan in the pit of Dante's Inferno, was 
Windows, an operating system written for secretaries and accountants. 
AVSAT would crash from time to time during Boston Celtics games when it 
tried to record news headlines into a file that AVAIR had cued up to play 
at the next break. The Celtics would call for the break, AVAIR would play 
it, and then there'd be silence... Rivendell would have handled it all 
seamlessly.



Rob

--
Я там, где ребята толковые,
Я там, где плакаты "Вперёд",
Где песни рабочие новые
Страна трудовая поёт.

On Tue, 6 Nov 2018, Richard Elen wrote:



IIRC, you can store a full complement of metadata in a WAV file and there is
a standard for it, it's just not commonly done. I must admit that the one
thing that has concerned me slightly is the fact that the ingested files are
completely unidentifiable - the idea of writing out and maintaining the
metadata in the ingested files in case of a need for database reconstruction
sounds like a neat idea on the face of it.

On Mon, 5 Nov 2018, Fred Gleason wrote:

  ...This was one of the fundamental design principles laid down
  at
  the very inception of the project: the audio store contains
  *only* audio;
  all other metadata goes in the SQL database.


What was the rationale behind this decision, incidentally? Given the amount
of thought that has gone into the project as a whole, I imagine there is a
very good reason for it.

-_R


On 06-Nov-18 16:50, Rob Landry wrote:

  Of course, one consequence of this approach is that if you lose
  the MySQL database, the audio files will be more or less
  useless.

  If each audio file had headers carrying copies of the metadata,
  it would be possible to reconstruct the database fromt hem in
  the event of a disaster.



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Sherrod Munday]

On Nov 6, 2018, at 15:42, Fred Gleason  wrote:
> …
> They had an auxiliary program called the ‘SoundHound’ (derisively referred to 
> as the ‘SoundPig’ by one of my co-workers) that would continually scan the 
> set of audio files on the system, building and updating a searchable database 
> of the metadata.

That’s not the only name it was known by… but not all are fit to print. ;-)

I do *not* miss that particular automation system - at all.  As noted, it would 
frequently crash and caused no small amount of consternation and headache.  
With six or seven channels of audio running at our facility, it was ridiculous 
how many times per day we had to go restart that metadata scraper utility on 
multiple machines.

In contrast, dumping the entire mySQL database takes only a few moments 
(completely in the background, even on a running system) and the resulting file 
can be placed anywhere without effort (indeed; it can be written directly to a 
mapped share or RAID system, etc.) so there’s no excuse for not having a backup 
of the database.

--
Sherrod Munday


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Fred Gleason]

On Nov 6, 2018, at 14:06, Richard Elen  wrote:
> IIRC, you can store a full complement of metadata in a WAV file and there is 
> a standard for it, it's just not commonly done.
> 
There are several public standards for such, as well as a whole slew of _ad 
hoc_ private ones, invented by vendors for use in specific product lines. 


> I must admit that the one thing that has concerned me slightly is the fact 
> that the ingested files are completely unidentifiable - the idea of writing 
> out and maintaining the metadata in the ingested files in case of a need for 
> database reconstruction sounds like a neat idea on the face of it. 
> 
There are some options in Rivendell for aiding the recovery of a damaged audio 
store. See for example the --relink-audio switch in rddbcheck(8).


> On Mon, 5 Nov 2018, Fred Gleason wrote: 
> 
>> ...This was one of the fundamental design principles laid down at 
>> the very inception of the project: the audio store contains *only* audio; 
>> all other metadata goes in the SQL database.
> 
> What was the rationale behind this decision, incidentally? Given the amount 
> of thought that has gone into the project as a whole, I imagine there is a 
> very good reason for it.

At the time (ca. 2002) I was very familiar with a radio automation program 
(name withheld here to protect the guilty) that used this very technique of 
putting the metadata into the audio files. They had an auxiliary program called 
the ‘SoundHound’ (derisively referred to as the ‘SoundPig’ by one of my 
co-workers) that would continually scan the set of audio files on the system, 
building and updating a searchable database of the metadata. For you see, a 
broadcast automation system *needs* a database; it’s the only way you have of 
finding things quickly enough to be useful in a near-realtime system. The 
SoundHound would frequently get behind-hand in keeping the database in sync 
with the metadata that was in the audio files, resulting in all sorts of races, 
crashes and other system mayhem. Also, what’s often forgotten is that metadata 
in a broadcast automation system is an inherently *dynamic* thing; constantly 
being updated and changed. Since the audio files were also the metadata store, 
that meant that they had to rewrite the audio file every time a piece of 
metadata changed: a major non-orthogonality in the system.

Thus, in Rivendell, we make a strong separation: the audio store holds audio 
and the database holds metadata. Audio in the audio store is *immutable*; once 
it’s written, it can never be changed short of being *deleted*. Information in 
the database OTOH can be changed at any time. This separation immediately takes 
an entire class of hard-to-find-and-fix bugs involving the synchronization of 
two non-orthogonal processes off the table while greatly simplifying the 
conceptual model of how the overall system works: a major win in each case. It 
also allows us to use an off-the-shelf RDBMS (MySQL/MariaDB) that has had 
hundreds of thousands of man-hours invested in its design and debugging instead 
of having to whomp up one of our own (a major savings of resources). While this 
does create two sets of data that each require backup, there are 
well-understood techniques in the IT industry for managing such situations.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  It's always good to take an orthogonal view of things.  It  |
|  develops ideas. |
| -- Ken Thompson  |
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Richard Elen]

IIRC, you can store a full complement of metadata in a WAV file and 
there is a standard for it, it's just not commonly done. I must admit 
that the one thing that has concerned me slightly is the fact that the 
ingested files are completely unidentifiable - the idea of writing out 
and maintaining the metadata in the ingested files in case of a need for 
database reconstruction sounds like a neat idea on the face of it.


On Mon, 5 Nov 2018, Fred Gleason wrote:


...This was one of the fundamental design principles laid down at
the very inception of the project: the audio store contains *only* audio;
all other metadata goes in the SQL database. 


What was the rationale behind this decision, incidentally? Given the 
amount of thought that has gone into the project as a whole, I imagine 
there is a very good reason for it.


-_R


On 06-Nov-18 16:50, Rob Landry wrote:


Of course, one consequence of this approach is that if you lose the 
MySQL database, the audio files will be more or less useless.


If each audio file had headers carrying copies of the metadata, it 
would be possible to reconstruct the database fromt hem in the event 
of a disaster. 


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Fred Gleason]

On Nov 6, 2018, at 11:50, Rob Landry <41001...@interpring.com> wrote:

> Of course, one consequence of this approach is that if you lose the MySQL 
> database, the audio files will be more or less useless.

Yup. Better have a good backup plan in place!


> If each audio file had headers carrying copies of the metadata, it would be 
> possible to reconstruct the database fromt hem in the event of a disaster.

And if you lose the audio files, you’re done also. Ditto on the backup plan.

I don’t see how losing the MySQL DB is perceived as being somehow ‘riskier’ 
than losing the audio data. *Both* are well-understood risks, which can be 
mitigated by a good backup scheme.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[Fred Gleason]

On Nov 6, 2018, at 12:15, David Klann  wrote:

> My experience has been that rdimport ignores _all_ of the
> metadata if it finds problems with _any_ of the metadata it (someone
> please correct me if I misunderestimate that).

Can you gives us a specific example of where this occurs?

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[drew Roberts]

Of course,

if you have the storage space and the horsepower, you could always export
all the audio every so often... This puts a lot of the metadata into the
files exported. Does it put it all? You can export to flac as well...

all the best,

drew

On Tue, Nov 6, 2018 at 11:50 AM Rob Landry <41001...@interpring.com> wrote:

> On Mon, 5 Nov 2018, Fred Gleason wrote:
>
> > They don’t. This was one of the fundamental design principles laid down
> at
> > the very inception of the project: the audio store contains *only* audio;
> > all other metadata goes in the SQL database.
>
> Of course, one consequence of this approach is that if you lose the MySQL
> database, the audio files will be more or less useless.
>
> If each audio file had headers carrying copies of the metadata, it would
> be possible to reconstruct the database fromt hem in the event of a
> disaster.
>
>
> Rob
>
>
> --
> Я там, где ребята толковые,
> Я там, где плакаты "Вперёд",
> Где песни рабочие новые
> Страна трудовая поёт.
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>


-- 
Enjoy great *Bahamian Music* at:
Bahamian Or Nuttin - http://www.bahamianornuttin.com

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - Suggested ingestion parameters?

[David Klann]

Hi Richard,

On 11/5/18 5:29 PM, Richard G Elen wrote:
> Hi...
> 
> I am soon to ingest our music library using rdimport.
> 
> The source library structure is basically
> ~/Artistname/Albumname/trackfiles and they may be multiple album
> subfolders in the Artistname folder.
> 
> We've spent quite a lot of time and effort getting our metadata in good
> order so hopefully all will go well.
> 
> looking at the man pages, rdimport has a great number of options, but,
> being new to this, I wonder if anyone can suggest what is a good
> general-purpose set of configuration options that will be most likely to
> give the best results. Fortunately or unfortunately we have an extremely
> eclectic library ranging from mediaeval to rock, so I am expecting to
> have to do some fine tuning.
> 
> But some basic suggestions would be gratefully received, and thanks in
> advance.

I have written a ZSH script to wrap rdimport. Mostly the script is
irrelevant to your question, but you can see how I invoke it at the
bottom of the attached file (in the series of lines starting with
"${DEBUG} ${RDIMPORT}"). The file is also available on GitHub at
https://github.com/opensourceradio/ram/blob/master/usr/local/bin/import-rd

Given the recent discussion on the list regarding normalization level, I
recommend setting (and will change) the default normalization in the
script from -4 dBFS to -12 dBFS.

While rdimport(1) is pretty good at extracting metadata from audio
files, I like to do so manually, and then set the the database fields to
predictable values on the command line rather than simply leaving them
blank. My experience has been that rdimport ignores _all_ of the
metadata if it finds problems with _any_ of the metadata it (someone
please correct me if I misunderestimate that).

Feel free to ask questions!

  ~David Klann
#!/bin/zsh

setopt NO_CASE_MATCH
zmodload zsh/regex
zmodload zsh/terminfo
autoload colors
colors

# This script complies with Semantic Versioning: http://semver.org/
vMajor=0
vMinor=1
vPatch=4
vHash='$Hash: 917b77e$'

# Tell them how to use this command.
usage() {
  myName=${1}

  ${CAT} << EOF
${myName}: import digital audio tracks into the Rivendell Library using 
rdimport(1).

Summary: ${myName##*/} [ --code (-c) {  or 'list' } ]
   [ --label (-l)  ]
   [ --normalization  ]
   --group (-g) {  or 'list' }
   audio-file ...

You may use the word "list" for the --code (-c) and --group (-g)
options. This will cause ${myName##*/} to list the available codes or
groups and prompt for which one(s) to use. You may specify multiple
Scheduler Codes with the "-c" (aka "--code") option; do this by
specifying the codes separated by commas (you must quote the list of
Scheduler Codes if you include spaces between the codes).

This script will set Scheduler Code to the "genre" meta tag if the
"genre" matches a valid Rivendell Scheduler code. Otherwise the
"genre" meta tag will be ignored.

The script will attempt to extract the label name from the meta
tags. You can explicitely set this with the --label option.

Normalization level defaults to -4 dBFS.

EOF
}

# Check to be sure it is a valid Scheduler Code. Returns true or false
# based on the regex match test.
validSchedCode() {
  local definedCodes=${1} ; shift
  local requestedCode=${1} ; shift

  for schedCode in $(echo ${definedCodes}) ; do
[[ "${requestedCode}" = ${schedCode} ]] && return 0
  done

  return 1
}

# Check to be sure it is a valid GROUP. Returns true or false based on
# the regex match test
validGroup() {
  local definedGroups=${1} ; shift
  local requestedGroup=${1} ; shift

  [[ "${definedGroups}" =~ ".*${requestedGroup}.*" ]]
}

# Figure out the file type and extract the meta tags from it.
tags() {
  local track="${1}"

  # NB: these string match tests are performed case INsensitively
  # (see setopt, above).
  if [[ "${track##*.}" = 'flac' ]] ; then
flacTags "${track}"
  elif [[ "${track##*.}" = 'ogg' ]] ; then
vorbisTags "${track}"
  elif [[ "${track##*.}" = 'mp3' ]] ; then
id3Tags "${track}"
  else
echo "${BOLD}Cannot figure out what kind of file this is. I give 
up!${NORM}" >&2
exit
  fi
}

# We prefer the style of metaflac(1), so leave these alone.
flacTags() {
  local track="${1}"

  ${METAFLAC} --list --block-type=VORBIS_COMMENT "${track}" | ${FGREP} ' 
comment['
}

# We prefer the style of metaflac(1), so do only minimal processing.
# Output from vorbiscomment(1) is expected to be simply "key=value" format.
vorbisTags() {
  local track="${1}"
  local index=1

  ${VORBISCOMMENT} --list "${track}" | while read line ; do

echo "comment[$((index++))]: ${line}"

  done
}

# We prefer the style of metaflac(1), so convert the ID3 tags to
# metaflac style.
id3Tags() {
  local track=${1}

  ${ID3INFO} "${track}" | while read line ; do
case "${line#=== }" in
  TT2*|TIT2*) echo "comment[1]: title=${line#*: }" ;; # 
(Title/songname/content 

Re: [RDD] rdimport - audio file location and ingestion

[Rob Landry]

On Mon, 5 Nov 2018, Fred Gleason wrote:


They don’t. This was one of the fundamental design principles laid down at
the very inception of the project: the audio store contains *only* audio;
all other metadata goes in the SQL database.


Of course, one consequence of this approach is that if you lose the MySQL 
database, the audio files will be more or less useless.


If each audio file had headers carrying copies of the metadata, it would 
be possible to reconstruct the database fromt hem in the event of a 
disaster.



Rob


--
Я там, где ребята толковые,
Я там, где плакаты "Вперёд",
Где песни рабочие новые
Страна трудовая поёт.
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] rdimport - Suggested ingestion parameters?

[Richard G Elen]

Hi...

I am soon to ingest our music library using rdimport.

The source library structure is basically 
~/Artistname/Albumname/trackfiles and they may be multiple album 
subfolders in the Artistname folder.


We've spent quite a lot of time and effort getting our metadata in good 
order so hopefully all will go well.


looking at the man pages, rdimport has a great number of options, but, 
being new to this, I wonder if anyone can suggest what is a good 
general-purpose set of configuration options that will be most likely to 
give the best results. Fortunately or unfortunately we have an extremely 
eclectic library ranging from mediaeval to rock, so I am expecting to 
have to do some fine tuning.


But some basic suggestions would be gratefully received, and thanks in 
advance.


--Richard E

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Fred Gleason]

On Nov 5, 2018, at 17:44, John Edstrom  wrote:

> Interesting.  According to the doc the BWF V2 standard accomodates EBU
> R128 loudness metadata, which someone was asking about the other day. 
> Am I correct in interpreting that to mean than its OK to include
> loudness metadata in the audio file, and it will be stripped and stored
> in the DB, but the playout algorithm, so far, ignores it?

Haven’t really wrapped my head around R128 yet. I plan to do so once v3.x is 
production-ready.

Cheers!


|--|
| Frederick F. Gleason, Jr. |  Chief Developer |
|   |  Paravel Systems |
|--|
|  A room without books is like a body without a soul. |
| -- Cicero|
|--|___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Richard Elen]

Hi, Robert...

It's heading that way. I indeed picked up a used machine for the current 
experiments and it should be fine for the application. Thankfully 
storage is cheap too: I have a 2TB drive on its way. I'll let rdimport 
ingest from the existing NTFS copy of the library and save its version 
on the new drive.


--Richard E


On 05-Nov-18 21:59, Robert Jeffares wrote:


I would heartily recommend you build  a Rivendell system on a 
dedicated computer.


You can source 2nd hand 64 bit machines relatively inexpensively and 
they work quite well.


You may need to install a bigger drive for /var/snd depending on the 
music library size, but you can run with almost anything to see how it 
works.




___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Richard Elen]

Hi, Fred...

Many thanks for these helpful comments, much appreciated.

--Richard E


On 05-Nov-18 21:39, Fred Gleason wrote:
...the audio store contains *only* audio; all other metadata goes in 
the SQL database.


...The European Broadcasting Union has codified the standard audio 
storage format for use in professional broadcast storage and play-out 
systems. Rivendell (as well as many proprietary systems) adhere to 
these standards


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[John Edstrom]

On Mon, 2018-11-05 at 16:39 -0500, Fred Gleason wrote:
> On Nov 5, 2018, at 16:17, Richard Elen  wrote:
> ...
> 
> It's a matter of standards-compliance. The European Broadcasting
> Union has codified the standard audio storage format for use in
> professional broadcast storage and play-out systems. Rivendell (as
> well as many proprietary systems) adhere to these standards:
> 
>   https://tech.ebu.ch/docs/tech/tech3285.pdf

Interesting.  According to the doc the BWF V2 standard accomodates EBU
R128 loudness metadata, which someone was asking about the other day. 
Am I correct in interpreting that to mean than its OK to include
loudness metadata in the audio file, and it will be stripped and stored
in the DB, but the playout algorithm, so far, ignores it?

   JE


-- 
John Edstrom 
Firebare

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] rdimport - audio file location and ingestion

[Robert Jeffares]

Hi Richard,

I would heartily recommend you build  a Rivendell system on a dedicated 
computer.


You can source 2nd hand 64 bit machines relatively inexpensively and 
they work quite well.


You may need to install a bigger drive for /var/snd depending on the 
music library size, but you can run with almost anything to see how it 
works.


Yes all audio is stored as wav for good reason.

Bit of effort but I can assure you it's worth it.

regard

Robert Jeffares



On 06/11/18 05:20, Richard G Elen wrote:


Hi...

I am just starting with Rivendell, so please pardon my total lack of 
knowledge at this point which may result in my asking meaningless or 
impossible questions.


I had set up a CentOS 7.5 system in advance and then followed the 
Rivendell CentOS installation document to install Rivendell (the only 
difference from the document's recommendation being that I did not 
define a separate partition for /var, as I followed the standard 
CentOS install recommendation).


As I want to get to know Rivendell for a while and continue to use an 
existing Windows playout system in the meantime, the machine 
dual-boots into CentOS or Win 10. A 1.5 TB partition on the drive is 
formatted as NTFS and contains the music library, which is accessed by 
the Windows playout system currently. The library is mounted with 
ntfs-3g on boot into CentOS so it can be accessed by Rivendell.


It appears that Rivendell requires to make a complete copy of the 
music library on ingestion with rdimport. This is inconvenient. There 
is insufficient space on the current drive to allow Rivendell to store 
a copy of the music library. Now of course I could attach an external 
drive, copy the library on to it and then let Rivendell ingest it from 
there and copy it back to where it is now. In which case, two 
questions arise:


 1. If I follow the copy-back-and-forth course outlined above, will
the Rivendell-ingested copy of the music library still be able to
be used by the Windows playout system or would I need to have /two
/active copies of the music library, one for Windows playout and
the other for Rivendell?
 2. Does Rivendell require to make a copy of the library at all, or
can it simply ingest the metadata and populate the database
without copying the actual audio files?

Any observations or advice would be greatly appreciated, and thanks in 
advance.


--Richard Elen
radioriel.org



___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev


___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev