Re: [Dorset] dorset Digest, Vol 555, Issue 1
John
I use this as my backup:
function RsyncThem
{
echo now rsynch directories
#rsync -rvpt --delete /home /backup/
rsync -vlH -e ssh --times --perms --owner --group --recursive /home
/masterbackup/backup
rsync -vlH -e ssh --times --perms --owner --group --recursive /etc
/masterbackup/backup/etc/
}
this function is called by a sheel being run as root.
To answer your questions
1) no it does not verify the files copied
2) As you see I actually chose which directories to save, rather than what to
exclude. But your list seems reasonable
3) I just use 1 as it gives me enough information
4) Running as the root user, from the root cron, I backup every user in the
/home directory and all subdirectories, including the '.'
Hope this helps
Peter L
On 29/09/14 13:00, dorset-requ...@mailman.lug.org.uk wrote:
Send dorset mailing list submissions to
dorset@mailman.lug.org.uk
To subscribe or unsubscribe via the World Wide Web, visit
https://mailman.lug.org.uk/mailman/listinfo/dorset
or, via email, send a message with subject or body 'help' to
dorset-requ...@mailman.lug.org.uk
You can reach the person managing the list at
dorset-ow...@mailman.lug.org.uk
When replying, please edit your Subject line so it is more specific
than Re: Contents of dorset digest...
Today's Topics:
1. How to use rsync for backups (JD)
--
Message: 1
Date: Sun, 28 Sep 2014 21:22:17 +0100
From: JD john.dub...@hotmail.co.uk
To: dorset@mailman.lug.org.uk
Subject: [Dorset] How to use rsync for backups
Message-ID: blu436-smtp1121468f9f8a40c5aaa2ca7a2...@phx.gbl
Content-Type: text/plain; charset=utf-8; format=flowed
I've set up an initial use of rsync for making a mirror-type backup and
I'd like some advice to improve it, please.
1. Does rsync verify the copies it makes?
2. What non-user directories should I exclude? My initial command is:
sudo rsync -azvv --delete --exclude=/tmp/
--exclude=/home/john/Downloads/ --exclude=/home/john/GM2
--exclude=/home/shareddocs/Downloads/
--exclude=/home/evelyn/Downloads/ --exclude=proc/ --exclude=dev/
--exclude=mnt/ --exclude=media/ --exclude=sys//
'/media/john/Ubuntu Backup/Mirror-backup'
3. How many v's should I use, e.g -azv?
4. I (user john) couldn't copy the .thunderbird subdirectories of user
evelyn. Why not? I ran with sudo and other items copied OK.
Temporarily, I've changed their permissions.
Thanks in advance.
John
--
___
dorset mailing list
dorset@mailman.lug.org.uk
https://mailman.lug.org.uk/mailman/listinfo/dorset
End of dorset Digest, Vol 555, Issue 1
**
--
Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00
Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/
New thread on mailing list: mailto:dorset@mailman.lug.org.uk
How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] How to use rsync for backups
Hi John, I've set up an initial use of rsync for making a mirror-type backup and I'd like some advice to improve it, please. 1. Does rsync verify the copies it makes? Well, it does have -c, AKA --checksum, though it's actually MD4 or MD5. This changes how the list of files that need updating is calculated. Instead of being just size and modification time, the sender reads every byte to build the MD5 digest. This is before transmission starts so it can delay the start of things quite a bit, and cause a lot more sender I/O. The receiver will do the same for any file that's the same length. I tend to use this option in case anything overwrote bytes in a file and then touched back its original modification time. rsync(1) points out Note that rsync always verifies that each transferred file was correctly reconstructed on the receiving side by checking a whole-file checksum that is generated as the file is transferred, but that automatic after-the-transfer verification has nothing to do with this option’s before-the-transfer Does this file need to be updated? check. But my reading is this is confirming that the bytes requested to be written to disk on the receiver match; it doesn't then ask the OS to get them from spinning rust, bypassing any cache. So, if you want to achieve that scrub of the copy, you could do your backup, with or without -c, up to you, then flush the OS's cache on the receiver, and repeat with -c. Since the files will mostly be the same length, the receiver will pull from disk to calculate the digests. IIRC to have the kernel discard its cache of file's contents, do sudo sh -c 'echo 1 /proc/sys/vm/drop_caches' More simply, use -c each time and the next backup with check that the files transferred in the previous one that are still the same length read from disk OK on both machines. And it will keep doing this on every future backup. BTW, I find -PacivHAX a convenient mnemonic for what rsync options might be useful. I think you might want to consider -HX to add to your -a. 2. What non-user directories should I exclude? My initial command is: sudo rsync -azvv --delete --exclude=/tmp/ --exclude=/home/john/Downloads/ --exclude=/home/john/GM2 --exclude=/home/shareddocs/Downloads/ --exclude=/home/evelyn/Downloads/ --exclude=proc/ --exclude=dev/ --exclude=mnt/ --exclude=media/ --exclude=sys// '/media/john/Ubuntu Backup/Mirror-backup' --exclude takes a pattern so you might find --exclude='/home/*/Downloads/' a useful shortcut. You've excluded various mount points; -x stops its crossing into other filesystems, so you could specify that and list the top of the ones you do want transferred instead, e.g. / and /home. 3. How many v's should I use, e.g -azv? Depends how noisy you want the output? I tend to peruse the listing of my GNU tar incremental backups sorted by the size of the file so I can spot any monsters getting in that I didn't intend. I rectify, delete the latest backup (and revert the incremental database), and re-run. 4. I (user john) couldn't copy the .thunderbird subdirectories of user evelyn. Why not? I ran with sudo and other items copied OK. Temporarily, I've changed their permissions. Don't know. Would help to see the permissions of the directory its complaining about and every parent before they were changed together with rsync's complaint. Cheers, Ralph. -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] List Behaviour - Reply / Reply to All
** Ralph Corderoy ra...@inputplus.co.uk [2014-09-28 16:23]: David wrote: Maybe the list logic has changed recently I think the behaviour of the list has changed. Looking at older emails the reply-to header used to be the list email address It has indeed changed, as announced last month. :-) http://thread.gmane.org/gmane.user-groups.linux.uk.dorset/5944 Some more background on the issue. http://www.unicom.com/pw/reply-to-harmful.html https://woozle.org/~neale/papers/reply-to-still-harmful.html ** end quote [Ralph Corderoy] That explains the direct email I had to a list post a while back. I use Mutt so just use L to reply to lists and it actually catches me by suprise when it doesn't work on a mailing list (Yahoo I'm looking at you for your groups!). -- Paul Tansom | Aptanet Ltd. | http://www.aptanet.com/ | 023 9238 0001 = Registered in England | Company No: 4905028 | Registered Office: Ralls House, Parklands Business Park, Forrest Road, Denmead, Waterlooville, Hants, PO7 6XP -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
Hi Terry On 30/09/14 14:05, d-...@hadrian-way.co.uk wrote: Hi, Our company has a presence in several European countries and our collective bosses would like to set up a Corporate Social Network based on Linux servers and Clients running on Windows hardware. The system would have to be private to the company using the Intranet or our other shared networking capabilities. Does anyone have any recommendations? I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally and have some varied opinions: 1. I like the blog environment, having been a big fan of Groklaw, but that implementation of Geeklog didn't allow attachments. 2. Some think that a Facebook style of presentation would be ideal, but I've never used it so cannot comment. Is there an opensource package that can implement Facebook functionality? 3. We think that twitter is too brief. 4. We think that IRC is too immediate; if your not there you've missed it. What else could be used? Maybe I've missed something but a mailing list seems to tick all the boxes above. Cheers Tim -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
Hi Terry, I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally What's the nature of the information you want to share? Considered blog posts? One-line QA? A curated resource of information? If you can get over the name, then BuddyPress is pretty flexible in terms of tailoring a website for a social network: - https://buddypress.org/ It could be served to an internal company network rather than www, and setup with the feature set which suits (as Ralph says - what do you want to share?) Stephen -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
Atlassian Confuence https://www.atlassian.com/software/confluence? You can get a 'starter' licence for between $10 and $30, that will support up to 10 users. Sufficient to try out its capabilities. Adrian On 30 September 2014 14:40, Stephen Wolff step...@maxgatedigital.com wrote: Hi Terry, I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally What's the nature of the information you want to share? Considered blog posts? One-line QA? A curated resource of information? If you can get over the name, then BuddyPress is pretty flexible in terms of tailoring a website for a social network: - https://buddypress.org/ It could be served to an internal company network rather than www, and setup with the feature set which suits (as Ralph says - what do you want to share?) Stephen -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
On 30 September 2014 at 14:33 Ralph Corderoy ra...@inputplus.co.uk wrote: Hi Terry, I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally What's the nature of the information you want to share? Considered blog posts? One-line QA? A curated resource of information? That's part of the problem; they're not really sure. I think it might function as a newsletter in some scenarios, but with the ability to accept comments, where appropriate. In other scenarios, it might be used to seed ideas, with inline drawings / photographs, etc to really get over the message. The key I think is engagement. When Groklaw was at it height it was generating hundreds of responses to each article, with ideas flying thick and fast. I don't believe a mailing list (as suggested elsewhere) will work like that for people who aren't necessarily technical, whereas an active blog or Facebook type solution might, because of the multimedia element. As a bonus, it might also be useful to have the ability to collaborate on documents etc. I think we are looking for suggestions to see what might be the most attractive. Does anyone have any experience of Corporate Social Networks (linux based or otherwise)? Terry Coles -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
If they already use Microsoft Office (and especially if they already subscribe to Office 365) then Yammer is a service that is specifically designed to be a corporate social network at the Office 365 Mid-Size Business tier. I've never used it though and naturally it's a service, not something you can run yourself on your own hardware. I've had some brief exposure to Atlassians Confluence software, which you can buy to self-host or pay for monthly per user as a service and it seems pretty good, though like all things it has a bit of a learning curve. I've only barely used it though, so can't say much about it other than people I work with have given it very high praise. It's probably better if you buy into the rest of Atlassian's suite of tools like Jira and Hipchat, etc but by itself I don't imagine it's too bad. Speaking of Hipchat, that might actually fit the bill. It's basically an IRC style private chatroom client, but depending on the plans you get (and you can even use it for free with unlimited users if I recall) when you attach images or files to messages, they stay in the system so they can be referred back to, at least for a time. If what they need is something more real-time rather than a long-term document storage/sharing system, then that might work out well for them. I use hipchat extensively at work for communicating with my team, sharing files, talking to clients, holding meetings, etc and find I rarely use anything else for sharing things, getting feedback or collaborating on projects. I can highly recommend it, and since you can trial it for free, if it sounds like it might fit the bill, I'd encourage you to investigate it. We also use their dev API to feed in info from our various monitoring tools for servers, software builds, support tickets, etc so it acts a company-wide notification system as well as shared communications platform. On 30 September 2014 15:12, d-...@hadrian-way.co.uk d-...@hadrian-way.co.uk wrote: On 30 September 2014 at 14:33 Ralph Corderoy ra...@inputplus.co.uk wrote: Hi Terry, I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally What's the nature of the information you want to share? Considered blog posts? One-line QA? A curated resource of information? That's part of the problem; they're not really sure. I think it might function as a newsletter in some scenarios, but with the ability to accept comments, where appropriate. In other scenarios, it might be used to seed ideas, with inline drawings / photographs, etc to really get over the message. The key I think is engagement. When Groklaw was at it height it was generating hundreds of responses to each article, with ideas flying thick and fast. I don't believe a mailing list (as suggested elsewhere) will work like that for people who aren't necessarily technical, whereas an active blog or Facebook type solution might, because of the multimedia element. As a bonus, it might also be useful to have the ability to collaborate on documents etc. I think we are looking for suggestions to see what might be the most attractive. Does anyone have any experience of Corporate Social Networks (linux based or otherwise)? Terry Coles -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue -- Andrew Montgomery-Hurrell Professional Geek Blog: http://darkliquid.co.uk Twitter: http://twitter.com/darkliquid Fiction: http://www.protagonize.com/author/darkliquid -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
On 30 September 2014 at 15:30 Andrew Montgomery-Hurrell darkliq...@darkliquid.co.uk wrote: If they already use Microsoft Office (and especially if they already subscribe to Office 365) then Yammer is a service that is specifically designed to be a corporate social network at the Office 365 Mid-Size Business tier. I've never used it though and naturally it's a service, not something you can run yourself on your own hardware. We are looking for a solution that can be hosted within our Corporate network, preferably on Linux servers. I've had some brief exposure to Atlassians Confluence software, which you can buy to self-host or pay for monthly per user as a service and it seems pretty good, though like all things it has a bit of a learning curve. I've only barely used it though, so can't say much about it other than people I work with have given it very high praise. It's probably better if you buy into the rest of Atlassian's suite of tools like Jira and Hipchat, etc but by itself I don't imagine it's too bad. I don't think having to pay is the issue; it's about having it hosted on our network. Speaking of Hipchat, that might actually fit the bill. It's basically an IRC style private chatroom client, but depending on the plans you get (and you can even use it for free with unlimited users if I recall) when you attach images or files to messages, they stay in the system so they can be referred back to, at least for a time. If what they need is something more real-time rather than a long-term document storage/sharing system, then that might work out well for them. I use hipchat extensively at work for communicating with my team, sharing files, talking to clients, holding meetings, etc and find I rarely use anything else for sharing things, getting feedback or collaborating on projects. I can highly recommend it, and since you can trial it for free, if it sounds like it might fit the bill, I'd encourage you to investigate it. We also use their dev API to feed in info from our various monitoring tools for servers, software builds, support tickets, etc so it acts a company-wide notification system as well as shared communications platform. Thanks for the ideas. We will be investigating all of them. Anyone come across Zimbra (http://www.zimbra.com/)? Terry Coles -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
Hi We've used Socialcast and Salesforce's Chatter, both are externally hosts (ie cloud) but both work quite well. Depends on how deep your pockets are and if you're already using Salesforce or not. -- Martin Hepworth, CISSP Oxford, UK On 30 September 2014 15:50, d-...@hadrian-way.co.uk d-...@hadrian-way.co.uk wrote: On 30 September 2014 at 15:30 Andrew Montgomery-Hurrell darkliq...@darkliquid.co.uk wrote: If they already use Microsoft Office (and especially if they already subscribe to Office 365) then Yammer is a service that is specifically designed to be a corporate social network at the Office 365 Mid-Size Business tier. I've never used it though and naturally it's a service, not something you can run yourself on your own hardware. We are looking for a solution that can be hosted within our Corporate network, preferably on Linux servers. I've had some brief exposure to Atlassians Confluence software, which you can buy to self-host or pay for monthly per user as a service and it seems pretty good, though like all things it has a bit of a learning curve. I've only barely used it though, so can't say much about it other than people I work with have given it very high praise. It's probably better if you buy into the rest of Atlassian's suite of tools like Jira and Hipchat, etc but by itself I don't imagine it's too bad. I don't think having to pay is the issue; it's about having it hosted on our network. Speaking of Hipchat, that might actually fit the bill. It's basically an IRC style private chatroom client, but depending on the plans you get (and you can even use it for free with unlimited users if I recall) when you attach images or files to messages, they stay in the system so they can be referred back to, at least for a time. If what they need is something more real-time rather than a long-term document storage/sharing system, then that might work out well for them. I use hipchat extensively at work for communicating with my team, sharing files, talking to clients, holding meetings, etc and find I rarely use anything else for sharing things, getting feedback or collaborating on projects. I can highly recommend it, and since you can trial it for free, if it sounds like it might fit the bill, I'd encourage you to investigate it. We also use their dev API to feed in info from our various monitoring tools for servers, software builds, support tickets, etc so it acts a company-wide notification system as well as shared communications platform. Thanks for the ideas. We will be investigating all of them. Anyone come across Zimbra (http://www.zimbra.com/)? Terry Coles -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
Re: [Dorset] Social Networking in a Corporate Environment
On 30/09/14 15:12, d-...@hadrian-way.co.uk wrote: On 30 September 2014 at 14:33 Ralph Corderoy ra...@inputplus.co.uk wrote: Hi Terry, I believe that the management are not really sure what they want in terms of functionality so are looking for suggestions. We have discussed this locally What's the nature of the information you want to share? Considered blog posts? One-line QA? A curated resource of information? That's part of the problem; they're not really sure. I think it might function as a newsletter in some scenarios, but with the ability to accept comments, where appropriate. In other scenarios, it might be used to seed ideas, with inline drawings / photographs, etc to really get over the message. The key I think is engagement. When Groklaw was at it height it was generating hundreds of responses to each article, with ideas flying thick and fast. I don't believe a mailing list (as suggested elsewhere) will work like that for people who aren't necessarily technical, whereas an active blog or Facebook type solution might, because of the multimedia element. As a bonus, it might also be useful to have the ability to collaborate on documents etc. I think we are looking for suggestions to see what might be the most attractive. Does anyone have any experience of Corporate Social Networks (linux based or otherwise)? Terry Coles Hi Terry, I came across Zimbra as an email client at one time, but didn't like it, I can't remember why now. I just wonder whether a forum type thing like ubuntuforums might be something that they like- divisible into topics etc. I had a look at a cycling forum - yacf.co.uk and it is managed/hosted by simplemachines.org - an open source solution. Peter M. -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
[Dorset] Next Meeting - One Week Tonight
Hi All, The next Meeting is one week tonight; same time same place: http://dorset.lug.org.uk/wiki/doku.php?id=meetings:pub#the_broadway I'll see you there. -- Terry Coles -- Next meeting: Bournemouth, Tuesday, 2014-10-07 20:00 Meets, Mailing list, IRC, LinkedIn, ... http://dorset.lug.org.uk/ New thread on mailing list: mailto:dorset@mailman.lug.org.uk How to Report Bugs Effectively: http://goo.gl/4Xue
