Re: [Bacula-users] Bacula Windows client using ntfs change log?

2012-08-20 Thread lst_hoe02

Zitat von lst_ho...@kwsoft.de:

 Hello List

 i recently read about the NTFS change journal and its aim to support
 backups in finding files for incremental backups. Are there any plans
 to maybe include such a feature in the windows client? I suspect this
 would be really helpful on bigger sized filesystems with a lot of
 files. Information about the NTFS feature can for example found here:
 http://msdn.microsoft.com/en-us/library/aa363798.aspx

 Regards

 Andreas


No one with Windows Clients, not needed at all, or is it just a dumb question?

Any pointers are welcome

Andreas



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Windows client using ntfs change log?

2012-08-20 Thread James Harper
 Hello List
 
 i recently read about the NTFS change journal and its aim to support backups
 in finding files for incremental backups. Are there any plans to maybe include
 such a feature in the windows client? I suspect this would be really helpful 
 on
 bigger sized filesystems with a lot of files. Information about the NTFS
 feature can for example found here:
 http://msdn.microsoft.com/en-us/library/aa363798.aspx
 

I've implemented this in an unsubmitted patch. The problems I found are:

. takes a bit of memory to hold the data
. it doesn't completely solve the accurate problem for any 'since' date unless 
you keep the complete log in memory rather than 'this file has changed' 
(although it would in the regular since-last-backup case)
. bacula really needs to store the FRN in the catalog, which takes extra space

Another idea I had was to cross reference the MFT vs the accurate file 
information. Enumerating the MFT isn't particularly quick, but it is orders of 
magnitude faster than actually traversing the entire filesystem looking for 
changes. If Bacula recorded the FRN and the last USN then a is file changes? 
would be straightforward.

I can send the patch (against 5.2.0 I think) if you would like to use it as a 
starting point.

James


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Windows client using ntfs change log?

2012-08-20 Thread lst_hoe02

Zitat von James Harper james.har...@bendigoit.com.au:

 Hello List

 i recently read about the NTFS change journal and its aim to support backups
 in finding files for incremental backups. Are there any plans to  
 maybe include
 such a feature in the windows client? I suspect this would be  
 really helpful on
 bigger sized filesystems with a lot of files. Information about the NTFS
 feature can for example found here:
 http://msdn.microsoft.com/en-us/library/aa363798.aspx


 I've implemented this in an unsubmitted patch. The problems I found are:

 . takes a bit of memory to hold the data

Not sure what you mean. Must the changelog be hold in (real) Memory  
for some reason or is it simply related to the next one below?

 . it doesn't completely solve the accurate problem for any 'since'  
 date unless you keep the complete log in memory rather than 'this  
 file has changed' (although it would in the regular  
 since-last-backup case)

The accurate problem is the one with reappearing files on restore from  
incremental backup, no? But the deleted files are also logged in the  
change journal so we are at the same point as of now without the need  
to search the whole volume for changes in the most cases.

 . bacula really needs to store the FRN in the catalog, which takes  
 extra space

Would this be per Job or per File? Should be per Job, no?

 Another idea I had was to cross reference the MFT vs the accurate  
 file information. Enumerating the MFT isn't particularly quick, but  
 it is orders of magnitude faster than actually traversing the entire  
 filesystem looking for changes. If Bacula recorded the FRN and the  
 last USN then a is file changes? would be straightforward.

 I can send the patch (against 5.2.0 I think) if you would like to  
 use it as a starting point.

Nice to here that at least the idea could not be that dumb :-) Would  
be really nice to see and maybe a pointer to already happend  
discussion on the list.

Many Thanks

Andreas



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Windows client using ntfs change log?

2012-08-16 Thread lst_hoe02
Hello List

i recently read about the NTFS change journal and its aim to support  
backups in finding files for incremental backups. Are there any plans  
to maybe include such a feature in the windows client? I suspect this  
would be really helpful on bigger sized filesystems with a lot of  
files. Information about the NTFS feature can for example found here:  
http://msdn.microsoft.com/en-us/library/aa363798.aspx

Regards

Andreas






--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users