Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-12 Thread Alexander V. Makartsev
On 12.04.2019 23:47, Michael Stone wrote: > On Fri, Apr 12, 2019 at 01:13:49PM -0400, rhkra...@gmail.com wrote: >> It looks like I am writing something like 20 GB per day > > That's basically nothing for a reasonably sized modern SSD. > Still the SSD market is having a steady decline in terms of

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-12 Thread Michael Stone
On Fri, Apr 12, 2019 at 01:13:49PM -0400, rhkra...@gmail.com wrote: It looks like I am writing something like 20 GB per day That's basically nothing for a reasonably sized modern SSD.

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-12 Thread rhkramer
On Friday, April 12, 2019 08:07:07 AM Curt wrote: > On 2019-04-12, Andy Smith wrote: > > Honestly my advice to the OP as suggested what seems like many days > > ago remains: just take a measure, do a day or two of work, take > > another measure, check the difference in byte count and extrapolate

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-12 Thread Curt
On 2019-04-12, Andy Smith wrote: > > Honestly my advice to the OP as suggested what seems like many days > ago remains: just take a measure, do a day or two of work, take > another measure, check the difference in byte count and extrapolate > from there. I'd be amazed if you didn't end up with

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-12 Thread Andy Smith
Hello, On Mon, Apr 08, 2019 at 01:32:48PM -, Curt wrote: > How about: > > Subject: SSD for frequent edits of large text files? It's really hard for me to imagine any form of human editing of a text file that could wear out a modern SSD. Natural language text files just aren't that big, and

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Alexander V. Makartsev
On 08.04.2019 19:56, rhkra...@gmail.com wrote: > On Monday, April 08, 2019 10:18:28 AM Curt wrote: >> On 2019-04-08, rhkra...@gmail.com wrote: >>> And someone would (or should) ask what does "frequently" mean, and that >>> is what I am trying to quantify. >> Sure. But below a certain level of

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Curt
On 2019-04-08, rhkra...@gmail.com wrote: > > As mentioned in another post, I am starting to fear for the reilability of an > HDD (DOAs, early failures, unwilingness of the vendor / manufacturer to > provide a warranty), and, therefore, I am trying to determine if an SSD could > be a better

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Gene Heskett
On Monday 08 April 2019 10:56:33 rhkra...@gmail.com wrote: > On Monday, April 08, 2019 10:18:28 AM Curt wrote: > > On 2019-04-08, rhkra...@gmail.com wrote: > > > And someone would (or should) ask what does "frequently" mean, and > > > that is what I am trying to quantify. > > > > Sure. But below

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Monday, April 08, 2019 09:41:10 AM Alexander V. Makartsev wrote: > There are NVMe drives and SSDs intended to be used in servers with high > workloads like cache storage. These server grade drives must be rated > for at least 3 DWPD (Drive Writes Per Day) or more. Thanks! I really hadn't

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Monday, April 08, 2019 10:18:28 AM Curt wrote: > On 2019-04-08, rhkra...@gmail.com wrote: > > And someone would (or should) ask what does "frequently" mean, and that > > is what I am trying to quantify. > > Sure. But below a certain level of granularity it becomes an exercise > for which the

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread David
On Mon, 8 Apr 2019 at 22:38, wrote: > On Sunday, April 07, 2019 04:22:41 PM Reco wrote: > > On Sun, Apr 07, 2019 at 10:10:58PM +0200, Carles Pina i Estany wrote: > > > > In my SSDs I have: > > > /sys/fs/ext4/dm-0/lifetime_write_kbytes > > > > > > I'm not sure if this is specific for SSD? > > > >

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Curt
On 2019-04-08, rhkra...@gmail.com wrote: > > And someone would (or should) ask what does "frequently" mean, and that is > what I am trying to quantify. Sure. But below a certain level of granularity it becomes an exercise for which the benefits remain to be established. Large files and

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Monday, April 08, 2019 09:32:48 AM Curt wrote: > On 2019-04-08, rhkra...@gmail.com wrote: > > On Monday, April 08, 2019 03:40:54 AM Curt wrote: > >> Maybe an SSD is not the most appropriate > >> storage device for frequent editing of large files. > > > > That is what I'm trying to decide /

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Alexander V. Makartsev
On 08.04.2019 17:39, rhkra...@gmail.com wrote: > On Monday, April 08, 2019 03:40:54 AM Curt wrote: >> Maybe an SSD is not the most appropriate >> storage device for frequent editing of large files. > That is what I'm trying to decide / determine. There are NVMe drives and SSDs intended to be used

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Monday, April 08, 2019 08:39:58 AM rhkra...@gmail.com wrote: > On Monday, April 08, 2019 03:40:54 AM Curt wrote: > > Maybe an SSD is not the most appropriate > > storage device for frequent editing of large files. > > That is what I'm trying to decide / determine. I guess I'll amplify that a

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Curt
On 2019-04-08, rhkra...@gmail.com wrote: > On Monday, April 08, 2019 03:40:54 AM Curt wrote: >> Maybe an SSD is not the most appropriate >> storage device for frequent editing of large files. > > That is what I'm trying to decide / determine. It is? Sorry. I guess I was tragically thrown off the

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Monday, April 08, 2019 03:40:54 AM Curt wrote: > Maybe an SSD is not the most appropriate > storage device for frequent editing of large files. That is what I'm trying to decide / determine. > (arriving as I am now at the chocolate-covered banana > response to Euro Zone monetary integration)

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread rhkramer
On Sunday, April 07, 2019 04:22:41 PM Reco wrote: > On Sun, Apr 07, 2019 at 10:10:58PM +0200, Carles Pina i Estany wrote: > > In my SSDs I have: > > /sys/fs/ext4/dm-0/lifetime_write_kbytes > > > > I'm not sure if this is specific for SSD? > > No, it's not. It's filesystem-specific though. >

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-08 Thread Curt
On 2019-04-07, Reco wrote: >> >> I'm not sure if this is specific for SSD? > > No, it's not. It's filesystem-specific though. > Meaning - you have to use ext4 to see this attribute, but the device > where the ext4 filesystem resides does not matter. > > Reco > Maybe an SSD (arriving as I am now

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Reco
Hi. On Sun, Apr 07, 2019 at 10:10:58PM +0200, Carles Pina i Estany wrote: > > Hi, > > On Apr/06/2019, rhkra...@gmail.com wrote: > > > Can anyone confirm that, and, if so, suggest any way of measuring how much > > is > > written to a given file in a given time period (e.g., per day)?

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Carles Pina i Estany
Hi, On Apr/06/2019, rhkra...@gmail.com wrote: > Can anyone confirm that, and, if so, suggest any way of measuring how much is > written to a given file in a given time period (e.g., per day)? > > I guess at a very deep level (I mean like at the level of the disk firmware > or > driver

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Stefan Monnier
>> Not completely sure if "you assume" or "you know" it to be the case. > Sorry, I should have tried to be more clear -- sort of a digression, but I > came from an environment where anytime someone used the word assume, someone > else would point out what (they thought) that meant (it makes an

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread rhkramer
Thanks for the response -- two comments below: On Sunday, April 07, 2019 08:53:16 AM Erik Christiansen wrote: > Not the boys in blue, by any chance? Station sergeants tend to plant > that lesson early in a rookie's consciousness, I hear. No -- a large steel company that went out of business

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread rhkramer
On Sunday, April 07, 2019 05:41:42 AM Curt wrote: > On 2019-04-06, Stefan Monnier wrote: > >> 2. A lot of my editing involves editing near (but not at) the end of > >> a file. I assume (I know) that the software that saves the file is > >> smart enough not to rewrite the entire file but instead

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread rhkramer
Again, thanks to all who replied -- one comment below -- oops, that changed ;-) On Saturday, April 06, 2019 09:22:17 PM Andy Smith wrote: > You can test by writing a known quantity of data to the device (say, > with dd) and then checking out with smartctl how much the counters > altered. Here's

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Erik Christiansen
On 07.04.19 08:12, rhkra...@gmail.com wrote: > Sorry, I should have tried to be more clear -- sort of a digression, but I > came from an environment where anytime someone used the word assume, someone > else would point out what (they thought) that meant (it makes an ass out of > [yo]u and me).

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread rhkramer
Again, thanks to all who replied, some comments below. On Saturday, April 06, 2019 05:44:19 PM Stefan Monnier wrote: > > 2. A lot of my editing involves editing near (but not at) the end of > > a file. I assume (I know) that the software that saves the file is > > smart enough not to rewrite the

Re: [OFF-LIST] Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread rhkramer
Thanks to all who responded (even off list)! I will respond to some of the other posts if they did something like ask a question. I am exploring smartctl and sar (I found atsar for wheezy and loaded it, adn smartctl in smartmontools -- I had heard of (and even used smartctl sometime in the

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Curt
On 2019-04-07, Curt wrote: > On 2019-04-06, Stefan Monnier wrote: >> >>> 2. A lot of my editing involves editing near (but not at) the end of >>> a file. I assume (I know) that the software that saves the file is >>> smart enough not to rewrite the entire file but instead to preserve >>> the

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-07 Thread Curt
On 2019-04-06, Stefan Monnier wrote: > >> 2. A lot of my editing involves editing near (but not at) the end of >> a file. I assume (I know) that the software that saves the file is >> smart enough not to rewrite the entire file but instead to preserve >> the beginning of the file and just

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-06 Thread Andy Smith
Hi, On Sat, Apr 06, 2019 at 01:39:27PM -0400, rhkra...@gmail.com wrote: > Background: I am considering buying a new disk (and will write an email later > with some other questions or observations about the process), but I know > that, > at least often for SSD drives, they now specify what I

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-06 Thread Nicholas Geovanis
On Sat, Apr 6, 2019, 4:44 PM Stefan Monnier wrote: > > > 2. A lot of my editing involves editing near (but not at) the end of > > a file. I assume (I know) that the software that saves the file is > > smart enough not to rewrite the entire file but instead to preserve > > the beginning of the

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-06 Thread Stefan Monnier
> Anyway, I edit large files many times a day and try to save it at each > edit or partial edit (at a guess, one particular file is around 100 > MB, and I may save it 200 or more times a day). So, we're looking in the order of 100GB / day. > 1. I'd like to count how many times a day I actually

Re: Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-06 Thread Alexander V. Makartsev
On 06.04.2019 22:39, rhkra...@gmail.com wrote: > Background: I am considering buying a new disk (and will write an email later > with some other questions or observations about the process), but I know > that, > at least often for SSD drives, they now specify what I will call the > longevity

Measuring (or calculating) how many bytes are actually written to disk when I repeatedly save a file

2019-04-06 Thread rhkramer
Background: I am considering buying a new disk (and will write an email later with some other questions or observations about the process), but I know that, at least often for SSD drives, they now specify what I will call the longevity in terms of TB TBW (iiuc, that is terabytes total bytes