Re: [hlds_linux] Replays causing spikes
Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
We do manual cleanup of all files that are over three days old (is there any reason to keep them longer than one day actually?). There should never be 500k files at any point. Would it help - or is it even possible - to have the relevant folders mounted on ramfs/tmpfs? We were always running 5-8 servers simultanously with replay enabled across all of them aswell, but the issues only started sometime last month. It's quite weird. I'll check out the TF2 replay wiki. On Thu, Jul 17, 2014 at 5:32 PM, Erik-jan Riemers riem...@binkey.nl wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
Sorry I'm at work so I can't answer with more precision. I'm afraid there is quite a bit of data duplication between the folders as I recall. I never did try to do much about that since my server has space to spare. I do clean out the replays every 24 hours in the morning. And again I don't recall how much space gets eaten up by 24hours of playing, but I know my ramdisk is 500M and I never had an issue. Hope this helps somewhat. On 7/17/2014 11:50 AM, Valentin G. wrote: With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
Should qualify that last statement. Every hour I clean out replays more than 24 hours old. I don't wipe them all out at once. -Andrew On 7/17/2014 3:10 PM, The Wave wrote: Sorry I'm at work so I can't answer with more precision. I'm afraid there is quite a bit of data duplication between the folders as I recall. I never did try to do much about that since my server has space to spare. I do clean out the replays every 24 hours in the morning. And again I don't recall how much space gets eaten up by 24hours of playing, but I know my ramdisk is 500M and I never had an issue. Hope this helps somewhat. On 7/17/2014 11:50 AM, Valentin G. wrote: With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
Thanks. I'll set everything up to run replays with ramdisk and see how far it goes. On Thu, Jul 17, 2014 at 10:16 PM, The Wave thew...@thewaveserver.com wrote: Should qualify that last statement. Every hour I clean out replays more than 24 hours old. I don't wipe them all out at once. -Andrew On 7/17/2014 3:10 PM, The Wave wrote: Sorry I'm at work so I can't answer with more precision. I'm afraid there is quite a bit of data duplication between the folders as I recall. I never did try to do much about that since my server has space to spare. I do clean out the replays every 24 hours in the morning. And again I don't recall how much space gets eaten up by 24hours of playing, but I know my ramdisk is 500M and I never had an issue. Hope this helps somewhat. On 7/17/2014 11:50 AM, Valentin G. wrote: With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
Good luck! Be curious to see if it helps. On 7/17/2014 3:32 PM, Valentin G. wrote: Thanks. I'll set everything up to run replays with ramdisk and see how far it goes. On Thu, Jul 17, 2014 at 10:16 PM, The Wave thew...@thewaveserver.com wrote: Should qualify that last statement. Every hour I clean out replays more than 24 hours old. I don't wipe them all out at once. -Andrew On 7/17/2014 3:10 PM, The Wave wrote: Sorry I'm at work so I can't answer with more precision. I'm afraid there is quite a bit of data duplication between the folders as I recall. I never did try to do much about that since my server has space to spare. I do clean out the replays every 24 hours in the morning. And again I don't recall how much space gets eaten up by 24hours of playing, but I know my ramdisk is 500M and I never had an issue. Hope this helps somewhat. On 7/17/2014 11:50 AM, Valentin G. wrote: With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
Re: [hlds_linux] Replays causing spikes
Anyone tried replay_buffersize? dont know what it does exactly.. 2014-07-17 22:45 GMT+02:00 The Wave thew...@thewaveserver.com: Good luck! Be curious to see if it helps. On 7/17/2014 3:32 PM, Valentin G. wrote: Thanks. I'll set everything up to run replays with ramdisk and see how far it goes. On Thu, Jul 17, 2014 at 10:16 PM, The Wave thew...@thewaveserver.com wrote: Should qualify that last statement. Every hour I clean out replays more than 24 hours old. I don't wipe them all out at once. -Andrew On 7/17/2014 3:10 PM, The Wave wrote: Sorry I'm at work so I can't answer with more precision. I'm afraid there is quite a bit of data duplication between the folders as I recall. I never did try to do much about that since my server has space to spare. I do clean out the replays every 24 hours in the morning. And again I don't recall how much space gets eaten up by 24hours of playing, but I know my ramdisk is 500M and I never had an issue. Hope this helps somewhat. On 7/17/2014 11:50 AM, Valentin G. wrote: With the local fileserver method, how much data is duplicated between the servers replay directory and the webservers replay directory, can you do anything about that? I've never paid attention to the file sizes, do you have a rough idea how much space the files take up for a day of 24 players on the server? Do you clean up every day or more frequent? On Thu, Jul 17, 2014 at 5:48 PM, The Wave thew...@thewaveserver.com wrote: On my host (a linode) I had trouble with replay lag spikes for some time due to slow file system IO. I ended up mounting the replay folder to a ramdisk, and then cleaning it out frequently. Not an ideal solution, but it did solve the lagging. Might at least be worth a test to see if the spikes disappear. On 7/17/2014 10:32 AM, Erik-jan Riemers wrote: Just make sure you dont have 500k files in the folders, and http is the best for now too. I had ftp in use but if it didn't work it would stall the servers and sometimes hang too. With http i never had that issue. I think there are also option on how quickly it writes it or how big the buffers are you can use.. its on the tf2 replay wiki. Dont know if that will help. I've got multiple servers running on the same box with all replay and they seem to do ok.. 2014-07-17 17:23 GMT+02:00 Valentin G. nextra...@gmail.com: We have had replays enabled for over two years now, but only recently we have been experiencing massive lag spikes on our servers. When replays are disabled the spikes disappear, and a VProf told me that file access is the culprit. We already got our aging hard drive replaced but the issues remain the same. Has anything changed recently that I need to be aware of? The server is currently configured to use a local HTTP to distribute the files. Any tips or tricks on how to resolve this, or is this on Valve to fix? ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux -- Sent from your mom's iPad ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux ___ To unsubscribe, edit your list preferences, or view the list archives, please visit: https://list.valvesoftware.com/cgi-bin/mailman/listinfo/hlds_linux
