Re: [CentOS-docs] New draft article: HowTos/MigrationGuide/MigratingFiveToSix
Phil Schaffner wrote on 07/22/2011 09:44 AM: http://wiki.centos.org/HowTos/MigrationGuide/MigratingFiveToSix Have at it. :-) The page having had some attention by Alan, and another revision or two, the DRAFT status is being removed and a link being added to HowTos/MigrationGuide. Phil ___ CentOS-docs mailing list CentOS-docs@centos.org http://lists.centos.org/mailman/listinfo/centos-docs
Re: [CentOS-es] Unsort en centos
On Sat, 2011-07-23 at 21:36 -0600, troxlinux wrote: Slds lista , alguien a instalado unsort en centos 5.x , Quiero instalarlo pero no encuentro como! hum shuf que lo tienes en los coreutils, debe hacer lo mismo... creo que unsort no está mantenido por lo que leí cat /etc/aliases|shuf saludos epe alguna idea? sldss ___ CentOS-es mailing list CentOS-es@centos.org http://lists.centos.org/mailman/listinfo/centos-es
[CentOS-es] Disco usb en Centos 6
Buenas tardes Compañeros; tengo el siguiente inconveniente con un disco externo con conexion USB, lo tengo conectado para hacer nackup de el sistema pero cuando lo realiza sale el siguiente error: end_request: I/O error, dev sdc, sector 86537887 Buffer I/O error on device sdc1, logical block 10817228 Buffer I/O error on device sdc1, logical block 10817230 Buffer I/O error on device sdc1, logical block 10817231 Buffer I/O error on device sdc1, logical block 10817232 Buffer I/O error on device sdc1, logical block 10817233 Buffer I/O error on device sdc1, logical block 10817234 Buffer I/O error on device sdc1, logical block 10817235 Buffer I/O error on device sdc1, logical block 10817236 Buffer I/O error on device sdc1, logical block 10817237 Buffer I/O error on device sdc1, logical block 10817239 end_request: I/O error, dev sdc, sector 86537895 EXT3-fs error (device sdc1): read_block_bitmap: Cannot read block bitmap - block_group = 331, block_bitmap = 10846208 Aborting journal on device sdc1. journal commit I/O error Message from syslogd@matematicas at Jul 23 02:27:58 ... kernel:journal commit I/O error sd 4:0:0:0: [sdd] Assuming drive cache: write through sd 4:0:0:0: [sdd] Assuming drive cache: write through sd 4:0:0:0: [sdd] Assuming drive cache: write through EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 ext3_abort called. EXT3-fs error (device sdc1): ext3_journal_start_sb: Detected aborted journal Remounting filesystem read-only EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 EXT3-fs error (device sdc1): ext3_find_entry: reading directory #2 offset 0 Lugo reinicio el servidor y lo carga normal no se a que se debe esto, les agradeceria su colaboracion. De antemano muchas gracias Cesar Augusto Martinez Cobo Administrador de Sistemas Facultad de Ciencias Exactas y Naturales Universidad de Antioquia Tel: ++57(4)2195604 Medellin - Colombia ___ CentOS-es mailing list CentOS-es@centos.org http://lists.centos.org/mailman/listinfo/centos-es
Re: [CentOS] missing run-parts in /etc/crontab
2011/7/22 thomas veymont thomas.veym...@gmail.com: hello, after a Centos 6 fresh install, I don't see any run-parts scripts in /etc/contab like in the 5.x releases : # run-parts 01 * * * * root run-parts /etc/cron.hourly 02 4 * * * root run-parts /etc/cron.daily 22 4 * * 0 root run-parts /etc/cron.weekly 42 4 1 * * root run-parts /etc/cron.monthly was it moved somewhere else ? am I missing any package ? thanks, Tom Just consult the docs please. http://www.linuxtopia.org/online_books/rhel6/rhel_6_migration_guide/rhel_6_migration_ch04s13.html Alexander Horse's mouth better? The EL 6.1 version is at http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Migration_Planning_Guide/ch04s14.html uh-oh, I missed that. thanks for your answers Tom ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
2011/7/24 yonatan pingle yonatan.pin...@gmail.com: Hello, I have a rather annoying issue on going with one of my centos virtual servers. the server hosts a website using apache and mysql ,there are three persons involved with keeping the site up and running. and i am his root due to the fact he does not know anything with about Linux. there is an php/sql coder , and the site owner which only knows to use the CMS and upload new articles to the website. the coder and the site owner work together for a long time already , i am their new admin ( as the last one was a major ISP which failed to host the site properly ). lately the server is under-preforming and load averages are high, mysql service keeps crashing and the server is hitting max memory usage ( so i added ram .. ) , after looking into the website folders, i have found one folder which from my point of view is one of the causes for the server loads. (sorry for piping ls ). uploads]# ls | wc -l 3123 I have talked with the site owner, which in turn showed this to the coder ,now he throws the ball back claiming: it has nothing to do with server performance. the folder is full of images, about 40K each, and i have good reason to believe this is the problem, as this is not the first time i see that a folder which includes a large amount of files causes a server to under-perform. the coder is not tech savvy as one might expect, so it's really hard for me to explain the issue of having lots of files in one folder to the site owner or to the coder. the hardware is a decent machine dual E5530 24RAM with six hard drives in raid. the virtual server has 2GB of ram and it's own CPU share ( 4 cores 8 threads ). the coder is arguing with facts sadly to say he has the site owner on his side. long story short, how should i explain in the most simple way in plain english that having that much files in a folder will cause a server to work slower? pros vs cons of having a large amount of small files in the same folder on Linux Centos? I assume that you are using ext3 or ext4 filesystems? Both ext3 and ext4 slows down, if there is too much files in same directory. XFS-fs is solution to fix this problem. -- Eero ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
Am 24.07.2011 13:03, schrieb Eero Volotinen: 2011/7/24 yonatan pingle yonatan.pin...@gmail.com: uploads]# ls | wc -l 3123 I assume that you are using ext3 or ext4 filesystems? Both ext3 and ext4 slows down, if there is too much files in same directory. XFS-fs is solution to fix this problem. Eero Seriously, 3123 files in a single directory is not an issue for any of the extX filesystems. Though ext2 probably performs the worst, ext3 and particular ext4 should not have any problem with that small amount of file objects. Given that the filesystem is not already filled nearby 100%. An issue may be, how the code deals with the directory content. Horrible code for sure can impact the speed of the website, but should not affect the system globally. Yonatan, if you really are concerned about the uploads directory, then use vmstat, iostat or sar to check system parameters while the directory is accessed. Your problem is something else, I am pretty sure. Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sat, Jul 23, 2011 at 8:58 PM, Thomas Dukes tdu...@sc.rr.com wrote: Red Hat does not support upgrades between major versions (doesn't necessarily mean it's not possible) http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installation_Guide/ch-upgrade-x86.html http://linsec.ca/blog/2011/02/23/my-adventure-upgrading-rhel5-to-rhel6/ Since when?? I started with slackware 1.0 on a pentinum 1 system from VaResearch back in the mid 90's, change to Redat 2.0, then Fedora, then to Whitebox, then CentOS.. Never had a problem upgrading on an rpm based system. That's a good question. It seems that since RHEL 4 (2005), Red Hat has been telling us that upgrading from earlier major versions is not a good idea. - RHEL 3 docs say it's possible to upgrade from 2.1 to 3.x (http://goo.gl/8Gwrs) - RHEL 4 docs don't bother showing the steps and provide a lot of warnings for 2.x/3.x to 4.x (http://goo.gl/yiRGK) - RHEL 5 docs explicitly say Red Hat does not support upgrading from earlier major versions (http://goo.gl/RQABB) - RHEL 6 docs explicitly say Red Hat does not support upgrading from earlier major versions (http://goo.gl/H9zBU) I don't think RPM is the one allowing/disallowing the upgrade between major versions. The kernel architecture and other major components changes are more likely to be the culprit. I'd be surprised how you moved from Slackware 1.0 all the way to CentOS without a reinstall (because that's what is being discussed here). Just as reference, starting with Solaris 11, it'll not be possible to upgrade from earlier major versions either (although binary compatibility will still be there). Oracle is asking customers to treat earlier versions as legacy and put them in containers and/or virtual machines. Solaris 11 will change so much how things work that Oracle says it's better not to bother upgrading path from Solaris 10. My point is that big changes happen in Linux much frequently than in Solaris and even Solaris sometimes doesn't support these kinds of upgrades. -- Giovanni Tirloni ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 2:19 PM, Alexander Dalloz ad+li...@uni-x.org wrote: Am 24.07.2011 13:03, schrieb Eero Volotinen: 2011/7/24 yonatan pingle yonatan.pin...@gmail.com: uploads]# ls | wc -l 3123 I assume that you are using ext3 or ext4 filesystems? Both ext3 and ext4 slows down, if there is too much files in same directory. XFS-fs is solution to fix this problem. Eero Seriously, 3123 files in a single directory is not an issue for any of the extX filesystems. Though ext2 probably performs the worst, ext3 and particular ext4 should not have any problem with that small amount of file objects. Given that the filesystem is not already filled nearby 100%. An issue may be, how the code deals with the directory content. Horrible code for sure can impact the speed of the website, but should not affect the system globally. Yonatan, if you really are concerned about the uploads directory, then use vmstat, iostat or sar to check system parameters while the directory is accessed. Your problem is something else, I am pretty sure. Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos Hi, Alexander good suggestions, ill monitor I/O and mysql code, sounds like a code related issue and not a centos issue after all. it runs on ext3 ,i could only guess how to code deals with the dir, as it seems to be the site builds the pages using php+mysql for each visitor, with about 40K unique visitors a day, that is a lot of I/O. This looks like an issue with MySQL after all. Queries: 48.0M qps: 66 Slow:65.0 avg-cpu: %user %nice %system %iowait %steal %idle 0.970.000.28 97.910.000.84 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 0 102 5.30 3.13 2.06 2 120 3.14 2.77 2.22 we wait and see, tail -f log-slow-queries.log /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community Edition (GPL)). started with: Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock Time Id CommandArgument thank you -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 08:30 -0300, Giovanni Tirloni wrote: My point is that big changes happen in Linux much frequently than in Solaris and even Solaris sometimes doesn't support these kinds of upgrades. It is the inevitable and time-consuming upheaval which many will probably find daunting. Installing Centos then configuring it for a specific manner of operation can take several hours. When I recently re-installed C 5.6 as a server/desktop, the configuration took 4 to 5 hours to complete. I didn't use kickstart. People love and appreciate Centos. They sometimes shudder at the implication of effectively a re-installation, re-configuration and a translation of perfectly good reliable working applications into unfamiliar compulsory alternatives. Get something wrong and the time and effort increases and competes with the daily priorities of running a smooth computer operation and responding to all the things that do occur. The challenge is how to do an easily transition from one major version to its successor version with the least physical, emotional, intellectual and time-consuming effort. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
yonatan pingle wrote: On Sun, Jul 24, 2011 at 2:19 PM, Alexander Dalloz ad+li...@uni-x.org wrote: Am 24.07.2011 13:03, schrieb Eero Volotinen: 2011/7/24 yonatan pingle yonatan.pin...@gmail.com: uploads]# ls | wc -l 3123 I assume that you are using ext3 or ext4 filesystems? Both ext3 and ext4 slows down, if there is too much files in same directory. XFS-fs is solution to fix this problem. Eero Seriously, 3123 files in a single directory is not an issue for any of the extX filesystems. Though ext2 probably performs the worst, ext3 and particular ext4 should not have any problem with that small amount of file objects. Given that the filesystem is not already filled nearby 100%. An issue may be, how the code deals with the directory content. Horrible code for sure can impact the speed of the website, but should not affect the system globally. Yonatan, if you really are concerned about the uploads directory, then use vmstat, iostat or sar to check system parameters while the directory is accessed. Your problem is something else, I am pretty sure. Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos Hi, Alexander good suggestions, ill monitor I/O and mysql code, sounds like a code related issue and not a centos issue after all. it runs on ext3 ,i could only guess how to code deals with the dir, as it seems to be the site builds the pages using php+mysql for each visitor, with about 40K unique visitors a day, that is a lot of I/O. This looks like an issue with MySQL after all. Queries: 48.0M qps: 66 Slow:65.0 avg-cpu: %user %nice %system %iowait %steal %idle 0.970.000.28 97.910.000.84 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 0 102 5.30 3.13 2.06 2 120 3.14 2.77 2.22 we wait and see, tail -f log-slow-queries.log /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community Edition (GPL)). started with: Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock Time Id CommandArgument thank you Do you have cahcing turned on in CMS? That could help. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 7:52 AM, yonatan pingle yonatan.pin...@gmail.com wrote: Hi, Alexander good suggestions, ill monitor I/O and mysql code, sounds like a code related issue and not a centos issue after all. it runs on ext3 ,i could only guess how to code deals with the dir, as it seems to be the site builds the pages using php+mysql for each visitor, with about 40K unique visitors a day, that is a lot of I/O. This looks like an issue with MySQL after all. Queries: 48.0M qps: 66 Slow: 65.0 avg-cpu: %user %nice %system %iowait %steal %idle 0.97 0.00 0.28 97.91 0.00 0.84 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 0 102 5.30 3.13 2.06 2 120 3.14 2.77 2.22 we wait and see, tail -f log-slow-queries.log /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community Edition (GPL)). started with: Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock Time Id Command Argument thank you -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 If you are using phpMyAdmin the status page will aid you in tuning mySQL. Look for values in red. The description will usually tell you what to adjust to improve performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
Do you have cahcing turned on in CMS? That could help. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos there is no caching system, its a home made CMS. -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
RHCT | RHCSA | CCNA1 If you are using phpMyAdmin the status page will aid you in tuning mySQL. Look for values in red. The description will usually tell you what to adjust to improve performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos im good with mysqltuner.pl, as it seems there are slow queries on mysql and i have adjusted all values in my.cnf according to the application needs. looks like it's all in the code and the way the CMS handles the files from that upload directory , so there is nothing wrong with the centos machine after all, it's doing it's job ill point the coder to the status page and hope he gets a clue. thank you everybody for the good advices, i am now sure it's not my fault :-) /thread -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 8:40 AM, yonatan pingle yonatan.pin...@gmail.com wrote: im good with mysqltuner.pl, as it seems there are slow queries on mysql and i have adjusted all values in my.cnf according to the application needs. looks like it's all in the code and the way the CMS handles the files from that upload directory , so there is nothing wrong with the centos machine after all, it's doing it's job ill point the coder to the status page and hope he gets a clue. thank you everybody for the good advices, i am now sure it's not my fault :-) /thread -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 Sounds like you need to enable logging in mySQL for slow queries. Give your developer the log and let him know to either optimize the queries or create indexes appropriately to improve the performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 3:43 PM, Ryan Wagoner rswago...@gmail.com wrote: On Sun, Jul 24, 2011 at 8:40 AM, yonatan pingle yonatan.pin...@gmail.com wrote: im good with mysqltuner.pl, as it seems there are slow queries on mysql and i have adjusted all values in my.cnf according to the application needs. looks like it's all in the code and the way the CMS handles the files from that upload directory , so there is nothing wrong with the centos machine after all, it's doing it's job ill point the coder to the status page and hope he gets a clue. thank you everybody for the good advices, i am now sure it's not my fault :-) /thread -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 Sounds like you need to enable logging in mySQL for slow queries. Give your developer the log and let him know to either optimize the queries or create indexes appropriately to improve the performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos Yes Ryan, that exactly what i have done. he will get the log shortly and i will get some not free beer. :-) -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] VLAN's
On Sat, Jul 23, 2011 at 3:26 PM, John R Pierce pie...@hogranch.com wrote: On 07/23/11 12:09 PM, Tom H wrote: Even after this explanation I don't understand your objection to helping someone with a firewall and routing issue on a CentOS box. You might have a point if the executables didn't come from packages in the canonical CentOS repo. I'm writing my doctoral thesis on pygmy rhino genetic marker traits, I am using LibreOffice on CentOS. Should I put the 1 or 2 pages of abstract before or after my table of contents. :) I was of course assuming that the query was about system administration and not anything remotely similar to what you're suggesting! I get your point that there has to be a limit but I still think that the limit that you're proposing's too restrictive. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 03:53:46PM +0300, yonatan pingle wrote: Yes Ryan, that exactly what i have done. he will get the log shortly and i will get some not free beer. While I'm all for mysql optimization it's clearly evident from an earlier posting that your disks are thrashing with insanely high iowait figures; and while it's _possible_ for this to be caused by mysql you really have to go out of your way to achieve that type of behavior. John -- The best argument against democracy is a five minute conversation with the average voter. -- Winston Churchill pgpQQWMH9fKHI.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
2011/7/24 yonatan pingle yonatan.pin...@gmail.com: there is no caching system, its a home made CMS. You can use an accelerator too. http://en.wikipedia.org/wiki/PHP_accelerator http://en.wikipedia.org/wiki/List_of_PHP_accelerators Please, make a big backup before this! (I nevever had a problem, but... why tempt the devil?) -- Diego - Yo no soy paranoico! (pero que me siguen, me siguen) http://about.me/diegors/bio ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
Am 24.07.2011 14:04, schrieb Always Learning: On Sun, 2011-07-24 at 08:30 -0300, Giovanni Tirloni wrote: My point is that big changes happen in Linux much frequently than in Solaris and even Solaris sometimes doesn't support these kinds of upgrades. It is the inevitable and time-consuming upheaval which many will probably find daunting. Installing Centos then configuring it for a specific manner of operation can take several hours. When I recently re-installed C 5.6 as a server/desktop, the configuration took 4 to 5 hours to complete. I didn't use kickstart. People love and appreciate Centos. They sometimes shudder at the implication of effectively a re-installation, re-configuration and a translation of perfectly good reliable working applications into unfamiliar compulsory alternatives. Get something wrong and the time and effort increases and competes with the daily priorities of running a smooth computer operation and responding to all the things that do occur. The challenge is how to do an easily transition from one major version to its successor version with the least physical, emotional, intellectual and time-consuming effort. Paul, as much as I understand your point of view, I must disagree taking upstream's and CentOS's position. Your description reflects a home user or an administrator with just less than a handful of systems. CentOS and RHEL aims for the enterprise use. Of course that does not imply people can not rely on this stable platform in very small environments, but that's not the focus of the OS design. And speaking about the enterprise scenario, no serious administrator will risk the proper function of his install base by going risky paths. Typically the OS is just the base for the middleware and application level. Switching to a new major level of OS with lots of important changes means, the administrator will have to test and adjust his setup of OS and application use in multiple aspects. This even applies to applications the base OS ships with. In enterprise environments, where the CentOS systems are more than a simple shell box or a trivial webserver, it is more time consuming to find all the possible places to adjust the obsolete configurations being transferred by an upgrade and to find the tripping points than to run a clean and fresh installation with a defined state. In less trivial setups the applications even get wrecked because of library changes and such. Regards Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, yonatan pingle wrote:
the coder is not tech savvy as one might expect, so it's
really hard for me to explain the issue of having lots of
files in one folder to the site owner or to the coder.
I do not expect coders to remain 'not tech savvy'
If the coder is not willing to learn and to test, you are
already doomed, and should walk away from the project
To show the problem, take a pile of pennies, and ask the coder
to find one with a given year. The coder will have to do a
linear search, to even know if the target exists. Then show a
egg carton with another pile of pennies sorted and labelled by
year in each section, and aask them to repeat the task -- in
the latter case, it is a 'single seek' to solve the problem
Obviously, the target year may not even be present. With a
single pile (directory) the linear search is still required,
but with 'binning' by years, that is obvious by inspection as
well
One approach to lots of files in a single directory (which can
cause problems in getting timely access to a specific file) is
to build a permuted directory tree from the file names to
spread the load around. If the files are of a form where they
have 'closely identical' names [pix1.jpg, pix2.jpg,
etc], first build a 'hashed' version of the file name with
md5sum, or such, to level the hash leading characters
[herrold@localhost ~]$ ./hashdemo.sh
pix1.jpgfd8f49c6487588989cd764eb493251ec
pix2.jpg12955d9587d99becf3b2ede46305624c
pix3.jpgbfdc8f593676e4f1e878bb6959f14ce2
[herrold@localhost ~]$ cat hashdemo.sh
#!/bin/sh
#
CANDIDATES=pix1.jpg pix2.jpg pix3.jpg
for i in `echo ${CANDIDATES}`; do
HASH=`echo $i | md5sum - | awk {'print $1'}`
echo $i${HASH}
done
[herrold@localhost ~]$
then, we look to the leading letter of the hask, to design our
egg carton bins. We place pix1.jpg in directory: ./f/ and
pix2.jpg in directory ./1/ and pix3.jpg in directory
./b/ and so forth -- if the directories get too full again,
you might go to using the first two letters of the hash to
perform the 'binning' process
The md5sum function is readily available in php, as are
directory creation and so forth, so positioning the files, and
computing the indexes are straightforward there
This is all pretty basic stuff, covered in Knuth in TAOCP long
ago
-- Russ herrold
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 4:02 PM, John R. Dennison j...@gerdesas.com wrote: On Sun, Jul 24, 2011 at 03:53:46PM +0300, yonatan pingle wrote: Yes Ryan, that exactly what i have done. he will get the log shortly and i will get some not free beer. While I'm all for mysql optimization it's clearly evident from an earlier posting that your disks are thrashing with insanely high iowait figures; and while it's _possible_ for this to be caused by mysql you really have to go out of your way to achieve that type of behavior. John -- The best argument against democracy is a five minute conversation with the average voter. -- Winston Churchill ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos this is exactly what i was thinking, that's an insane iowait value, taking into consideration its a VM , not the hardware machine , and the fact the he fills up all his ram along with slow queries showing in the log, it's simply bad code and wrong handling of files. -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold herr...@owlriver.com wrote:
On Sun, 24 Jul 2011, yonatan pingle wrote:
the coder is not tech savvy as one might expect, so it's
really hard for me to explain the issue of having lots of
files in one folder to the site owner or to the coder.
I do not expect coders to remain 'not tech savvy'
If the coder is not willing to learn and to test, you are
already doomed, and should walk away from the project
To show the problem, take a pile of pennies, and ask the coder
to find one with a given year. The coder will have to do a
linear search, to even know if the target exists. Then show a
egg carton with another pile of pennies sorted and labelled by
year in each section, and aask them to repeat the task -- in
the latter case, it is a 'single seek' to solve the problem
Obviously, the target year may not even be present. With a
single pile (directory) the linear search is still required,
but with 'binning' by years, that is obvious by inspection as
well
One approach to lots of files in a single directory (which can
cause problems in getting timely access to a specific file) is
to build a permuted directory tree from the file names to
spread the load around. If the files are of a form where they
have 'closely identical' names [pix1.jpg, pix2.jpg,
etc], first build a 'hashed' version of the file name with
md5sum, or such, to level the hash leading characters
[herrold@localhost ~]$ ./hashdemo.sh
pix1.jpg fd8f49c6487588989cd764eb493251ec
pix2.jpg 12955d9587d99becf3b2ede46305624c
pix3.jpg bfdc8f593676e4f1e878bb6959f14ce2
[herrold@localhost ~]$ cat hashdemo.sh
#!/bin/sh
#
CANDIDATES=pix1.jpg pix2.jpg pix3.jpg
for i in `echo ${CANDIDATES}`; do
HASH=`echo $i | md5sum - | awk {'print $1'}`
echo $i ${HASH}
done
[herrold@localhost ~]$
then, we look to the leading letter of the hask, to design our
egg carton bins. We place pix1.jpg in directory: ./f/ and
pix2.jpg in directory ./1/ and pix3.jpg in directory
./b/ and so forth -- if the directories get too full again,
you might go to using the first two letters of the hash to
perform the 'binning' process
The md5sum function is readily available in php, as are
directory creation and so forth, so positioning the files, and
computing the indexes are straightforward there
This is all pretty basic stuff, covered in Knuth in TAOCP long
ago
-- Russ herrold
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
Thank you for the excellent analogy , i will actually use it to
explain the matter.
I do hope he understands the simple logic behind a proper directory
tree, it's clearly a design flaw, bad planning or laziness which lead
him to this state.
unfortunately, as bash is easier to read then English for you and me,
ill spare the demohash.sh code from him , and simply put it out in
words , and hope he figures out the proper way to create a tree.
I am strongly tempted to walk away on this one, normally when there no
co-operation and statements like it's a problem with the server
when clearly it's a code issue , it's just nerve wrecking to try and
help these guys.
as i said earlier , he was hosted directly on a virtual server with
the largest isp in my country , and they have failed to help him (
just selling him more ram and cpu, until it got to a breaking point ).
I have actually co-locate at the very same ISP and i know for a fact
they are awesome when it comes to support...
--
Best Regards,
Yonatan Pingle
RHCT | RHCSA | CCNA1
___
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] high performance open source DHCP solution?
On Tue, Jul 19, 2011 at 7:54 PM, Rogelio scubac...@gmail.com wrote: The free DHCP solution, ISC, seems to be having scaling issues (i.e. handling only about 200 DHCPDISCOVER and 20 DHCPRENEW requests), and I was wondering if anyone had any open source suggestions of solutions that could scale much better? (Ideally, I could find a free version of a solution like Nominum, but I know that's asking for much.) Anyone have any suggestions? Not really, but it might be a good idea to restrict this posting to the list for the OS you're using - is it CentOS or Debian or what? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 15:59 +0200, Alexander Dalloz wrote: Paul, as much as I understand your point of view, I must disagree taking upstream's and CentOS's position. Your description reflects a home user or an administrator with just less than a handful of systems. Alexander, I have 11 servers all running C 5.6 and will stay on 5.x while everything works satisfactorily. For development and experimentation I use 2 desktops, laptop and notebook running C 5.6 as a server/client (server/normal user). The 6.x kernel offers me new development possibilities. CentOS and RHEL aims for the enterprise use. Of course that does not imply people can not rely on this stable platform in very small environments, but that's not the focus of the OS design. The operating system comprises several parts. The kernel, Red Hat's versions of various semi-system/application software, the extras like clustering and kvm. The focus of the design is to provide a very stable base upon which many different additions will successfully operate and co-exist. Red Hat provide one basic version of their RHEL which can be used both as a server and as a client (meaning 'normal user' environment). You may have noticed RH's endorsement of Gnome. RHEL is an enterprise operating system but enterprise, in the commercial understanding of the word, means more than a server farm or racks in a data centre. It means the entire corporation - servers and end-users. From the payroll system to the chief executive officer's desk. RHEL does all these different tasks admirably well. And speaking about the enterprise scenario, no serious administrator will risk the proper function of his install base by going risky paths. Is 'risky path' someone wanting to easily upgrade/convert from 5.x to 6.x ? Typically the OS is just the base for the middleware and application level. Switching to a new major level of OS with lots of important changes means, the administrator will have to test and adjust his setup of OS and application use in multiple aspects. This even applies to applications the base OS ships with. The large? jump from 5.x to 6.x and the resulting pressure on people to find the problems and solve them is, obviously, time consuming and for some demanding. If some (certainly not 'all') of the 'new' 6.x systems/changes/improvements were available in 5.x, people could gradually learn about them including any changes. This pre-knowledge spread over a year, would make major version transitions easier and quicker. I acknowledge this is not a Centos issue but a Red Hat policy. A solution is to experiment with the relevant Fedora versions. In enterprise environments, where the CentOS systems are more than a simple shell box or a trivial webserver, it is more time consuming to find all the possible places to adjust the obsolete configurations being transferred by an upgrade and to find the tripping points Hopefully each application has just one configuration file in one known location. Keeping a set-up simple and ensuring up-to-date documentation should avoid 'obsolete configurations' existing and 'tripping points' occurring. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold herr...@owlriver.com wrote: then, we look to the leading letter of the hask, to design our egg carton bins. We place pix1.jpg in directory: ./f/ and pix2.jpg in directory ./1/ and pix3.jpg in directory ./b/ and so forth -- if the directories get too full again, you might go to using the first two letters of the hash to perform the 'binning' process If the pictures are named sequentially, why not store then at a 100 per directory structure something like this /pix/0/00/pix1.jpg /pix/0/26/pix02614.jpg /pix/6/72/pix67255.jpg -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sunday 24 July 2011 22:48:23 Always Learning wrote: On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold herr...@owlriver.com wrote: then, we look to the leading letter of the hask, to design our egg carton bins. We place pix1.jpg in directory: ./f/ and pix2.jpg in directory ./1/ and pix3.jpg in directory ./b/ and so forth -- if the directories get too full again, you might go to using the first two letters of the hash to perform the 'binning' process If the pictures are named sequentially, why not store then at a 100 per directory structure something like this /pix/0/00/pix1.jpg /pix/0/26/pix02614.jpg /pix/6/72/pix67255.jpg As I have worked on projects where the 'coder' is not willing to do any changes, I offer you another temporary solution: If the pictures are in /home/site/public_html/images, you simply need to create a tmpfs, copy the pictures there and then bind mount the tmpfs in that directory: # mkdir /home/site/ram # mount -t tmpfs -o size=200M none /home/site/ram # cp -a /home/site/public_html/images/* /home/site/ram # mount --bind /home/site/ram /home/site/public_html/images Instant performance gain, while you wait for the coder to actually fix the problem. However you should make sure that you copy the new images from the ram to disk. Maybe with inotifywatch. Keep in mind that this is only a temporary solution that should serve only as a proof that this is the problem and it needs to be fixed. Try to explain that this hack is not an actual solution. -- Best regards, Marian Marinov signature.asc Description: This is a digitally signed message part. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, Always Learning wrote: If the pictures are named sequentially, why not store then at a 100 per directory structure something like this /pix/0/00/pix1.jpg /pix/0/26/pix02614.jpg /pix/6/72/pix67255.jpg Go read Knuth One does not do that because then one is counting on the end user's data to conform to, and to continue to conform to your expectations [here you have added an invisible constraint of 'pix' as the first part of the file name which you are hoping remains constant -- it will not, as survey of naming schemes used by digital camera makers will reveal]. Your explicit constraint of a monotonicly increasing image number is also not likely to be realized in a world where people will erase or for other reasons not submit all of a given photo shoot By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories -- Russ herrold ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, R P Herrold wrote: By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories Not followed the whole thread, but a SQL database index of the actual picture files, giving the path into the directory structure. Would that work? Kind Regards, Keith Roberts - Websites: http://www.karsites.net http://www.php-debuggers.net http://www.raised-from-the-dead.org.uk All email addresses are challenge-response protected with TMDA [http://tmda.net] - ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 2011-07-24 at 16:33 -0400, R P Herrold wrote: On Sun, 24 Jul 2011, Always Learning wrote: If the pictures are named sequentially, why not store then at a 100 per directory structure something like this /pix/0/00/pix1.jpg /pix/0/26/pix02614.jpg /pix/6/72/pix67255.jpg Go read Knuth One does not do that because then one is counting on the end user's data to conform to, and to continue to conform to your expectations [here you have added an invisible constraint of 'pix' as the first part of the file name which you are hoping remains constant -- it will not, as survey of naming schemes used by digital camera makers will reveal]. Your explicit constraint of a monotonicly increasing image number is also not likely to be realized in a world where people will erase or for other reasons not submit all of a given photo shoot I did begin with 'IF' :-) Photo-shoot or whatever, using the 'rename' command means pictures can adopt a uniform numbering system. There is no logical or genuine practical reason to accept a disorganised mess. I have about 21,000+ pictures - all my own work. I can find and display any of them within about 17 seconds (just timed myself) using basic operating system commands. (My database application is unfinished). -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, Keith Roberts wrote: By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories Not followed the whole thread, but a SQL database index of the actual picture files, giving the path into the directory structure. Would that work? Fortunately there is a full, and freely accessible of all posts to this mailing list. The link to that archive is in the header of every message through this list. As such you need not speculate As I read the post initially, the problem was as stated in the subject line, and the database issue was not in the forefront Per the initial problem description, the files were all splatted into a single directory. The fastest database I know of is using the filesystem as a database; The addition of the hashing is just a pointer, and so also O(1) Adding a database engine, with the overhead that it brings, and as the thread has already pointed out, in a domU as well (not usually the best place to add the overhead of a database), simply are additonal points of mis-design “We should forget about small efficiencies, say about 97% of the time: premature optimization is the root of all evil. Yet we should not pass up our opportunities in that critical 3%. A good programmer will not be lulled into complacency by such reasoning, he will be wise to look carefully at the critical code; but only after that code has been identified” - Donald Knuth [1] Once the implementation is 'correct', then it is time to do A:B testing to see where the really problem lies ... which testing was at the head of my initial post on this topic -- Russ herrold [1] http://pplab.snu.ac.kr/courses/adv_pl05/papers/p261-knuth.pdf A person not willing to pony up $2.73 for a used copy of 'The Art of Computer Programming: Sorting and Searching. Volume 3', which discusses the specific problem space here, may wish to read and consider his rather nice lecture published by the ACM ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 2011-07-24 at 17:50 -0400, R P Herrold wrote: On Sun, 24 Jul 2011, Keith Roberts wrote: By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories Not followed the whole thread, but a SQL database index of the actual picture files, giving the path into the directory structure. Would that work? The answer must be 'yes' to a normal problem of identifying (searching for) then retrieving data. MySQL would be a good choice. Russ' adoration(?) of Donald KNUTH made me read the first page of [1] http://pplab.snu.ac.kr/courses/adv_pl05/papers/p261-knuth.pdf which includes this This study focuses largely on two issues: (a) improved syntax for iterations and error exits, making it possible to write a larger class of programs clearly and efficiently without go to statements; (b) a methodology of program design, beginning with readable and correct, but possibly inefficient programs that are systematically transformed if necessary into efficient and correct, but possibly less readable code. A computer programmer can not change the syntax of the language he or her is writing-in. The syntax of any programming language is determined by the creator of that programming language. Spaghetti-code is a trade-mark of confused programmers, usually of little ability and certainly have never spend days trying to debug someone else's programme. Spaghetti-code can always be avoided by a clear understanding of what the user wants coupled with the programmer's in depth understanding of how to implement the user's requirements in the chosen programming language whilst remembering someone else may have to maintain the programme. Hashing file names is an interesting concept but a simple, and they are very simple to write, MySQL db application running as HTML pages, with a dash of PHP, makes the application universally accessible and easy to use. Oh, and on Centos, amazingly quick to run :-) -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes tdu...@sc.rr.com wrote: Just ran the installation DVD but there is no option to 'upgrade'. Looked at the RHEL docs, http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installati on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS Release notes but the CentOS installation doesn't offer the 'upgrade'. I use to be able to upgrade by doing a 'yum update'. That doesn't work either. Guess I'm stuck with 5.6 as I an not about to install a new version and have to rebuild all non-rpm packages from scratch. This is worse than Microsoft!! @Thomas: I'm a newbie home user, with CentOS on our Desktops, and Red Hat Linux, before that. I do not believe you understand the philosophy behind CentOS (an Enterprise OS) or RHEL (the upstream distro). This is a distro with a *LONG* life, and without the latest and greatest, for security and stability reasons. It has always been recommended to do a Clean Install when moving from one major version (ie: 5.x) to a newer version (ie: 6.x) and then to Restore your data, from your backup. If you do it in some other fashion, there are apt to be problems, which will probably not be supported on this list. If you break it, you will fix it. There is a lot of information available, on CentOS.org in the Wiki. HowTos, FAQs, etc. If you look there, you will find many things explained clearly. Also, if you search the archives of the mailing list, you will find a ton of information, from a large group of highly knowledgeable users. People who work with CentOS in the Enterprise, all day, every day. Installing non RPM software on an RPM Distro like CentOS is frowned upon. That is the worst way to do it. There are 3rd party Yum repositories, with lots of things that have been packaged for CentOS and you can install them with Yum, once you have the Repository data ready for yum. You probably won't need to rebuild many packages, if any, if you use the 3rd party repositories. GL ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
Greetings, On Sun, Jul 24, 2011 at 2:59 PM, yonatan pingle yonatan.pin...@gmail.com wrote: Hello, after looking into the website folders, i have found one folder which from my point of view is one of the causes for the server loads. hmm... does mount dir -noatime -noadirtime help speed it up? -- Regards, Rajagopal ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Mon, Jul 25, 2011 at 06:38:33AM +0530, Rajagopal Swaminathan wrote: hmm... does mount dir -noatime -noadirtime help speed it up? Just an FYI: noatime is a superset that includes noadirtime. John -- You can safely assume you've created God in your own image when it turns out that God hates all the same people you do. -- Anne Lamott (10 April 1954-), American author, Bird by Bird pgp0qSMUHthUt.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
-Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of Lanny Marcus Sent: Sunday, July 24, 2011 8:51 PM To: CentOS mailing list Subject: Re: [CentOS] Upgrading from CentOS 5.6 to 6.0 On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes tdu...@sc.rr.com wrote: Just ran the installation DVD but there is no option to 'upgrade'. Looked at the RHEL docs, http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Inst allati on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS Release notes but the CentOS installation doesn't offer the 'upgrade'. I use to be able to upgrade by doing a 'yum update'. That doesn't work either. Guess I'm stuck with 5.6 as I an not about to install a new version and have to rebuild all non-rpm packages from scratch. This is worse than Microsoft!! @Thomas: I'm a newbie home user, with CentOS on our Desktops, and Red Hat Linux, before that. I do not believe you understand the philosophy behind CentOS (an Enterprise OS) or RHEL (the upstream distro). This is a distro with a *LONG* life, and without the latest and greatest, for security and stability reasons. It has always been recommended to do a Clean Install when moving from one major version (ie: 5.x) to a newer version (ie: 6.x) and then to Restore your data, from your backup. If you do it in some other fashion, there are apt to be problems, which will probably not be supported on this list. If you break it, you will fix it. There is a lot of information available, on CentOS.org in the Wiki. HowTos, FAQs, etc. If you look there, you will find many things explained clearly. Also, if you search the archives of the mailing list, you will find a ton of information, from a large group of highly knowledgeable users. People who work with CentOS in the Enterprise, all day, every day. Installing non RPM software on an RPM Distro like CentOS is frowned upon. That is the worst way to do it. There are 3rd party Yum repositories, with lots of things that have been packaged for CentOS and you can install them with Yum, once you have the Repository data ready for yum. You probably won't need to rebuild many packages, if any, if you use the 3rd party repositories. GL I have never had a problem upgrading a CentOS release since I started with 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do a complete re-install since moving from Slackware 1.x to Redhat 2.x except once when I had a hard drive failure. I'll be moving to Ubunto. They have a 3 year window for support on a distribution unlike CentOS/RHEL. They seem to be more user friendly for a home networking environment. The software package I use which takes hours of trial and error to compile and install is as simple apt-get install under Ubunto. There are no rpms for zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue with CentOS with the outdated php/mysql and other various libs. I can see the direction RHEL is taking and its more and more like Microsoft. The enduser is having to be more and more dependent on the provider. CentOS has its hands tied. I thank all for the help I have recievied over the years, its just not beneficial to stay this current direction. TE Dukes ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, Jul 24, 2011 at 10:20:07PM -0400, Thomas Dukes wrote: I have never had a problem upgrading a CentOS release since I started with 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do a complete re-install since moving from Slackware 1.x to Redhat 2.x except once when I had a hard drive failure. There is no 5.7 yet. The software package I use which takes hours of trial and error to compile and install is as simple apt-get install under Ubunto. There are no rpms for zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue with CentOS with the outdated php/mysql and other various libs. I know of at least one packaged zoneminder and its required deps; I'm not sure if it's public but if it is the person that did the packaging will likely speak up as he is on this list. So it's indeed possible. I can see the direction RHEL is taking and its more and more like Microsoft. The enduser is having to be more and more dependent on the provider. CentOS has its hands tied. This is purely FUD. I thank all for the help I have recievied over the years, its just not beneficial to stay this current direction. Good luck with future endeavors. John -- What lies behind us and what lies before us are tiny matters compared to what lies within us. -- Ralph Waldo Emerson pgpVcUQu5j67h.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 22:20 -0400, Thomas Dukes wrote: The compliation of ffmpeg/zoneminder seems to be an issue with CentOS with the outdated php/mysql and other various libs. PHP and MySQL work fine for me. My systems depend on both these being reliable, efficient, dependable and robust - they are on Centos 5.6. I can see the direction RHEL is taking and its more and more like Microsoft. While Centos (and SL) exist, we are never going to be like M$. RH needs, commercially, to prevent/reduce business losses to copy-cat companies like Oracle etc. The enduser is having to be more and more dependent on the provider. CentOS has its hands tied. Yes all Centos users are dependent on RH if they want to run a 100% binary compatible system. However there is flexibility to add non-standard software and, as you have proved, one's own non-standard applications successfully. Good Luck. We will be here if you pop back sometime in the future. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 22:20 -0400, Thomas Dukes wrote: -Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of Lanny Marcus Sent: Sunday, July 24, 2011 8:51 PM To: CentOS mailing list Subject: Re: [CentOS] Upgrading from CentOS 5.6 to 6.0 On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes tdu...@sc.rr.com wrote: Just ran the installation DVD but there is no option to 'upgrade'. Looked at the RHEL docs, http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Inst allati on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS Release notes but the CentOS installation doesn't offer the 'upgrade'. I use to be able to upgrade by doing a 'yum update'. That doesn't work either. Guess I'm stuck with 5.6 as I an not about to install a new version and have to rebuild all non-rpm packages from scratch. This is worse than Microsoft!! @Thomas: I'm a newbie home user, with CentOS on our Desktops, and Red Hat Linux, before that. I do not believe you understand the philosophy behind CentOS (an Enterprise OS) or RHEL (the upstream distro). This is a distro with a *LONG* life, and without the latest and greatest, for security and stability reasons. It has always been recommended to do a Clean Install when moving from one major version (ie: 5.x) to a newer version (ie: 6.x) and then to Restore your data, from your backup. If you do it in some other fashion, there are apt to be problems, which will probably not be supported on this list. If you break it, you will fix it. There is a lot of information available, on CentOS.org in the Wiki. HowTos, FAQs, etc. If you look there, you will find many things explained clearly. Also, if you search the archives of the mailing list, you will find a ton of information, from a large group of highly knowledgeable users. People who work with CentOS in the Enterprise, all day, every day. Installing non RPM software on an RPM Distro like CentOS is frowned upon. That is the worst way to do it. There are 3rd party Yum repositories, with lots of things that have been packaged for CentOS and you can install them with Yum, once you have the Repository data ready for yum. You probably won't need to rebuild many packages, if any, if you use the 3rd party repositories. GL I have never had a problem upgrading a CentOS release since I started with 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do a complete re-install since moving from Slackware 1.x to Redhat 2.x except once when I had a hard drive failure. I'll be moving to Ubunto. They have a 3 year window for support on a distribution unlike CentOS/RHEL. They seem to be more user friendly for a home networking environment. The software package I use which takes hours of trial and error to compile and install is as simple apt-get install under Ubunto. There are no rpms for zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue with CentOS with the outdated php/mysql and other various libs. I can see the direction RHEL is taking and its more and more like Microsoft. The enduser is having to be more and more dependent on the provider. CentOS has its hands tied. I thank all for the help I have recievied over the years, its just not beneficial to stay this current direction. update from CentOS 5.6 to 5.7 (when 5.7 becomes available) is automatic... just run 'yum update' - no extra efforts or thought need to be given. update from CentOS 5.x to CentOS 6.x is at best a crapshoot. Skilled admins should be able to fix whatever needs fixing. Less than skilled admins will find it takes less time to backup and re-install. As for switching to Ubuntu... I have switched my latest installs from RHEL/CentOS to Ubuntu. Primarily because I felt I couldn't rely upon timely releases/updates. Let me assure you though that nothing is perfect with any distribution and while some packages might be newer/more readily available on one distribution than the other, there are certainly other packages that are newer/better vice versa. ffmpeg on CentOS/RHEL 5.x is a bit behind (CentOS/RHEL 5 is way behind). zoneminder is just perl scripts so it doesn't make that much of a difference if it is RPM packaged or just tarball install CentOS/RHEL has a much larger window of support for a specific version than Ubuntu so claiming that Ubuntu has a 3 year window as an advantage suggests that you don't understand the RHEL/CentOS support windows at all. Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 19:51 -0500, Lanny Marcus wrote: Installing non RPM software on an RPM Distro like CentOS is frowned upon. That is the worst way to do it. why? you made a vacuous argument. Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On 7/24/11 4:08 PM, Keith Roberts wrote: On Sun, 24 Jul 2011, R P Herrold wrote: By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories Not followed the whole thread, but a SQL database index of the actual picture files, giving the path into the directory structure. Would that work? You introduce new issues where the name in the database can't be managed atomically with the name in the directory that way. Consider what might happen with concurrent operations trying to add different files with the same name - or perhaps an add and delete at the same times. And it still doesn't help with the real problem unless you do something to break up the large directory. Unix-like filesystems guarantee atomic operations in filename manipulation, so every time you try to create a file, the system must check that the name does not already exist, find an empty slot for the name and insert it with the directory locked against other changes until that is complete. Filesystems that index directories can help with the lookup, with the tradeoff that additions require an index update. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
I'll be moving to Ubunto. They have a 3 year window for support on a distribution unlike CentOS/RHEL. They seem to be more user friendly for a home networking environment. RHEL is supported for 10 years on each major release. -- Eero ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
