Re: [gentoo-user] why you've chosen your desktop environment? (no war !)
You can try the Desktop GNUStep avec WindowMaker. On 19/08/2014 07:55, behrouz khosravi wrote: On Mon, Aug 18, 2014 at 2:47 PM, wraeth wra...@wraeth.id.au wrote: Also, I think your subject line, while a valiant effort, is the IT equivalent of don't eat the cookies while I'm gone :P Yea, I think there will no escape from that!
Re: [gentoo-user] Re: Changing glibc
No other diff program comes even close to BC in terms of diff output quality and merge capability. I am willing to go through much more hoops than this just to be able to use this under linux. And also, to avoid any misrepresentation, their support in determining the cause of the issue was very good. The problem seems to be that their linux build is using an older gcc version. This was causing an ABI related crash in the strstr function, which was using SSE instructions. So at some point, they will probably switch to a newer compiler and the problem will go away. But if I mail their support, it would take many messages until we come to the same page (the previous developer getting copied on it, he remembers the issue etc etc). It is much faster to just try it :) -- Timur
Re: [gentoo-user] Clusters on Gentoo ?
On Monday, August 18, 2014 08:09:00 PM thegeezer wrote: On 18/08/14 15:31, J. Roeleveld wrote: snip valid points, and interesting to see the corrections of my understanding, always welcome :) You're welcome :) Looks nice, but is not going to help with performance if the application is not designed for distributed processing. -- Joost this is the key point i would raise about clusters really -- it would be nice to not need for example distcc configured and just have portage run across all connected nodes without any further work, or to use a tablet computer which is borrowing cycles from a GFX card across the network without having to configure nvidia grid: specifically these two use cases have wildly different characteristics and are a great example of why clustering has to be designed first to fit the application and viceversa. I had a better look at that site you linked to. It won't be as hidden as you'd like. The software you run on it needs to be designed to actually use the infrastructure. This means that for your ideal to work, the industry needs to decide on a single clustering technology for this. I wish you good luck on that venture. :) /me continues to wonder if 10GigE is fast enough to page fault across the network ... ;) Depends on how fast you want the environment to be. Old i386 time, probably. Expecting a performance equivalent to a modern system, no. Check the bus-speeds between the CPU and memory that is being employed these days. That is the minimum speed you need in the network link to be fast enough to actually work. And that is expecting a perfect link with no errors occurring in the wiring. -- Joost
Re: [gentoo-user] Clusters on Gentoo ?
On Monday, August 18, 2014 10:53:51 AM Alec Ten Harmsel wrote: On Mon 18 Aug 2014 10:50:23 AM EDT, Rich Freeman wrote: Hadoop is a very specialized tool. It does what it does very well, but if you want to use it for something other than map/reduce then consider carefully whether it is the right tool for the job. Agreed; unless you have decent hardware and can comfortably measure your data in TB, it'll be quicker to use something else once you factor in the administration time and learning curve. The benefit of clustering technologies is that you don't need high-end hardware to start with. You can use the old hardware you found collecting dust in the basement. The learning curve isn't as steep as it used to be. There are plenty of tools to make it easier to start using Hadoop. -- Joost
Re: [gentoo-user] Clusters on Gentoo ?
On Tue, Aug 19, 2014 at 5:34 AM, J. Roeleveld jo...@antarean.org wrote: On Monday, August 18, 2014 10:53:51 AM Alec Ten Harmsel wrote: On Mon 18 Aug 2014 10:50:23 AM EDT, Rich Freeman wrote: Hadoop is a very specialized tool. It does what it does very well, but if you want to use it for something other than map/reduce then consider carefully whether it is the right tool for the job. Agreed; unless you have decent hardware and can comfortably measure your data in TB, it'll be quicker to use something else once you factor in the administration time and learning curve. The benefit of clustering technologies is that you don't need high-end hardware to start with. You can use the old hardware you found collecting dust in the basement. The learning curve isn't as steep as it used to be. There are plenty of tools to make it easier to start using Hadoop. As long as you're counting words and don't mind coding everything in Java. :) I found that if you want to avoid using Java, then the available documentation plummets, and I'm pretty sure the version I was attempting to use was buggy - it was losing records in the sort/reduce phase I believe. Or perhaps I was just using it incorrectly, but the same exact code worked just fine when I ran it on a single host with a smaller dataset and just piped map | sort | reduce without using Hadoop. The documentation was pretty sparse on how to get Hadoop to work via stdin/out with non-Java code and it is quite possible I wasn't quite doing things right. In the end my problem wasn't big enough to necessitate using Hadoop and I used GNU parallel instead. -- Rich
Re: [gentoo-user] Clusters on Gentoo ?
On Tuesday, August 19, 2014 06:33:29 AM Rich Freeman wrote: On Tue, Aug 19, 2014 at 5:34 AM, J. Roeleveld jo...@antarean.org wrote: On Monday, August 18, 2014 10:53:51 AM Alec Ten Harmsel wrote: On Mon 18 Aug 2014 10:50:23 AM EDT, Rich Freeman wrote: Hadoop is a very specialized tool. It does what it does very well, but if you want to use it for something other than map/reduce then consider carefully whether it is the right tool for the job. Agreed; unless you have decent hardware and can comfortably measure your data in TB, it'll be quicker to use something else once you factor in the administration time and learning curve. The benefit of clustering technologies is that you don't need high-end hardware to start with. You can use the old hardware you found collecting dust in the basement. The learning curve isn't as steep as it used to be. There are plenty of tools to make it easier to start using Hadoop. As long as you're counting words and don't mind coding everything in Java. :) I found that if you want to avoid using Java, then the available documentation plummets, and I'm pretty sure the version I was attempting to use was buggy - it was losing records in the sort/reduce phase I believe. Or perhaps I was just using it incorrectly, but the same exact code worked just fine when I ran it on a single host with a smaller dataset and just piped map | sort | reduce without using Hadoop. The documentation was pretty sparse on how to get Hadoop to work via stdin/out with non-Java code and it is quite possible I wasn't quite doing things right. In the end my problem wasn't big enough to necessitate using Hadoop and I used GNU parallel instead. No need for Java knowledge to develop against Hadoop. A commercial product: http://www.informatica.com/Images/01603_powerexchange-for-hadoop_ds_en-US.pdf Nice and easy graphical interface. The same code that works against a relational database also works with Hadoop. The tool does the translation. I would be surprised if there are no other tools that can make it easier to develop code to work with Hadoop. I just haven't had the reason to search for those yet. -- Joost
Re: [gentoo-user] Clusters on Gentoo ?
On Tue 19 Aug 2014 05:34:40 AM EDT, J. Roeleveld wrote: On Monday, August 18, 2014 10:53:51 AM Alec Ten Harmsel wrote: On Mon 18 Aug 2014 10:50:23 AM EDT, Rich Freeman wrote: Hadoop is a very specialized tool. It does what it does very well, but if you want to use it for something other than map/reduce then consider carefully whether it is the right tool for the job. Agreed; unless you have decent hardware and can comfortably measure your data in TB, it'll be quicker to use something else once you factor in the administration time and learning curve. The benefit of clustering technologies is that you don't need high-end hardware to start with. You can use the old hardware you found collecting dust in the basement. Yes, but... if you are doing anything that *needs* to be fast (i.e. if you're not a hobbyist), you don't need some super fancy database machine but you still need some decent hardware (gotta have enough RAM for that JVM ;) ). If you'd like to take a look at our hardware, you can check out http://caen.github.io/hadoop/hardware.html. The learning curve isn't as steep as it used to be. There are plenty of tools to make it easier to start using Hadoop. There are plenty of great tools (Pig, Sqoop, Hive, RHadoop, etc.) that you can use so you're not writing Java. This is all client-side; it doesn't make the administration easier. I agree that it's easy to start using it (It's possible to configure a small cluster from scratch in half an hour), but it takes a lot more time to tune your installation so it actually performs well. Just like any other piece of server software; serving a website with httpd is easy, but serving it well and adding security takes a lot more time. Rich Freeman wrote: As long as you're counting words and don't mind coding everything in Java. :) We discourage researchers from writing in Java and instead use any of the things I list above, unless they really like Java. I found that if you want to avoid using Java, then the available documentation plummets Yeah, this is still a pretty big problem. Documentation is pretty sparse. Alec
RE: [gentoo-user] Intermittent USB device failures
From: Volker Armin Hemmann [mailto:volkerar...@googlemail.com] Sent: Monday, August 18, 2014 8:01 PM Am 17.08.2014 um 12:33 schrieb Mick: On Sunday 17 Aug 2014 02:56:58 Mike Edenfield wrote: When I `modprobe -r ochi_pci` while the system is operating normally, I see all four modules (ohci-pci, ohci-hcd, ehci-pci, and ehci-hcd) unloading properly: [25603.37] ohci-pci :00:0b.0: remove, state 1 [25603.370395] usb usb2: USB disconnect, device number 1 [25603.370414] usb 2-6: USB disconnect, device number 2 [25603.383451] usb 2-7: USB disconnect, device number 3 [25603.384217] ohci-pci :00:0b.0: USB bus 2 deregistered [25603.384597] ehci-pci :00:0b.1: remove, state 1 [25603.384611] usb usb1: USB disconnect, device number 1 [25603.386306] ehci-pci :00:0b.1: USB bus 1 deregistered If I try to do the same thing after the mouse has locked up, modprobe stalls trying to unload the first module: wombat kutulu # modprobe -r -v ohci_pci rmmod ohci_pci wombat kutulu # dmesg [38091.627389] ohci-pci :00:0b.0: remove, state 1 [38091.627400] usb usb2: USB disconnect, device number 1 Any ideas what's going wrong here? Any chance I can salvage this hardware? Do you need ohci-pci? Have you tried running a kernel without it and check if your hardware still works as intended? I would try that too,,, From: Volker Armin Hemmann [mailto:volkerar...@googlemail.com] Sent: Monday, August 18, 2014 8:01 PM Am 17.08.2014 um 12:33 schrieb Mick: On Sunday 17 Aug 2014 02:56:58 Mike Edenfield wrote: When I `modprobe -r ochi_pci` while the system is operating normally, I see all four modules (ohci-pci, ohci-hcd, ehci-pci, and ehci-hcd) unloading properly: [25603.37] ohci-pci :00:0b.0: remove, state 1 [25603.370395] usb usb2: USB disconnect, device number 1 [25603.370414] usb 2-6: USB disconnect, device number 2 [25603.383451] usb 2-7: USB disconnect, device number 3 [25603.384217] ohci-pci :00:0b.0: USB bus 2 deregistered [25603.384597] ehci-pci :00:0b.1: remove, state 1 [25603.384611] usb usb1: USB disconnect, device number 1 [25603.386306] ehci-pci :00:0b.1: USB bus 1 deregistered If I try to do the same thing after the mouse has locked up, modprobe stalls trying to unload the first module: wombat kutulu # modprobe -r -v ohci_pci rmmod ohci_pci wombat kutulu # dmesg [38091.627389] ohci-pci :00:0b.0: remove, state 1 [38091.627400] usb usb2: USB disconnect, device number 1 Any ideas what's going wrong here? Any chance I can salvage this hardware? Do you need ohci-pci? Have you tried running a kernel without it and check if your hardware still works as intended? I would try that too,,, I booted a kernel without ohci-pci and no, it doesn't quite work, though I'm pretty confused by it. With OHCI removed from my kernel, neither my mouse nor my keyboard register as attached, but it doesn't seem to matter which ports I put them in. I have 6 USB ports, 2 pair on the motherboard and a third pair in the front of the case, and I expected that the back four would be OCHI and the front two EHCI (or something similr), but they don't seem to follow that pattern. Anywhere I plug my flash drive or camera in, it gets routed through the ECHI controller, while anywhere I plug my keyboard or mouse in gets routed through the OHCI controller. For example, I have my keyword and a flash drive plugged into the two front-mounted ports, and when I boot, I get this: With OHCI: kutulu@wombat ~ $ dmesg | grep usb [0.074276] usbcore: registered new interface driver usbfs [0.074460] usbcore: registered new interface driver hub [0.074658] usbcore: registered new device driver usb [0.245705] usbcore: registered new interface driver usbhid [0.245879] usbhid: USB HID core driver [7.420249] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [7.420426] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [7.420735] usb usb1: Product: EHCI Host Controller [7.420908] usb usb1: Manufacturer: Linux 3.16.0-gentoo-wombat-3 ehci_hcd [7.421089] usb usb1: SerialNumber: :00:0b.1 [7.631143] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001 [7.631328] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [7.631618] usb usb2: Product: OHCI PCI host controller [7.631789] usb usb2: Manufacturer: Linux 3.16.0-gentoo-wombat-3 ohci_hcd [7.631964] usb usb2: SerialNumber: :00:0b.0 [7.753477] usb 1-7: new high-speed USB device number 2 using ehci-pci [7.968033] usb 1-7: New USB device found, idVendor=14cd, idProduct=6500 [7.968179] usb 1-7: New USB device strings: Mfr=1, Product=3, SerialNumber=2 [7.968312] usb 1-7: Product: USB 2.0 Flash drive [7.968442] usb 1-7: Manufacturer: MOAI INC. [7.968568] usb 1-7: SerialNumber: 4FD30F4B00C5 [8.165667] usb-storage 1-7:1.0: USB
