[gentoo-user] Installing OSS / error adding oss-overlay
Hello, list. Since I've scrapped my old miniITX home router / server, I've missed the ability to use speakers from laptop via wifi and esd/pulse, since new machine doesn't have bult-in sound card. Today I've got PCI-E Creative XFi Xtreme Audio, which, as far as I can see isn't on alsa or creative open driver support list, but is supported by OSS. I'd be quite happy if someone can prove me wrong about this matter, btw, since I have virtually no experience with OSS. To the point: AFAIK OSS in gentoo resides in oss-overlay, which I try to add with standard 'layman -a oss-overlay': r...@damnation:~# layman -a oss-overlay * Running command /usr/bin/hg clone http://hg.atheme.org/users/majeru/portage-overlay/; /usr/portage/local/layman/oss-overlay... real URL is http://hg.atheme.org/ abort: requirement '!-- quirksmode --' not supported! * Failed to add overlay oss-overlay. So, it's some weird hg (mercurial) error, and google is eerie silent on the matter. Same 'hg clone' with '--debug' flag (the easiest way I've found to debug hg) yields the same error with just two additional lines before it: Requested URL: 'http://hg.atheme.org/users/majeru/portage-overlay/?pairs=-cmd=between' (falling back to static-http) That said, overlay can be freely browsed via web interface and looks like pretty much alive to me. Mercurial don't seem to have any relevant use-flags, but I've no experience working with it. Layman works fine for several other (git and svn, not hg) overlays. I'm sorry that the message got that fat, but the questions are these: - What might be wrong with the overlay, layman or hg? - Is there any other natural way to install basic tools like ossmixer and osstest on gentoo, aside from cloning the ebuilds by hand? - Should I even consider using OSS in gentoo, or it's mostly unsupported already (all I really need is esd or pulse daemon on top of it)? - Prehaps someone know a way to make this sound card work with alsa? Thanks in advance. -- Mike Kazantsev // fraggod.net signature.asc Description: PGP signature
Re: [gentoo-user] How to turn off the screen permanently
On Sat, Feb 21, 2009 at 4:25 PM, Florian Philipp li...@f_philipp.fastmail.net wrote: No, I have this problem, too. When I use 'xset dpms force off' for the first few times, it works (screen stays off). After that, it always turns back on. It also didn't go away when I switched from XFCE to GNOME. The problem has been there since I bought my notebook 1.5 years ago. I just live with it. Thanks. At least I know that this is not something wrong with my configuration. As I mention before this is a small problem and of course I can live with it too, but this is not a point. I often leave my notebook for a few hours to compile some programs and simply it would be nice if the screen stays off during that time. Moreover, if the lid is closed I expect that the screen stays off as well. Fortunately, at least I have the simple solution with switching to the console ... Marcin
[gentoo-user] Re: Installing OSS / error adding oss-overlay
Mike Kazantsev wrote: To the point: AFAIK OSS in gentoo resides in oss-overlay, which I try to add with standard 'layman -a oss-overlay': r...@damnation:~# layman -a oss-overlay * Running command /usr/bin/hg clone http://hg.atheme.org/users/majeru/portage-overlay/; /usr/portage/local/layman/oss-overlay... real URL is http://hg.atheme.org/ abort: requirement '!-- quirksmode --' not supported! * Failed to add overlay oss-overlay. I'm using OSS4 for a long time and noticed this error appearing two days ago. I posted about it on the opensound forums: http://www.4front-tech.com/forum/viewtopic.php?p=11881#11881 Hopefully they'll fix it soon. As for the question whether it's useful on Gentoo, all I did was putting oss -alsa in make.conf and everything is working nicely till today, including ESD.
Re: [gentoo-user] Re: Installation questions
James ha scritto: Neil Bothwick neil at digimed.co.uk writes: Yes, you heard me right - I recommend one uses Ubuntu to install Gentoo I took that a stage further with my Eee. Knowing how long it would take to build everything, I installed Ubuntu, then used that while Gentoo was building in a chroot. OK, got it. +1, just for the sake of history :). I *never* used a Gentoo livecd. I always used Knoppix or Kubuntu cds. I don't even understand why should one use the minimal gentoo cd when one can have a working environment while installing. m.
Re: [gentoo-user] Re: Installation questions
Am Sonntag, 22. Februar 2009 12:28:29 schrieb b.n.: James ha scritto: Neil Bothwick neil at digimed.co.uk writes: Yes, you heard me right - I recommend one uses Ubuntu to install Gentoo I took that a stage further with my Eee. Knowing how long it would take to build everything, I installed Ubuntu, then used that while Gentoo was building in a chroot. OK, got it. +1, just for the sake of history :). I *never* used a Gentoo livecd. I always used Knoppix or Kubuntu cds. I guess it always depends on what tools you actually need during installation. I use GRML, since it * uses zsh as its default shell * didn't drop EVMS like Debian (ok, they wanted to, but I could convince them to keep it) * has some handy scripts like grml-chroot which does all the /proc and /dev bind mounting stuff * ... Bye... Dirk signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] How to turn off the screen permanently
Lately, I notice that when I go back to fluxbox then everything seems to be fine. Apparently, this is the problem with GNOME or some other apps. At this point I do not know exactly how the wake up of x11 works, but I have a question. Is it possible to set (some) options (xorg.conf?) that *only* upon receiving keyboard or mouse events the screen is back on? Marcin
Re: [gentoo-user] Re: Installing OSS / error adding oss-overlay
On Sun, 22 Feb 2009 12:47:33 +0200 Nikos Chantziaras rea...@arcor.de wrote: I'm using OSS4 for a long time and noticed this error appearing two days ago. I posted about it on the opensound forums: http://www.4front-tech.com/forum/viewtopic.php?p=11881#11881 Hopefully they'll fix it soon. As for the question whether it's useful on Gentoo, all I did was putting oss -alsa in make.conf and everything is working nicely till today, including ESD. Well, that pretty much the answers I sought. Thanks. -- Mike Kazantsev // fraggod.net signature.asc Description: PGP signature
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Grant schrieb: The madwifi/ath5k guys say it should work in 2.6.28 which I'm on. The latest is I'm getting this directly from hostapd: Failed to set interface ath0 to master mode. nl80211 driver initialization failed. rmdir[ctrl_interface]: No such file or directory ELOOP: remaining socket: sock=5 eloop_data=... I'm sure my procedure is correct now, but I don't know why ath0 won't go into master mode. - Grant Hi, i have been, through that lately an it is not that out of the box. Here is what i put together from linux-wireless mailinglist and trial and error: 1. Master mode on ath5k is there, but not activated and not in 2.6.28. Mainly from this thread i got the kernel stuff and settings http://marc.info/?t=12265272074r=1w=2 I use the latest git pull from http://linuxwireless.org/. The AP mode needs still to be activated: --- wireless-testing/drivers/net/wireless/ath5k/base.c 2009-02-10 06:11:43.186470883 +0100 +++ wireless-testing/drivers/net/wireless/ath5k/base.c.old 2008-11-14 09:36:40.0 +0100 @@ -522,6 +501,7 @@ hw-wiphy-interface_modes = BIT(NL80211_IFTYPE_STATION) | BIT(NL80211_IFTYPE_ADHOC) | + BIT(NL80211_IFTYPE_AP) | BIT(NL80211_IFTYPE_MESH_POINT); hw-extra_tx_headroom = 2; Now you have a kernel and a ath5k module capable of master mode. 2. You need ~arch version of hostapd. Stable version did not do the trick for me. 3. I needed to modify the startscripts. I removed the net.wlan0 link completely, as it does not seem to be able to initialize the ap mode, but is loaded automaticaly even when it is not set to boot in a spezific runlevel. So you need hostapd to initialize the wlan-nic. hostapd script wants to start all networkinterfaces with the rc-scripts, so i edited the script, to start my bridge an the wired card only and leave out the wlan-nic. I think this is a little redundant to removing the net.wlan0 script. Sometimes while testing, the interface did not shut down properly and hostapd could not initialize them any more. So i had to set them down manually with iwconfig. After that hostapd could use them again. This is clearly not yet meant to be used in a productive environment, as the devs clearly stated in the postet threads on wireless-linux. Regards, Norman
Re: [gentoo-user] problem with X.org (i915) [SOLVED]
pat wrote: On Mon, 26 Jan 2009 16:08:33 +0100, Pat wrote Hello, I'm using Gentoo on my laptop and quite often the graphic output goes mad. There are messed lines and the contend is not readable. I've made screen shots (attached). Please, could someone help me? In the system log I've found these lines: [drm] Initialized i915 1.6.0 20060119 on minor 0 [drm:i915_getparam] *ERROR* Unknown parameter 5 [drm:i915_initialize] *ERROR* can not ioremap virtual address for ring buffer The system configuration: amd64, 2.6.26-gentoo-r4, Core2 Duo CPU, DRM i915 graphics driver ~amd64: xorg-server-1.5.3-r1, xf86-video-intel-2.5.1-r1, xorg-x11- 7.4, mesa-7.2 Thanks a lot for the help Pat I've forget to attach the screen shots, sorry :-\ Switching to newer kernel (I've switched to 2.6.27-gentoo-r8) fixed to problem. Pat
[gentoo-user] Solid state disks...
I'm playing around with an application that requires me to manage a large (multi-gigabyte to terabyte), bespoke, frequently-updating data structure in real-time... key concerns are for durability and efficiency. While a traditional approach might be to employ an expensive DBMS on expensive hardware... I'm looking to be more innovative. I want to achieve big-iron beating performance on a shoestring budget... and I'm optimistic since the problem domain doesn't translate well to traditional RDBMS approaches. An obvious alternative to a DBMS is to use the file-system directly... in principle this could work - but it would be a laborious process fraught with potential pitfalls with respect to atomicity of updates, transactional recovery (in case of a fail-stop while processing a large update) etc. Another issue is that in order to establish an efficient and reliable implementation, it becomes necessary to second guess details about the implementation of file-systems... this vastly complicates any implementation and might render it unacceptably fragile (subject to unexpected deviations in behaviour as the implementation is moved between hardware/OS-versions etc. I've recently discovered that SSDs are becoming more affordable... and this might present new options. There were major hurdles in attempting to establish a strategy to interact with hard-disk block devices... including, but not limited to, a significant difficulty in establishing the extent to which locality of reference affected performance. Another worry was that it might be difficult to establish that a write had actually completed (i.e. the data reliably and durably stored - not just that the responsibility for recording the data was now exclusively with the drive.) My hope is that SSD technology simplifies some of these concerns - allowing a clear model for access performance that should allow an efficient and reliable implementation. I'd like to hear about anyone who has experience with configuring SSDs for use with (Gentoo) Linux - and especially from anyone who's investigated performance issues. I've read that SSDs typically have a 64Kib block size... this would work fine for me (though I understand that it is a significant impediment for high performance with existing file systems. I'd be interested to know if anyone has done performance analysis of SSDs at the device level under Linux... and am intrigued if there is more to interacting with them than establishing the block size from manufacturer data - then reading/writing appropriately many bytes from block devices... and/or flushing appropriately aligned and sized blocks of memory mapped data. For example, is there an interface to quiz an SSD about its block-size? I'm intrigued to establish if I can rely upon my data being durably stored on an SSD when a flush/write returns. In a practical sense, I'd like to experiment with some SSD hardware - but there seems to be a lot to chose from. For development purposes, I'd not need more than, say, 32GB - and I'm not all that fussed about absolute performance - as long as the relative performance of various interactions will increase proportionally were I to move to more expensive SSDs in future. I'm interested to establish any practical anecdotes (or hard statistical data) about the relative merits of various interfaces for SSDs - and to establish if RAID needs to be taken into account when establishing a performance model. Any feedback would be appreciated... especially from any gentooist who is interested in SSD performance/reliability/configuration.
Re: [gentoo-user] Gentoo and Madwifi contradict each other
The madwifi/ath5k guys say it should work in 2.6.28 which I'm on. The latest is I'm getting this directly from hostapd: Failed to set interface ath0 to master mode. nl80211 driver initialization failed. rmdir[ctrl_interface]: No such file or directory ELOOP: remaining socket: sock=5 eloop_data=... I'm sure my procedure is correct now, but I don't know why ath0 won't go into master mode. - Grant Hi, i have been, through that lately an it is not that out of the box. Here is what i put together from linux-wireless mailinglist and trial and error: 1. Master mode on ath5k is there, but not activated and not in 2.6.28. Mainly from this thread i got the kernel stuff and settings http://marc.info/?t=12265272074r=1w=2 I use the latest git pull from http://linuxwireless.org/. The AP mode needs still to be activated: --- wireless-testing/drivers/net/wireless/ath5k/base.c 2009-02-10 06:11:43.186470883 +0100 +++ wireless-testing/drivers/net/wireless/ath5k/base.c.old 2008-11-14 09:36:40.0 +0100 @@ -522,6 +501,7 @@ hw-wiphy-interface_modes = BIT(NL80211_IFTYPE_STATION) | BIT(NL80211_IFTYPE_ADHOC) | + BIT(NL80211_IFTYPE_AP) | BIT(NL80211_IFTYPE_MESH_POINT); hw-extra_tx_headroom = 2; Now you have a kernel and a ath5k module capable of master mode. 2. You need ~arch version of hostapd. Stable version did not do the trick for me. 3. I needed to modify the startscripts. I removed the net.wlan0 link completely, as it does not seem to be able to initialize the ap mode, but is loaded automaticaly even when it is not set to boot in a spezific runlevel. So you need hostapd to initialize the wlan-nic. hostapd script wants to start all networkinterfaces with the rc-scripts, so i edited the script, to start my bridge an the wired card only and leave out the wlan-nic. I think this is a little redundant to removing the net.wlan0 script. Sometimes while testing, the interface did not shut down properly and hostapd could not initialize them any more. So i had to set them down manually with iwconfig. After that hostapd could use them again. This is clearly not yet meant to be used in a productive environment, as the devs clearly stated in the postet threads on wireless-linux. Regards, Norman Thanks a lot Norman. I've got to remember not to ride the bleeding edge. Removing wlan0 from /etc/conf.d/hostapd didn't prevent hostapd from starting it? - Grant
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Grant schrieb: Hi, i have been, through that lately an it is not that out of the box. Here is what i put together from linux-wireless mailinglist and trial and error: 1. Master mode on ath5k is there, but not activated and not in 2.6.28. Mainly from this thread i got the kernel stuff and settings http://marc.info/?t=12265272074r=1w=2 I use the latest git pull from http://linuxwireless.org/. The AP mode needs still to be activated: --- wireless-testing/drivers/net/wireless/ath5k/base.c 2009-02-10 06:11:43.186470883 +0100 +++ wireless-testing/drivers/net/wireless/ath5k/base.c.old 2008-11-14 09:36:40.0 +0100 @@ -522,6 +501,7 @@ hw-wiphy-interface_modes = BIT(NL80211_IFTYPE_STATION) | BIT(NL80211_IFTYPE_ADHOC) | + BIT(NL80211_IFTYPE_AP) | BIT(NL80211_IFTYPE_MESH_POINT); hw-extra_tx_headroom = 2; Now you have a kernel and a ath5k module capable of master mode. 2. You need ~arch version of hostapd. Stable version did not do the trick for me. 3. I needed to modify the startscripts. I removed the net.wlan0 link completely, as it does not seem to be able to initialize the ap mode, but is loaded automaticaly even when it is not set to boot in a spezific runlevel. So you need hostapd to initialize the wlan-nic. hostapd script wants to start all networkinterfaces with the rc-scripts, so i edited the script, to start my bridge an the wired card only and leave out the wlan-nic. I think this is a little redundant to removing the net.wlan0 script. Sometimes while testing, the interface did not shut down properly and hostapd could not initialize them any more. So i had to set them down manually with iwconfig. After that hostapd could use them again. This is clearly not yet meant to be used in a productive environment, as the devs clearly stated in the postet threads on wireless-linux. Regards, Norman Thanks a lot Norman. I've got to remember not to ride the bleeding edge. Removing wlan0 from /etc/conf.d/hostapd didn't prevent hostapd from starting it? - Grant Removing wlan0 from /etc/conf.d/hostapd is not what you would want, as you wish hostapd to use wlan0. The init scripts are not able to set up master mode correctly and bring up an error or set up wlan0 interface in a false mode so hostapd can not set it up any more. So i set up my init to completely ignore wlan0 till hostapd handles it. Somehow hot- or coldplug initialized the net.wlan0 script anyway, so i removed it completely. Basicly it is moving over the handling of wlan0 from rc-scripts to hostapd. One thing,you might stumble accross later on. In hostapd.conf provide the wpa key in hex, not in phrase. phrase coused authentication errors for me an for one guy in the thread i talked about earlier. Otherwise the system runs fine and stable now. I hope there will be a less messy init-setting soon, as this functions get stabilized. Norman
[gentoo-user] Cleaning Out /usr/portage/distfiles/
Is there an emerge command or something to 1) clean out /usr/portage/distfiles/ for all but the most recent version of the packages installed and 2) to clean it out completely? Thanks, dave
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Hi, i have been, through that lately an it is not that out of the box. Here is what i put together from linux-wireless mailinglist and trial and error: 1. Master mode on ath5k is there, but not activated and not in 2.6.28. Mainly from this thread i got the kernel stuff and settings http://marc.info/?t=12265272074r=1w=2 I use the latest git pull from http://linuxwireless.org/. The AP mode needs still to be activated: --- wireless-testing/drivers/net/wireless/ath5k/base.c 2009-02-10 06:11:43.186470883 +0100 +++ wireless-testing/drivers/net/wireless/ath5k/base.c.old 2008-11-14 09:36:40.0 +0100 @@ -522,6 +501,7 @@ hw-wiphy-interface_modes = BIT(NL80211_IFTYPE_STATION) | BIT(NL80211_IFTYPE_ADHOC) | + BIT(NL80211_IFTYPE_AP) | BIT(NL80211_IFTYPE_MESH_POINT); hw-extra_tx_headroom = 2; Now you have a kernel and a ath5k module capable of master mode. 2. You need ~arch version of hostapd. Stable version did not do the trick for me. 3. I needed to modify the startscripts. I removed the net.wlan0 link completely, as it does not seem to be able to initialize the ap mode, but is loaded automaticaly even when it is not set to boot in a spezific runlevel. So you need hostapd to initialize the wlan-nic. hostapd script wants to start all networkinterfaces with the rc-scripts, so i edited the script, to start my bridge an the wired card only and leave out the wlan-nic. I think this is a little redundant to removing the net.wlan0 script. Sometimes while testing, the interface did not shut down properly and hostapd could not initialize them any more. So i had to set them down manually with iwconfig. After that hostapd could use them again. This is clearly not yet meant to be used in a productive environment, as the devs clearly stated in the postet threads on wireless-linux. Regards, Norman Thanks a lot Norman. I've got to remember not to ride the bleeding edge. Removing wlan0 from /etc/conf.d/hostapd didn't prevent hostapd from starting it? - Grant Removing wlan0 from /etc/conf.d/hostapd is not what you would want, as you wish hostapd to use wlan0. The init scripts are not able to set up master mode correctly and bring up an error or set up wlan0 interface in a false mode so hostapd can not set it up any more. So i set up my init to completely ignore wlan0 till hostapd handles it. Somehow hot- or coldplug initialized the net.wlan0 script anyway, so i removed it completely. Can you be more specific about what you did? Did you just remove the wlan0 initscript, or did you also make an initscript modification? If so, could you share your modification? Basicly it is moving over the handling of wlan0 from rc-scripts to hostapd. That's why I thought removing wlan0 from /etc/conf.d/hostapd would be appropriate. - Grant One thing,you might stumble accross later on. In hostapd.conf provide the wpa key in hex, not in phrase. phrase coused authentication errors for me an for one guy in the thread i talked about earlier. Otherwise the system runs fine and stable now. I hope there will be a less messy init-setting soon, as this functions get stabilized. Norman
[gentoo-user] Re: Cleaning Out /usr/portage/distfiles/
dhk dhk...@optonline.net writes: Is there an emerge command or something to 1) clean out /usr/portage/distfiles/ for all but the most recent version of the packages installed and 2) to clean it out completely? Thanks, eclean perhaps? app-portage/gentoolkit -- Rodrigo Lazo (rlazo)
Re: [gentoo-user] Cleaning Out /usr/portage/distfiles/
On Sun, 22 Feb 2009 10:13:40 -0500, dhk wrote: Is there an emerge command or something to 1) clean out /usr/portage/distfiles/ for all but the most recent version of the packages installed and 2) to clean it out completely? 1) eclean - from gentoolkit 2) rm Be careful with eclean if you are sharing a $DISTDIR. -- Neil Bothwick If only the good die young then what does that say about senior citizens? signature.asc Description: PGP signature
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Grant schrieb:
Removing wlan0 from /etc/conf.d/hostapd is not what you would want, as you
wish hostapd to use wlan0.
The init scripts are not able to set up master mode correctly and bring up
an error or set up wlan0 interface in a false mode so hostapd can not set it
up any more.
So i set up my init to completely ignore wlan0 till hostapd handles it.
Somehow hot- or coldplug initialized the net.wlan0 script anyway, so i
removed it completely.
Can you be more specific about what you did? Did you just remove the
wlan0 initscript, or did you also make an initscript modification? If
so, could you share your modification?
Sure.
I removed the net.wlan0 script, or better, i never created it.
I modified the init.d/hostapd script, not to depend on all interfaces
but on only those, which i need:
/etc/init.d/hostapd
depend() {
need net.br0
need net.eth0
use logger
}
As i said earlier, this is kind of redundant as it is possible, that
without the script, hostapd would not start that interface. But i can
not tell, i never tested it.
Basicly it is moving over the handling of wlan0 from rc-scripts to hostapd.
That's why I thought removing wlan0 from /etc/conf.d/hostapd would be
appropriate.
- Grant
Damnit, you are right, i should have read the text.
After looking over this setting with a little distance for this thread,
10 days after setting this up and with yout hint, i feel this could be
smoothed up significantly ;-). So thanks for that. I think i will put
some energy in it tomorrow.
Norman
Re: [gentoo-user] Re: Cleaning Out /usr/portage/distfiles/
Rodrigo Lazo wrote: dhk dhk...@optonline.net writes: Is there an emerge command or something to 1) clean out /usr/portage/distfiles/ for all but the most recent version of the packages installed and 2) to clean it out completely? Thanks, eclean perhaps? app-portage/gentoolkit perfect . . . thanks.
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Removing wlan0 from /etc/conf.d/hostapd is not what you would want, as you
wish hostapd to use wlan0.
The init scripts are not able to set up master mode correctly and bring up
an error or set up wlan0 interface in a false mode so hostapd can not set it
up any more.
So i set up my init to completely ignore wlan0 till hostapd handles it.
Somehow hot- or coldplug initialized the net.wlan0 script anyway, so i
removed it completely.
Can you be more specific about what you did? Did you just remove the
wlan0 initscript, or did you also make an initscript modification? If
so, could you share your modification?
Sure.
I removed the net.wlan0 script, or better, i never created it.
I modified the init.d/hostapd script, not to depend on all interfaces
but on only those, which i need:
/etc/init.d/hostapd
depend() {
need net.br0
need net.eth0
use logger
}
As i said earlier, this is kind of redundant as it is possible, that
without the script, hostapd would not start that interface. But i can
not tell, i never tested it.
Basicly it is moving over the handling of wlan0 from rc-scripts to hostapd.
That's why I thought removing wlan0 from /etc/conf.d/hostapd would be
appropriate.
- Grant
Damnit, you are right, i should have read the text.
After looking over this setting with a little distance for this thread,
10 days after setting this up and with yout hint, i feel this could be
smoothed up significantly ;-). So thanks for that. I think i will put
some energy in it tomorrow.
Norman
Still no luck for me with master mode, even after editing
wireless-testing/drivers/net/wireless/ath5k/base.c. 2.6.28 is
supposed to work but I'm wondering if it's not in 2.6.28-hardened or
something. I still get Failed to set interface ath0 to master mode
from hostapd.
- Grant
Re: [gentoo-user] Re: Mutually exclusive ebuilds?
There are good ebuilds here: http://bugs.gentoo.org/show_bug.cgi?id=131527 thx grant, I'll just wait till it goes testing, then try it. Don't hold your breath. :) 1.2.8 was working perfectly for a long time before 2.0 was released and there was never even a hint of portage folks considering it in the bug. It's a GREAT app and 2.0 is a huge step up. - Grant I've got enough to hax @ these days. James
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Grant schrieb: Still no luck for me with master mode, even after editing wireless-testing/drivers/net/wireless/ath5k/base.c. 2.6.28 is supposed to work but I'm wondering if it's not in 2.6.28-hardened or something. I still get Failed to set interface ath0 to master mode from hostapd. - Grant 2.6.28 did not work for me either. Get the wireless-testing kernel as described here: http://linuxwireless.org/en/developers/Documentation/git-guide Apply the modification to ath5k/base.c. You will have a 2.6.29-rc kernel with wireless-testing modifications. This one should do the trick. Norman
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Still no luck for me with master mode, even after editing wireless-testing/drivers/net/wireless/ath5k/base.c. 2.6.28 is supposed to work but I'm wondering if it's not in 2.6.28-hardened or something. I still get Failed to set interface ath0 to master mode from hostapd. - Grant 2.6.28 did not work for me either. Get the wireless-testing kernel as described here: http://linuxwireless.org/en/developers/Documentation/git-guide Apply the modification to ath5k/base.c. You will have a 2.6.29-rc kernel with wireless-testing modifications. This one should do the trick. Norman Thanks Norman. - Grant
RE: [gentoo-user] Gentoo Installer and Handbook (Was: Re: Gentoo's advantage: 'optimized for your system' -- huh?)
El Sab, 21 de Febrero de 2009, 19:29, James Homuth escribió: -Original Message- From: Mark David Dumlao [mailto:madum...@gmail.com] Sent: February 21, 2009 1:12 PM To: gentoo-user@lists.gentoo.org Subject: [gentoo-user] Gentoo Installer and Handbook (Was: Re: Gentoo's advantage: 'optimized for your system' -- huh?) To which the guru replied: If you just want a CD installer, then you can have this., and he gave the student another Ubuntu CD. At this point the student was enlightened. I think you just outlined the exact kind of help that keeps most people from switching to Gentoo. If that had been, for example, you and I having that particular conversation, I'd of probably smacked you with the CD and Assume it: Gentoo is not for most people. If you lack the ability to read a manual, use the Ubuntu installer or whatever else. Why do the people keep wanting to convert Gentoo in yet another Ubuntu? If you don't like it don't use it, and let us live with what we are happy. -- Jesús Guerrero
[gentoo-user] [OT] - command line read *.csv create new file
Hi, Very off topic other than I'd do this on my Gentoo box prior to using R on my Gentoo box. Please ignore if not of interest. I've got a really big data file in essentially a *.csv format. (comma delimited) I need to scan this file and create a new output file. I'm wondering if there is a reasonably easy command line way of doing this using something like sed or awk which I know nothing about. Thanks in advance. The basic idea goes something like this: 1) The input file might look this the following where some of it is attributes (shown as letters) and other parts are results. (shown as numbers) A,B,C,D,1 E,F,G,H,2 I,J,K,L,3 M,N,O,P,4 Q,R,S,T,5 U,V,W,X,6 2) From the above data input file I want to take the attributes from a few preceeding lines (say 3 in this example) and write them to the output file along with the result on the last of the 3 lines. The output file might look like this: A,B,C,D,E,F,G,H,I,J,K,L,3 E,F,G,H,I,J,K,L,M,N,O,P,4 I,J,K,L,M,N,O,P,Q,R,S,T,5 M,N,O,P,Q,R,S,T,U,V,W,X,6 3) This must be done as a read/process/write operation of some sort because the input file may be far larger than system memory. (Currently it isn't, but it likely will eventually be.) 4) In my example above I suggested that there is a single result but their may be more than one. (Don't know yet.) I showed 3 lines but might be doing 10. I don't know. It's important to me to pick a moderately flexible way of dealing with this as the order of columns and number of results will likely change over time and I'll certainly need to adjust. Thanks in advance for any pointers. Happy to buy a good book if someone knows what I should look for. Cheers, Mark
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sunday 22 February 2009, 20:06, Mark Knecht wrote: Hi, Very off topic other than I'd do this on my Gentoo box prior to using R on my Gentoo box. Please ignore if not of interest. I've got a really big data file in essentially a *.csv format. (comma delimited) I need to scan this file and create a new output file. I'm wondering if there is a reasonably easy command line way of doing this using something like sed or awk which I know nothing about. Thanks in advance. The basic idea goes something like this: 1) The input file might look this the following where some of it is attributes (shown as letters) and other parts are results. (shown as numbers) A,B,C,D,1 E,F,G,H,2 I,J,K,L,3 M,N,O,P,4 Q,R,S,T,5 U,V,W,X,6 Are the results always in the last field, and only a single field? Is the total number of fields per line always fixed? 2) From the above data input file I want to take the attributes from a few preceeding lines (say 3 in this example) and write them to the output file along with the result on the last of the 3 lines. The output file might look like this: A,B,C,D,E,F,G,H,I,J,K,L,3 E,F,G,H,I,J,K,L,M,N,O,P,4 I,J,K,L,M,N,O,P,Q,R,S,T,5 M,N,O,P,Q,R,S,T,U,V,W,X,6 Is the number of lines you pick for the operation always 3 or can it vary? And, once you choose a number n of lines, should the whole file be processed concatenating n lines at a time, and the resulting single line be ended with the result of the nth line? in other words, does the following hold for the output format: concatenation of attributes of lines 1..n result of line n concatenation of attributes of lines 2..n+1 result of line n+1 concatenation of attributes of lines 3..n+2 result of line n+1 concatenation of attributes of lines 4..n+3 result of line n+1 ... With answers to the above questions, it's probably possible to hack together a solution.
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Still no luck for me with master mode, even after editing wireless-testing/drivers/net/wireless/ath5k/base.c. 2.6.28 is supposed to work but I'm wondering if it's not in 2.6.28-hardened or something. I still get Failed to set interface ath0 to master mode from hostapd. - Grant 2.6.28 did not work for me either. Get the wireless-testing kernel as described here: http://linuxwireless.org/en/developers/Documentation/git-guide Apply the modification to ath5k/base.c. You will have a 2.6.29-rc kernel with wireless-testing modifications. This one should do the trick. Norman I'm a step closer in 2.6.28 after applying this patch: --- wireless-testing.orig/net/mac80211/cfg.c 2008-10-28 10:32:35.0 +0200 +++ wireless-testing/net/mac80211/cfg.c 2008-10-28 10:32:40.0 +0200 @@ -26,6 +26,8 @@ #ifdef CONFIG_MAC80211_MESH case NL80211_IFTYPE_MESH_POINT: #endif + case NL80211_IFTYPE_AP: + case NL80211_IFTYPE_AP_VLAN: case NL80211_IFTYPE_WDS: return true; default: The interface will go into master mode now but it errors when trying to set the channel. Are you using an AR5xxx? - Grant
Re: [gentoo-user] atheros wifi for gentoo..
On Sat, Feb 21, 2009 at 4:25 PM, maxim wexler bliss...@yahoo.com wrote: ATH5K has been in the kernel for a little while,the reason for using 2.6.28 is that it also supports the wired NIC. With the addition of the eee ACPI modules, I can now run with no third party modules on my Eee. When I do a search for 2.6.28 I get a patch. For gentoo-sources, 2.6.27 is the latest I can find. Currently using 2.6.24. Will that patch bridge the gap? At a big disadvantage here, my home PC, gentoo, is woefully out of date and I can't do anything for it because my ISP, hdcanada.com, just disappeared. No warning, no explanation. I have to pedal to town and use the wifi with the EEE. mw Well, it's a bit of a pain, but you can grab a portage snapshot from the mirrors and throw it in place on your home pc, get a list of the files you need to fetch, go back out to town, grab the packages, and then take those home to install. A couple handy commands... On Gentoo: emerge --fetchonly --pretend other options and package atoms 2 download.lst On an internet connected system (even doable on Windows with a ported copy of wget): wget -c -nc -i download.lst -- Poison [BLX] Joshua M. Murphy
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 11:06:31AM -0800, Penguin Lover Mark Knecht squawked:
I've got a really big data file in essentially a *.csv format.
(comma delimited) I need to scan this file and create a new output
file. I'm wondering if there is a reasonably easy command line way of
doing this using something like sed or awk which I know nothing about.
Thanks in advance.
Definitely more than doable in sed or awk. If you want a reference
book, try http://oreilly.com/catalog/9781565922259/
Unfortunately I haven't used awk in the longest time and can't
remember how it will go. The following sed recipe may work, modulo
some small modifications
The basic idea goes something like this:
1) The input file might look this the following where some of it is
attributes (shown as letters) and other parts are results. (shown as
numbers)
A,B,C,D,1
E,F,G,H,2
I,J,K,L,3
M,N,O,P,4
Q,R,S,T,5
U,V,W,X,6
2) From the above data input file I want to take the attributes from a
few preceeding lines (say 3 in this example) and write them to the
output file along with the result on the last of the 3 lines. The
output file might look like this:
A,B,C,D,E,F,G,H,I,J,K,L,3
E,F,G,H,I,J,K,L,M,N,O,P,4
I,J,K,L,M,N,O,P,Q,R,S,T,5
M,N,O,P,Q,R,S,T,U,V,W,X,6
3) This must be done as a read/process/write operation of some sort
because the input file may be far larger than system memory.
(Currently it isn't, but it likely will eventually be.)
4) In my example above I suggested that there is a single result but
their may be more than one. (Don't know yet.) I showed 3 lines but
might be doing 10. I don't know. It's important to me to pick a
moderately flexible way of dealing with this as the order of columns
and number of results will likely change over time and I'll certainly
need to adjust.
First create the sedscript
sedscript1:
--
1 {
N
N
}
{
p
D
N
}
--
The first block only hits when the first line of input is read. It
forces it to read the next two lines.
The second block hits for every pattern space, it prints the three
line blocks, deletes the first line, and reads the next line.
Now create the sedscript
sedscript2:
--
{
N
N
s/,[^,]\n/,/gp
d
}
--
This reads a three-line block at a time, removes the last field (and
the new line character) from all but the last line, replacing it with
a comma. Then it prints. And then it clears the pattern space.
So you can do
cat INPUT | sed -f sedscript1 | sed -f sedscript2
should give you what you want. Like I said, the whole thing can
probably be done a lot more eloquently in awk. But my awk-fu is not
what it used to be.
For a quick reference for sed, try
http://www.grymoire.com/Unix/Sed.html
W
--
Ever stop to think, and forget to start again?
Sortir en Pantoufles: up 807 days, 18:51
Re: [gentoo-user] atheros wifi for gentoo..
On Sun, Feb 22, 2009 at 3:36 PM, Joshua Murphy poiso...@gmail.com wrote: A couple handy commands... On Gentoo: emerge --fetchonly --pretend other options and package atoms 2 download.lst On an internet connected system (even doable on Windows with a ported copy of wget): wget -c -nc -i download.lst -- Poison [BLX] Joshua M. Murphy A correction to this... while I've seen the first used elsewhere, it's not at all doing what is needed... so... emerge --pretend --verbose --fetchonly other options and package atoms | tail --lines=+6 download.lst -- Poison [BLX] Joshua M. Murphy
Re: [gentoo-user] atheros wifi for gentoo..
On Sun, Feb 22, 2009 at 3:57 PM, Joshua Murphy poiso...@gmail.com wrote: On Sun, Feb 22, 2009 at 3:36 PM, Joshua Murphy poiso...@gmail.com wrote: A couple handy commands... On Gentoo: emerge --fetchonly --pretend other options and package atoms 2 download.lst On an internet connected system (even doable on Windows with a ported copy of wget): wget -c -nc -i download.lst -- Poison [BLX] Joshua M. Murphy A correction to this... while I've seen the first used elsewhere, it's not at all doing what is needed... so... emerge --pretend --verbose --fetchonly other options and package atoms | tail --lines=+6 download.lst And eventually I'll get it right... wget doesn't like the space delimited urls, and wants them on their own lines. Good job for sed. emerge --pretend --verbose --fetchonly other options and package atoms | tail --lines=+6 | sed 's# #\n#g' download.lst -- Poison [BLX] Joshua M. Murphy
Re: [gentoo-user] Gentoo and Madwifi contradict each other
Grant schrieb: I'm a step closer in 2.6.28 after applying this patch: --- wireless-testing.orig/net/mac80211/cfg.c 2008-10-28 10:32:35.0 +0200 +++ wireless-testing/net/mac80211/cfg.c 2008-10-28 10:32:40.0 +0200 @@ -26,6 +26,8 @@ #ifdef CONFIG_MAC80211_MESH case NL80211_IFTYPE_MESH_POINT: #endif + case NL80211_IFTYPE_AP: + case NL80211_IFTYPE_AP_VLAN: case NL80211_IFTYPE_WDS: return true; default: The interface will go into master mode now but it errors when trying to set the channel. Are you using an AR5xxx? - Grant Ethernet controller: Atheros Communications Inc. AR2413 802.11bg NIC (rev 01)
[gentoo-user] hal + xorg hell part 2
Hi, I'm still struggling with xorg + hal Now, my PS/2 keyboard translates certain keys in a strange way, e.g. 'insert' 'home' 'PgUp' 'PgDn' etc. Xorg.0.log contains the following lines which I don't understand (II) config/hal: Adding input device AT Translated Set 2 keyboard (**) AT Translated Set 2 keyboard: always reports core events (**) AT Translated Set 2 keyboard: Device: /dev/input/event0 (WW) AT Translated Set 2 keyboard: device file already in use. Ignoring. (II) UnloadModule: evdev (EE) PreInit returned NULL for AT Translated Set 2 keyboard (EE) config/hal: NewInputDeviceRequest failed Any help is very much appreciated, thanks, Helmut. P.S. I tried both drivers kbd and evdev (since my mouse uses evdev) -- Helmut Jarausch Lehrstuhl fuer Numerische Mathematik RWTH - Aachen University D 52056 Aachen, Germany
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 12:15 PM, Etaoin Shrdlu shr...@unlimitedmail.org wrote: On Sunday 22 February 2009, 20:06, Mark Knecht wrote: Hi, Very off topic other than I'd do this on my Gentoo box prior to using R on my Gentoo box. Please ignore if not of interest. I've got a really big data file in essentially a *.csv format. (comma delimited) I need to scan this file and create a new output file. I'm wondering if there is a reasonably easy command line way of doing this using something like sed or awk which I know nothing about. Thanks in advance. The basic idea goes something like this: 1) The input file might look this the following where some of it is attributes (shown as letters) and other parts are results. (shown as numbers) A,B,C,D,1 E,F,G,H,2 I,J,K,L,3 M,N,O,P,4 Q,R,S,T,5 U,V,W,X,6 Are the results always in the last field, and only a single field? Is the total number of fields per line always fixed? I don't know that for certain yet but I think the results will not always be in the last field. The total number of fields per line is always fixed in a given file but might change from file to file. If it does I'm willing to do minor edits (heck - I'll do major edits if I have to!!) to get it working. 2) From the above data input file I want to take the attributes from a few preceeding lines (say 3 in this example) and write them to the output file along with the result on the last of the 3 lines. The output file might look like this: A,B,C,D,E,F,G,H,I,J,K,L,3 E,F,G,H,I,J,K,L,M,N,O,P,4 I,J,K,L,M,N,O,P,Q,R,S,T,5 M,N,O,P,Q,R,S,T,U,V,W,X,6 Is the number of lines you pick for the operation always 3 or can it vary? And, once you choose a number n of lines, should the whole file be processed concatenating n lines at a time, and the resulting single line be ended with the result of the nth line? in other words, does the following hold for the output format: concatenation of attributes of lines 1..n result of line n concatenation of attributes of lines 2..n+1 result of line n+1 concatenation of attributes of lines 3..n+2 result of line n+1 concatenation of attributes of lines 4..n+3 result of line n+1 The above diagram is correct when the lines chosen is 3. I suspect that I might chose 10 or 15 lines once I get real data and do some testing but that was harder to show in this email. A good design for me would be a single variable I could set. Once a value is chosen I want to process every line in the input file the same way. I don't use 5 lines sometimes and 10 lines other times. In a given file it's always the same number of lines. ... With answers to the above questions, it's probably possible to hack together a solution. Thanks! - Mark
[gentoo-user] Issue with e2fsprogs
Hi everyone, I know there is a bug here, but I followed this from the bug comments: 1. emerge -NuDav --fetchonly world 2. emerge -C ss com_err e2fsprogs 3. emerge -NuDav --nodeps e2fsprogs-libs e2fsprogs 4. echo sys-libs/com_err /etc/portage/package.mask 5. echo sys-libs/ss /etc/portage/package.mask 6. echo sys-libs/com_err-1.40.11 /etc/portage/profile/package.provided 7. echo sys-libs/ss-1.40.11 /etc/portage/profile/package.provided This worked from a few people, so I felt safe doing it. On step 3, e2fsprogs-libs emerged fine, but at the end of the emerge of e2fsprogs, the emerge bombed and I got a message saying that e2progs was not merged due to file collisions. I have no idea what to do now. I googled, but didn't see anything relevant. Any help would be appreciated. Regards, Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sunday 22 February 2009, 23:28, Mark Knecht wrote:
concatenation of attributes of lines 1..n result of line n
concatenation of attributes of lines 2..n+1 result of line n+1
concatenation of attributes of lines 3..n+2 result of line n+1
concatenation of attributes of lines 4..n+3 result of line n+1
The above diagram is correct when the lines chosen is 3. I suspect
that I might chose 10 or 15 lines once I get real data and do some
testing but that was harder to show in this email. A good design for
me would be a single variable I could set. Once a value is chosen I
want to process every line in the input file the same way. I don't use
5 lines sometimes and 10 lines other times. In a given file it's
always the same number of lines.
Ok, try this for a start:
BEGIN { FS=OFS=,}
{
r=$NF;NF--
for(i=1;in;i++){
s[i]=s[i+1]
if(NR=n)printf %s%s,s[i],OFS
}
s[n]=$0;if(NR=n)printf %s,%s\n, s[n],r
}
Save the above code in a file (eg, program.awk) and run it with
awk -v n=3 -f program.awk datafile.csv
where the n=3 part is to be replaced with the actual number of lines
you want to group (eg, n=5, n=4, etc.)
With your sample input and n=3, the above awk program produces the output
you show.
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 12:59 PM, Willie Wong ww...@princeton.edu wrote:
On Sun, Feb 22, 2009 at 11:06:31AM -0800, Penguin Lover Mark Knecht squawked:
I've got a really big data file in essentially a *.csv format.
(comma delimited) I need to scan this file and create a new output
file. I'm wondering if there is a reasonably easy command line way of
doing this using something like sed or awk which I know nothing about.
Thanks in advance.
Definitely more than doable in sed or awk. If you want a reference
book, try http://oreilly.com/catalog/9781565922259/
Unfortunately I haven't used awk in the longest time and can't
remember how it will go. The following sed recipe may work, modulo
some small modifications
The basic idea goes something like this:
1) The input file might look this the following where some of it is
attributes (shown as letters) and other parts are results. (shown as
numbers)
A,B,C,D,1
E,F,G,H,2
I,J,K,L,3
M,N,O,P,4
Q,R,S,T,5
U,V,W,X,6
2) From the above data input file I want to take the attributes from a
few preceeding lines (say 3 in this example) and write them to the
output file along with the result on the last of the 3 lines. The
output file might look like this:
A,B,C,D,E,F,G,H,I,J,K,L,3
E,F,G,H,I,J,K,L,M,N,O,P,4
I,J,K,L,M,N,O,P,Q,R,S,T,5
M,N,O,P,Q,R,S,T,U,V,W,X,6
3) This must be done as a read/process/write operation of some sort
because the input file may be far larger than system memory.
(Currently it isn't, but it likely will eventually be.)
4) In my example above I suggested that there is a single result but
their may be more than one. (Don't know yet.) I showed 3 lines but
might be doing 10. I don't know. It's important to me to pick a
moderately flexible way of dealing with this as the order of columns
and number of results will likely change over time and I'll certainly
need to adjust.
First create the sedscript
sedscript1:
--
1 {
N
N
}
{
p
D
N
}
--
The first block only hits when the first line of input is read. It
forces it to read the next two lines.
The second block hits for every pattern space, it prints the three
line blocks, deletes the first line, and reads the next line.
Now create the sedscript
sedscript2:
--
{
N
N
s/,[^,]\n/,/gp
d
}
--
This reads a three-line block at a time, removes the last field (and
the new line character) from all but the last line, replacing it with
a comma. Then it prints. And then it clears the pattern space.
So you can do
cat INPUT | sed -f sedscript1 | sed -f sedscript2
should give you what you want. Like I said, the whole thing can
probably be done a lot more eloquently in awk. But my awk-fu is not
what it used to be.
For a quick reference for sed, try
http://www.grymoire.com/Unix/Sed.html
W
--
Ever stop to think, and forget to start again?
Sortir en Pantoufles: up 807 days, 18:51
Thanks Willie. That's a good start. The first two lines out were
mangled but that's totally cool. I can deal with that by hand.
There are two places where I'd like to improve things which probably
apply to the awk code Etaoin just sent me also. Both have to do with
excluding columns but in different ways.
1) My actual input data starts with two fields which date time. For
lines 2 3 I need exclude the 2nd 3rd date time from the output
corresponding to line 1, so these 3 lines:
Date1,Time1,A,B,C,D,0
Date2,Time2,E,F,G,H,1
Date3,Time3,I,J,K,L,2
should generate
Date1,Time1,A,B,C,D,E,F,G,H,,I,J,K,L,2
Essentially Date Time from line 1, results from line 3.
2) The second is that possibly I don't need attribute G in my output
file. I'm thinking that possibly a 3rd sed script that counts a
certain number of commas and then doesn't copy up through the next
comma? That's messy in the sense that I probably need to drop 10-15
columns out as my real data is maybe 100 fields wide so I'd have 10-15
addition scripts which is too much of a hack to be maintainable.
Anyway, I appreciate the ideas. What you sent worked great.
I suspect this is somehow similar to what you did in the second
script? I'll go play around and see if I can figure that out.
In reality I'm not sure yet whether the results can be guaranteed to
be at the end in the real file, and probably there will be more than
one result column although if I have to I might be able to take care
of combining two results into a single value at the data sounce if
necessary.
Great help! Thanks!
Cheers,
Mark
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 2:57 PM, Etaoin Shrdlu shr...@unlimitedmail.org wrote:
On Sunday 22 February 2009, 23:28, Mark Knecht wrote:
concatenation of attributes of lines 1..n result of line n
concatenation of attributes of lines 2..n+1 result of line n+1
concatenation of attributes of lines 3..n+2 result of line n+1
concatenation of attributes of lines 4..n+3 result of line n+1
The above diagram is correct when the lines chosen is 3. I suspect
that I might chose 10 or 15 lines once I get real data and do some
testing but that was harder to show in this email. A good design for
me would be a single variable I could set. Once a value is chosen I
want to process every line in the input file the same way. I don't use
5 lines sometimes and 10 lines other times. In a given file it's
always the same number of lines.
Ok, try this for a start:
BEGIN { FS=OFS=,}
{
r=$NF;NF--
for(i=1;in;i++){
s[i]=s[i+1]
if(NR=n)printf %s%s,s[i],OFS
}
s[n]=$0;if(NR=n)printf %s,%s\n, s[n],r
}
Save the above code in a file (eg, program.awk) and run it with
awk -v n=3 -f program.awk datafile.csv
where the n=3 part is to be replaced with the actual number of lines
you want to group (eg, n=5, n=4, etc.)
With your sample input and n=3, the above awk program produces the output
you show.
Yeah, that's probably almost usable as it is . I tried it with n=3 and
n=10. Worked both times just fine. The initial issue might be (as with
Willie's sed code) that the first line wasn't quite right and required
some hand editing. I'd prefer not to have to hand edit anything as the
files are large and that step will be slow. I can work on that.
As per the message to Willie it would be nice to be able to drop
columns out but technically I suppose it's not really required. All of
this is going into another program which must at some level understand
what the columns are. If I have extra dates and don't use them that's
probably workable.
The down side is the output file is 10x larger than the input file -
roughly - and my current input files are 40-60MB so the output files
will be 600MB. Not huge but if they grew too much more I might get
beyond what a single file can be on ext3, right? Isn't that 2GB or so?
Thanks very much,
Mark
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 03:15:09PM -0800, Penguin Lover Mark Knecht squawked: 1) My actual input data starts with two fields which date time. For lines 2 3 I need exclude the 2nd 3rd date time from the output corresponding to line 1, so these 3 lines: Date1,Time1,A,B,C,D,0 Date2,Time2,E,F,G,H,1 Date3,Time3,I,J,K,L,2 should generate Date1,Time1,A,B,C,D,E,F,G,H,,I,J,K,L,2 Essentially Date Time from line 1, results from line 3. 2) The second is that possibly I don't need attribute G in my output file. I'm thinking that possibly a 3rd sed script that counts a certain number of commas and then doesn't copy up through the next comma? That's messy in the sense that I probably need to drop 10-15 columns out as my real data is maybe 100 fields wide so I'd have 10-15 addition scripts which is too much of a hack to be maintainable. Anyway, I appreciate the ideas. What you sent worked great. For both of these cases, since you are dropping columns and not re-organizing, you'd have a much easier time just piping the command through cut. Try 'man cut' (it is only a few hundred words) for usage. But with the sample you gave me, you just need to post process with | cut -d , -f 1-6,9,10,12,15- and the Date2, Time2, G, Date3, Time3 columns will be dropped. As to your problem with the first two lines being mangled: I suspect that the first two lines were formatted differently? Maybe stray control characters got into your file or maybe there are leading spaces? It's bizarre for both Etaoin's and my scripts to coincidentally mess up the same lines. (Incidentally, where did you get the csv files from? When I worked in a physics labs and collected data, I found that a lot of times the processing of data using basic command-line tools like sed, bash, perl, and bc can be done a lot more quickly if the initial datasets were formatted in a sensible fashion. Of course there are times when such luxury cannot be afforded.) Best, W -- What's the Lagrangian for a suction dart? ~DeathMech, Some Student. P-town PHY 205 Sortir en Pantoufles: up 807 days, 23:29
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 4:57 PM, Willie Wong ww...@princeton.edu wrote: On Sun, Feb 22, 2009 at 03:15:09PM -0800, Penguin Lover Mark Knecht squawked: 1) My actual input data starts with two fields which date time. For lines 2 3 I need exclude the 2nd 3rd date time from the output corresponding to line 1, so these 3 lines: Date1,Time1,A,B,C,D,0 Date2,Time2,E,F,G,H,1 Date3,Time3,I,J,K,L,2 should generate Date1,Time1,A,B,C,D,E,F,G,H,,I,J,K,L,2 Essentially Date Time from line 1, results from line 3. 2) The second is that possibly I don't need attribute G in my output file. I'm thinking that possibly a 3rd sed script that counts a certain number of commas and then doesn't copy up through the next comma? That's messy in the sense that I probably need to drop 10-15 columns out as my real data is maybe 100 fields wide so I'd have 10-15 addition scripts which is too much of a hack to be maintainable. Anyway, I appreciate the ideas. What you sent worked great. For both of these cases, since you are dropping columns and not re-organizing, you'd have a much easier time just piping the command through cut. Try 'man cut' (it is only a few hundred words) for usage. But with the sample you gave me, you just need to post process with | cut -d , -f 1-6,9,10,12,15- and the Date2, Time2, G, Date3, Time3 columns will be dropped. Thanks. I'll investigate that tomorrow. As to your problem with the first two lines being mangled: I suspect that the first two lines were formatted differently? Maybe stray control characters got into your file or maybe there are leading spaces? It's bizarre for both Etaoin's and my scripts to coincidentally mess up the same lines. (Incidentally, where did you get the csv files from? When I worked in a physics labs and collected data, I found that a lot of times the processing of data using basic command-line tools like sed, bash, perl, and bc can be done a lot more quickly if the initial datasets were formatted in a sensible fashion. Of course there are times when such luxury cannot be afforded.) They are primarialy coming from TradeStation. The data that I'm working with is stock pricing data along with technical indicators coming off of charts. Unfortunatelly I don't seem to have any control at all as to the order that the columns show up. It doesn't seem to be based on how I build the chart and certain things on the chart I don't need are still output to the file. It's pretty much take 100% of what's on the chart or take nothing. Fortunately the csv files are very good in terms of not dropping out data. At least every row has all the data. Cheers, Mark Best, W -- What's the Lagrangian for a suction dart? ~DeathMech, Some Student. P-town PHY 205 Sortir en Pantoufles: up 807 days, 23:29
Re: [gentoo-user] Issue with e2fsprogs
On Sun, 22 Feb 2009 17:32:57 -0500 CJoeB colleen.bea...@gmail.com wrote: On step 3, e2fsprogs-libs emerged fine, but at the end of the emerge of e2fsprogs, the emerge bombed and I got a message saying that e2progs was not merged due to file collisions. You can use 'equery b PATH' (app-portage/gentoolkit) to determine which package owns the offending files, then either unmerge it or just set FEATURES=-collision-protect to force installation despite collisions. -- Mike Kazantsev // fraggod.net signature.asc Description: PGP signature
[gentoo-user] Re: hal + xorg hell part 2
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Helmut Jarausch wrote: Hi, I'm still struggling with xorg + hal Now, my PS/2 keyboard translates certain keys in a strange way, e.g. 'insert' 'home' 'PgUp' 'PgDn' etc. Xorg.0.log contains the following lines which I don't understand (II) config/hal: Adding input device AT Translated Set 2 keyboard (**) AT Translated Set 2 keyboard: always reports core events (**) AT Translated Set 2 keyboard: Device: /dev/input/event0 (WW) AT Translated Set 2 keyboard: device file already in use. Ignoring. (II) UnloadModule: evdev (EE) PreInit returned NULL for AT Translated Set 2 keyboard (EE) config/hal: NewInputDeviceRequest failed Any help is very much appreciated, thanks, Helmut. P.S. I tried both drivers kbd and evdev (since my mouse uses evdev) You are probably setting the xkb keyboard type incorrectly, assuming you are using Gnome, KDE, or Xfce - You need to tell the desktop environment that you have an evdev keyboard, instead of whatever keyboard you actually have, and use the evdev driver (if I'm not mistaken). I had the same problem a few months ago when I upgraded, and that fixed it. - -- ABCD -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkmiILgACgkQOypDUo0oQOpwDACeK/Y2JJ4wiHC3J0OLTd5NoOJT eQEAn30ovptIBWFrIiJ+jfGZYpUN+RQW =73mK -END PGP SIGNATURE-
Re: [gentoo-user] Issue with e2fsprogs
Mike Kazantsev wrote: On Sun, 22 Feb 2009 17:32:57 -0500 CJoeB colleen.bea...@gmail.com wrote: On step 3, e2fsprogs-libs emerged fine, but at the end of the emerge of e2fsprogs, the emerge bombed and I got a message saying that e2progs was not merged due to file collisions. You can use 'equery b PATH' (app-portage/gentoolkit) to determine which package owns the offending files, then either unmerge it or just set FEATURES=-collision-protect to force installation despite collisions. The FEATURES=collision-protect didn't work. I assume I entered the command correctly because protage didn't give me grief. I have no idea how to determine what is the offending package because I don't know what the path is where the offending package is. This is the message I get at the end when emerge bombs: Package 'sys-fs/e2fsprogs-1.40.9' NOT merged due to file collisions. * If necessary, refer to your elog messages for the whole content of the * above message. I've looked at emerge.log, but nothing sheds any light. And if this isn't where I'm supposed to look, I'm not sure where I should be looking. Regards, Colleen -- Registered Linux User #411143 with the Linux Counter, http://counter.li.org
Re: [gentoo-user] Issue with e2fsprogs
On Montag 23 Februar 2009, CJoeB wrote: Mike Kazantsev wrote: On Sun, 22 Feb 2009 17:32:57 -0500 CJoeB colleen.bea...@gmail.com wrote: On step 3, e2fsprogs-libs emerged fine, but at the end of the emerge of e2fsprogs, the emerge bombed and I got a message saying that e2progs was not merged due to file collisions. You can use 'equery b PATH' (app-portage/gentoolkit) to determine which package owns the offending files, then either unmerge it or just set FEATURES=-collision-protect to force installation despite collisions. The FEATURES=collision-protect didn't work. I assume I entered the command correctly because protage didn't give me grief. I have no idea how to determine what is the offending package because I don't know what the path is where the offending package is. This is the message I get at the end when emerge bombs: usually the collision is shown a little bit above that. Just scroll back. Ands you have to set -collision-protect
Re: [gentoo-user] [OT] - command line read *.csv create new file
On Sun, Feb 22, 2009 at 5:31 PM, Mark Knecht markkne...@gmail.com wrote: The down side is the output file is 10x larger than the input file - roughly - and my current input files are 40-60MB so the output files will be 600MB. Not huge but if they grew too much more I might get beyond what a single file can be on ext3, right? Isn't that 2GB or so? The maximum file size for ext3 depends on the block size you're using, but I believe with the default settings it is 2TB max, not 2GB. I have personally had files as large as 26GB on ext3 without issues. You could always pipe the whole operation it through gzip/bzip2/lzma or similar if you want the file on disk to be much smaller.
Re: [gentoo-user] Issue with e2fsprogs
CJoeB wrote: Hi everyone, I know there is a bug here, but I followed this from the bug comments: It's not a bug. It's a valid blocker. They happen. 1. emerge -NuDav --fetchonly world 2. emerge -C ss com_err e2fsprogs 3. emerge -NuDav --nodeps e2fsprogs-libs e2fsprogs Using -D (--deep) and --nodeps is contradictory. In addition, you just unmerged e2fsprogs, which means using --update (-u) now makes very little sense. -N (--newuse) also makes very little sense (in addition to the fact that it implies --update). 4. echo sys-libs/com_err /etc/portage/package.mask 5. echo sys-libs/ss /etc/portage/package.mask 6. echo sys-libs/com_err-1.40.11 /etc/portage/profile/package.provided 7. echo sys-libs/ss-1.40.11 /etc/portage/profile/package.provided You should not add these packages to package.provided. There should be no need for this. I can see this causing issues. From the forums: http://forums.gentoo.org/viewtopic-t-712898.html # echo =app-crypt/mit-krb5-1.6.3-r2 /etc/portage/package.keywords # emerge --sync # emerge -f e2fsprogs e2fsprogs-libs # emerge --unmerge ss com_err e2fsprogs # emerge -av e2fsprogs e2fsprogs-libs You should also try to make sure you're using the latest version of portage (=2.1.6) as this has blocker handling functionality. This worked from a few people, so I felt safe doing it. On step 3, e2fsprogs-libs emerged fine, but at the end of the emerge of e2fsprogs, the emerge bombed and I got a message saying that e2progs was not merged due to file collisions. Please post the complete message (ie. the complete list of file collisions). I have no idea what to do now. I googled, but didn't see anything relevant. Any help would be appreciated. Regards, Colleen AllenJB
