|kardan| (~kardan@p54BE6C3B.dip.t-dialin.net) joined #fai.
kardan_ (~kardan@p54BE6880.dip.t-dialin.net) left irc: Ping timeout: 480 seconds
allee-k (~allee-k@dslb-092-074-034-235.pools.arcor-ip.net) left irc: Ping timeout: 480 seconds
amgarchIn9 (~amgarchin@p4FF036E4.dip0.t-ipconnect.de) left irc: Remote host closed the connection
ErKa (keryell@wireless-357.sc09.org) left irc: Ping timeout: 480 seconds
simNIX (~simNIX@156-60.bbned.dsl.internl.net) left irc: Ping timeout: 480 seconds
simNIX (~simNIX@156-60.bbned.dsl.internl.net) joined #fai.
ErKa (~keryell@72.11.113.122) joined #fai.
mikap (~mika@mail.michael-prokop.at) left irc: Ping timeout: 480 seconds
mikap (~mika@mail.michael-prokop.at) joined #fai.
ErKa (~keryell@72.11.113.122) left irc: Ping timeout: 480 seconds
ghislain (~Ghislain@LPuteaux-151-41-11-129.w217-128.abo.wanadoo.fr) joined #fai.
Mrfai (~lange@kueppers.informatik.uni-koeln.de) joined #fai.
ErKa (~keryell@72.11.113.122) joined #fai.
Action: allee stimmt \sh zu
10:01 \shwas?
siggg (~jean@tra78-5-88-172-128-32.fbx.proxad.net) left irc: Ping timeout: 480 seconds
cbmuser (~glaubitz@z6.physik.fu-berlin.de) left irc: Ping timeout: 480 seconds
Mrfai (~lange@kueppers.informatik.uni-koeln.de) left irc: Quit: leaving
Mrfai (~lange@suenner.informatik.uni-koeln.de) joined #fai.
cbmuser (~glaubitz@bender.physik.fu-berlin.de) joined #fai.
10:37 allee\sh: das'de was vernuenftiges geschafft hast :)
10:42 \shach so
siggg (~jean@AVelizy-151-1-20-46.w82-124.abo.wanadoo.fr) joined #fai.
cbmuser (~glaubitz@bender.physik.fu-berlin.de) left irc: Quit: leaving
cbmuser (~glaubitz@z6.physik.fu-berlin.de) joined #fai.
mfl (~mfl@adonis.fnb.maschinenbau.tu-darmstadt.de) left irc: Quit: leaving
ErKa (~keryell@72.11.113.122) left irc: Ping timeout: 480 seconds
mfl (~mfl@adonis.fnb.maschinenbau.tu-darmstadt.de) joined #fai.
14:55 cbmuserhey, does setup_harddisks work in FAI 3.3 at all anymore?
14:55 cbmuseror was it completely dumped now?
14:55 cbmuserall of a sudden I cannot install machines with squeeze anymore :(
15:08 cbmuserI really need help, FAI doesn't mount the newly partitioned disk anymore
15:08 cbmuserso all packages end up being installed into RAM
15:08 cbmuserRamdisk
15:08 cbmuserwhich is eventually full
15:17 MrfaiI do not recommend to use setup_harddisks any more. It's still available in 3.3 but, it's untested an no more bugs will be fixed for it.
15:18 MrfaiI myself do not yet use FAI with squeeze.
15:21 cbmuserMrfai: Thomas, nice to see you ;)
15:21 cbmuserdo you have any idea why FAI wouldn't mount the disks anymore all of a sudden?
15:22 cbmusercan you point me to some resource explaining how to migrate from setup_harddisks to _storage?
15:23 cbmuserI also want to use the latter now in order to use ext4 ;)
15:24 Mrfaicbmuser: hav a log at the log files. Maybe your kernel cannot load the ext2/3 module
15:24 cbmuserah
15:25 cbmuserright, it complained about some modules
15:25 cbmuserthanks
15:25 cbmuserI would be wondering why though
15:25 cbmuserah, I know
15:26 cbmuserthe kernel has been upgraded to 2.6.30-2
15:28 cbmuserok, another problem, make-fai-nfsroot fails creating the initrd
15:30 \shcbmuser, that problem is known for squeeze :) pav5088__ had the same issue
15:31 cbmuserany known fix?
15:32 cbmuser(using Lenny is not an option on a Dell OptiPlex 760)
15:34 oz_.o0(trö-Dell...)
15:34 cbmuserso?
15:35 cbmuserso FAI is only supported on ancient hardware?
15:36 pav5088__cbmuser, perhaps running update-initramfs -c -t -k 2.6.30-2-486 after chrooting into your nfsroot...  this was a suggestion given to me...
15:36 cbmuserok, thanks, will give it a shot
15:36 pav5088__ie. doing things manually for the time being.
15:37 cbmuserthats good enough
15:37 cbmuserin any case, I really can't go back to Lenny
siggg (~jean@AVelizy-151-1-20-46.w82-124.abo.wanadoo.fr) left irc: Ping timeout: 480 seconds
15:37 cbmuserxorg doesn't support the intel graphics board
15:37 cbmuserand the kernel the rest of the hardware
Nick change: pav5088__ -> pav5088
15:42 mgoetzecbmuser: you might be interested in http://faiwiki.informatik.uni-koeln.de/index.php/Grml_Kernel
15:42 mgoetzecbmuser: (with an otherwise lenny nfsroot)
15:45 pav5088Is Squeeze still freezing in December 2009?
15:46 oz_cbmuser: fai does support any hardware if your kernel supports it.
15:47 pav5088oz_, perhaps he's talking about the xserver in Lenny
15:47 Mrfaipav5088: no. I think the plans say first quarter of 2010
15:48 pav5088Mrfai, so they've changed the schedule?  Or was the Dec freeze just for the installer with the other parts coming later?
15:50 mgoetzepav5088: the dec freeze was a premature announcement without sufficient consultation...
15:50 pav5088I haven't really heard anything about it since midyear
15:50 mgoetzei believe the current plan is to freeze in march
15:51 pav5088OK, that's good...  :)
|kardan| (~kardan@p54BE6C3B.dip.t-dialin.net) left irc: Ping timeout: 480 seconds
15:52 mgoetzehttp://lists.debian.org/debian-devel-announce/2009/10/msg00002.html
15:53 pav5088I was working under the assumption that the 2009 deadline was still on, and in that case I would be a bit behind schedule in my own project work.
15:55 cbmuseroz_: I know, but when FAI supports Lenny only I can't use Squeeze and therefore not a current kernel without any trouble
15:57 pav5088cbmuser, have you tried backports for a more modern kernel?
15:58 pav5088...but I guess that won't help if your xserver doesn't support your video anyway.
15:59 Mrfaicbmuser: use FAI with squeeze and report problem to the bts. You can also help to make FAI work with squeeze if you send patches
|kardan| (~kardan@p54BE36AC.dip.t-dialin.net) joined #fai.
16:00 cbmuserMrfai: I will report back problems, I don't have time for patches unfortunately :(
16:01 pav5088I don't have the skills...  ;)  It has taken me a year to document GOsa as far as I have.
16:02 cbmuserpav5088: well, Squeeze is already rising at the horizon
16:03 Mrfaicbmuser: bug reports are fine. Most of the time it's easy for me to implement a fix, if you can tell me what's going wrong, and what's the new way to do it.
16:04 pav5088I know...   some guy from Belgium asked me to join a documenting effort for GOsa, but if I'm one of the more skilled people then the GOsa world is in trouble.
16:05 pav5088My FAI+GOsa documentation SEEMS to work...   but I have no idea how to use it.  ;)  I'm trying to work out Kolab+GOsa now...  and it looks like I will have to do lots of LDAP mods etc... etc...   and using Kolab in custom ways is not documented.  :(
16:06 cbmuserMrfai: so far I've only had the isse with the initrd not being created by make-fai-nfsroot
16:06 \shMrfai, make-fai-nfsroot makes a divert of update-initramfs when upgrading the chroot, right? this is what I read from the source...
16:06 cbmuserthe rest works quite nicely, I had to update alot of stuff in our config though
16:06 Mrfai\sh: yep
16:06 \shMrfai, so...it shouldn't happen when creating the chroot, or?
16:07 MrfaiIn the past, the initrd was build more than once, since the kernel itseld did this, and then also the live-initramfs and mdadm also recreated the initrd. There the code was added to skip this, and create the initrd at the end of make-fai-nfsroot
16:07 \shpav5088, or cbmuser would you do me a favour, and paste the contents of /etc/lsb-release?
siggg (~jean@tra78-5-88-172-128-32.fbx.proxad.net) joined #fai.
16:08 Mrfaitherefore make-fai-fsnroot has the option -U
16:08 pav5088No such file or directory
16:08 pav5088is this in the NFSROOT?
16:08 Mrfaicbmuser: can you please try it with -U
16:08 \shMrfai, well, strange thing is, that you set $divert to 0 for ubuntu
16:09 \shMrfai, could be that we need to set $divert to 0 for squeeze too, just a shot
Action: Mrfai .oO (man pages are really great)
16:09 oz_/etc/lsb-release doesn't exist on debian, or does it?
16:09 \shoz_, woot?
16:09 \shit should have that
16:10 pav5088There's an lsb-base directory
16:10 mgoetzepackage debian-edu-config has /etc/lsb-release
16:10 pav5088(with nothing in it)
16:10 mgoetzehttp://packages.debian.org/search?searchon=contents&keywords=lsb-release&mode=path&suite=testing&arch=any
16:10 oz_\sh: my lenny here doesn't have it.
16:10 Mrfailsb-release only exists if you have installed the package lsb-release. I also do not install it on my machines
16:11 \shMrfai, on ubuntu /etc/lsb-release belongs to base-files
16:11 oz_\sh: vanilla debian is SLOW. :)
16:12 Mrfaiubuntu is too fast
16:12 oz_Mrfai: imho too, but $users want is like that...
16:13 \shwell, lsb-release is the only file which can really tell a app dev on what linux os the app is running, and if it would work...it's not that this file is useless or so
16:13 \sheven if you can fake it ;)
16:13 oz_\sh: cat /etc/debian-release is the file for me. ;)
16:13 oz_/etc/debian_version even
16:14 \shimagine every linux distro has it's own <distro>-release file (imho redhat does have its own too)
16:14 cbmuserMrfai: make-nfs-root with -U?
16:14 \shanyways, I wonder if we have to set divert to 0 for squeeze
16:14 cbmuserI can't try right now because I have 3 clients being installed right now
16:14 oz_\sh: why imagine? it's just like that
16:14 \shcbmuser: make-fai-nfsroot -vU
16:15 \shoz_, it will be our hell..if we don't get a standard on this, distro neutral standard that is
16:16 pav5088I'm doing the make-fai-nfsroot -vU ...  although it's on a virtual machine running on a slow box
16:18 pav5088ie. my desktop.  ;)
16:19 oz_\sh: hm. I have been administering different UNIXes...HP/UX, SUNOS, AIX...
16:19 oz_normal unix hell ,)
16:21 pav5088http://pastebin.com/d17d23f18
16:22 \shpav5088, thx...that's it
16:23 \shoz_, can you paste your debian_release or whatever debian uses? ;)
16:23 \shMrfai, divert=0 for squeeze ;)
16:23 oz_gold:~# cat /etc/debian_version
16:23 oz_5.0.2
16:24 oz_\sh: that's for lenny
16:24 cbmuser\sh: ok, will try later, thanks
16:24 \shhow can someone tell that someone is running debian, programmtically?
16:24 \shsqueeze will be 6.0.0 then?
16:24 pav5088/etc/debian_version = sqeeze/sid
16:24 pav5088s/sqeeze/squeeze
16:24 MrfaiI think make-fai-nfsroot must check etc/debian_version inside the nfsroot, not from the host ssytem
16:26 Mrfaiow it's  sqeeze/sid but I think it will be changed (to 6.0) if squeeze is released. So, not that easy to detect which version be have
16:26 pav5088Squeeze has changed over to dash as /bin/sh...   I've been bitten by strange things like eg. echo -e will echo the -e (dash has an inbuilt echo command)
16:26 Mrfaifai is only using bash scripts
16:26 pav5088OK
16:26 \shpav5088, that's why all shell scripts are shebanging /bin/bash ;)
16:27 \shwe had this topic already for ubuntu in the past ;)
16:27 \shoh well...shebang is somehow sexist ;)
16:27 mgoetze\sh: i've found /etc/issue to be pretty good for identifying what distro you're on, generally
16:27 oz_mgoetze: hehe
16:28 \shhmm
16:29 Mrfaipav5088: Using -U shows that squeeze will generate the initrd twice. But this is better than never.
16:30 mgoetzei'd like to help test fai with squeeze, but i'm having such a hard time getting kvm working on squeeze :(
16:34 pav5088Mrfai, OK....  I'll tell this to the guys on #gosa on FreeNode so they can test
16:35 \shthere are more problems, if you check pav5088 paste, the MD stuff is failing
16:36 pav5088hmmmm....  OK
16:37 \sh#
16:37 \shSetting up mdadm (3.0.3-2) ...
16:37 \sh#
16:37 \sh
16:37 \sh#
16:37 \shW: mdadm: failed to load MD subsystem.
16:37 \sh#
16:37 \sh
16:37 \sh#
16:37 \shGenerating array device nodes... /var/lib/dpkg/info/mdadm.postinst: 158: /dev/MAKEDEV: not found
16:37 \sh#
16:37 \sh
16:37 \sh#
16:37 \shfailed.
16:37 \sh#
16:37 \sh
16:37 \shargl
16:37 \shdamn
16:37 oz_FAIL. :)
16:37 mgoetzeand we trust this guy with svn access? ;)
16:38 \shI'm not pushing to trunk ;) and normally the paste works...*grmpf*
16:38 \sh*shameonme*
16:38 oz_mgoetze: hm. I get headache when I think about our government and 'competence'....
16:39 pav5088Further up :
16:39 pav5088update-initramfs: Generating /boot/initrd.img-2.6.30-2-486
16:39 pav5088sed: can't read /etc/mdadm/mdadm.conf: No such file or directory
16:39 pav5088Examining /etc/kernel/postinst.d.
16:39 \shsqueeze should use upstart, right?
16:39 oz_mgoetze: you can trust this guy, I'm sure. I've seen him IRL!!!
16:39 MrfaiI think the mdadm stuff is not problem. It's similar to what I get on lenny.
16:39 mgoetzeanyway, i'm sure the MAKEDEV problem will be sorted out eventually in squeeze... it got moved from priority: required to priority: extra soon after the release of lenny
16:39 pav5088apt-file doesn't find a /etc/mdadm/mdadm.conf
16:39 \shMrfai, ok...
16:40 mgoetze\sh: i haven't seen anyone seriously working on making upstart the default
16:40 \shpav5088, looks like it's autogenrated
16:40 mgoetze\sh: however, i can report that it works fine, so if you want to install it on your systems, go ahead :)
16:40 MrfaiI just checked. The diversion of update-initramfs or mkinitramfs can also be remove for lenny. lenny also uysed trigger that do work, so the initrd is only created once.
16:40 \shmgoetze, oh well...good to know...so you don't have a problem with bonds, bridges and vlans
16:40 \shmgoetze, it doesn't work fine .. believe me
16:40 pav5088mdadm : tool to administrer Linux MD arrays
16:41 pav5088-r
16:41 \shmgoetze, i had several discussions with scott about it...but it looks like he doesn't like server issues, and is only concentrating on desktop
16:41 mgoetze\sh: well, i mean, it works for me (on my laptop)
16:41 mgoetzewhat sorts of problems are you having?
16:42 \shmgoetze, laptops + desktop installs are no problem...using auto eth0 etc. is also not a problem...problem are virtual devices...like bond, vlan, bridges
16:42 \shthere is a timing problem between /etc/init/network-interface.conf and /etc/init/networking
16:43 mgoetzebut is it a problem inherent in upstart or is it just a badly written configuration file?
16:43 \shresult: /etc/init/networking.conf will be triggered sometimes before /etc/init/network-interface.conf and then the whole /e/n/i handling failes, because /var/run/network/ is not avaiable, and ifup needs it
16:43 \shit's a problem between udev, upstart and all this crap
16:44 \shudev -> bus -> upstart -> for hardware , while upstart -> networking.conf -> ifup -a for /e/n/i handling
16:44 \shminus all static hardware interfaces
16:44 mgoetzei don't have any post-8.04 ubuntu systems available so i don't know what's in those files
16:44 \shhttps://bugs.launchpad.net/ubuntu/+source/ifupdown/+bug/446031
16:45 \shthere is a workaround from me...and this actually works for dist-upgrades from jaunty to karmic e.g.
16:47 \shmgoetze, especially when you talk about something like this: http://www.sourcecode.de/content/network-setup-freaks-me-out <- if this fails after dist-upgrade you're fcked ;)
16:47 mgoetzei don't have anything in /var/run/network, what does ubuntu do there?
16:47 \shmgoetze, ifup needs it
16:47 mgoetzejust the directory to exist?
16:47 \shthe directory needs to exist
16:47 \shyes
16:48 \shand /var/run is tmpfs + /etc/init/network-interface.conf will create it normally, but /etc/init/networking.conf does not create it...so when it's executed before the network-interface, ifup -a fails totally,
16:48 mgoetzeso it's just a poorly written configuration file, and not a bug in upstart itself *shrug*
16:49 \shmgoetze, no it's a timing problem in upstart + friends
16:49 \shbonds need hardware interfaces...if they are not added from udev to the userspace, bonds are created without any hardware interface bound on it...
16:49 mgoetzecan you maybe just pastebin network-interface.conf and networking.conf so i can figure out what you're talking about? ;)
Mrfai (~lange@suenner.informatik.uni-koeln.de) left irc: Quit: leaving
16:50 \shmgoetze, http://paste.ubuntu.com/321661/ <- network-interface.conf
16:50 \shhttp://paste.ubuntu.com/321662/ <- networking.conf
16:51 mgoetzethx
ErKa (keryell@wireless-357.sc09.org) joined #fai.
16:53 mgoetzeso net-device-added gets emitted for physical interfaces like eth*, but not for bond*, is that right?
16:53 \shyes
16:53 \shthe net-device-added comes from udev
16:54 \shand it's triggered for every physical NIC you have in your box...so it doesn't even make sense,  to call "ifup -a" somehow in network-interfaces
16:56 mgoetzeso if you were just doing this for one specific configuration, you could replace networking.conf with stuff like bond0.conf, which has "start on (local-filesystems and stopped udevtrigger and net-device-added INTERFACE=eth0 and net-device-added INTERFACE=eth1)
16:56 mgoetze", right?
16:57 \shmgoetze, well, that's what we tested already...this doesn't work ;)
16:58 \shbecause when interface eth0 is added interface eth1 isn't ... so and somehow upstart forgets about old net-device-added interfaces...
16:58 \sh(actually we don't know if upstart just forgets about old net-device-added triggers, but it looks like it)
16:59 mgoetzemaybe the problem is that it's the same event name, just with different variables
17:00 \shany combination we tried, didn't work..but just adding a script inside networking which creates /var/run/network helps..because then the configs for bonds are already loaded... and when the phys. interfaces are coming up, the bond is ready for usage...therefore all depend virt interfaces which are using the bond do come up as well
17:01 mgoetzemaybe it would work if you have a bond0.conf with "start on (local-filesystems and stopped udevtrigger and up-eth0 and up-eth1)", making sure of course to emit those events once the slave interfaces are up
17:02 \shmgoetze, you really don't want to have 2 or three + more job/task configs for vlan interfaces e.g. in upstart...
17:02 mgoetzeyou could autogenerate them via a script ;)
17:03 \shmgoetze, well, upstart should work with /e/n/i
17:03 oz_/e/n/i?
17:03 \sh /etc/network/interfaces
17:03 oz_ah. I wonder why it doesn't
17:04 oz_upstart isn't well tested, hm? ;)
17:04 \shwell, one of scotts great ideas was to just forget about /e/n/i handling and force people to use network-manager on servers ;()
17:04 mgoetzeoz_: we have set our debian alpha tester task force, aka ubuntu users, onto the job :)
17:04 \shoz_, the problem between "desktop" and "server"...people running server are doing nasty things to the OS ;)
17:05 oz_\sh: :)
17:05 \shoz_, the real problem but: scott is desktop and upstart maintainer... and other people are server and don't have a clue how to debug upstart
17:05 \shmgoetze, rotfl
17:06 oz_\sh: :)))
17:06 \sh"how to debug upstart? Add --debug or --verbose to the kernel commandline"
17:06 mgoetzeonce it's good it'll go into beta testing (sidux)
17:06 \sh"check the console and eventually you'll find some things in /var/log/syslog"
17:06 oz_To be honest...I had some ubuntu servers here, but I replaced them all with vanilla debian...
17:06 oz_as I have less hassle with debian.
17:08 \shI always have troubles with linux in general, regarding server and regarding new hardware...but that's distro neutral
17:09 oz_\sh: it's our job, I guess...
17:09 \shyes...but making more troubles because of "we need 10seconds boottime"
17:09 \shis not a good idea
17:09 oz_whut? they switched to upstart to speed up booting?
17:10 \shthat was the only reason to use upstart
17:10 oz_hm. I have a server here with 700days uptime.
17:10 oz_jay. how clueless.
17:10 oz_imho, of course :)
17:10 \shwell, actually I installed karmic on a vmware as server flavour and the boot time was less then 6 seconds ;)
17:11 mgoetzei personally believe there are other, and better, reasons for using upstart ;)
17:11 \sh(no more services installed only openssh-server that was)
17:11 \shmgoetze, which ones? apache2 will always wait for network
17:11 \shmgoetze, while an Xserver can run with lo configured + mounted fs
17:11 mgoetzeupstart is better at things like respawning daemons...
17:13 \shmgoetze, hmm...we had this already...was named daemontools, or?
17:13 mgoetzedid that ever make it into the debian archives? i believe there were some freeness issues :)
17:13 \shand came from d.j. bernstein ;) qmail was also much better then sendmail and postfix or exim these days
17:13 oz_jay, daemontools
17:14 oz_$collegue installed it, and the apache could not be stopped anymore :)
17:14 mgoetzeanyway i think combining functionality of init + daemontools makes a lot of sense
17:14 \shmgoetze, hehe...there was an issue with the license, yes
17:14 \shmgoetze, but it worked like a charm...
17:15 \shhttp://blog.blinkenlights.nl/2006/10/29/daemontools-with-upstart/
17:17 \shhttps://bugs.launchpad.net/ubuntu/+source/daemontools/+bug/253465 and this is a really nice one...check the dups
17:23 \shok going home for today...
17:23 \shcu
tokkee_ (tokkee@osprey.tokkee.org) joined #fai.
tokkee_ (tokkee@osprey.tokkee.org) left irc:
ErKa (keryell@wireless-357.sc09.org) left irc: Ping timeout: 480 seconds
amgarchIn9 (~amgarchin@p4FF01909.dip0.t-ipconnect.de) joined #fai.
20:39 ghislain\sh: qmail better, you must be kidding
siggg (~jean@tra78-5-88-172-128-32.fbx.proxad.net) left irc: Ping timeout: 480 seconds
siggg (~jean@tra78-5-88-172-128-32.fbx.proxad.net) joined #fai.
21:38 mikapmgoetze: http://faiwiki.informatik.uni-koeln.de/index.php/Grml_Kernel -> nice, thanks :) JFYI: kernel 2.6.31-grml[64] are available nowadays as well, maybe someone could mention that in the wiki?
siggg (~jean@tra78-5-88-172-128-32.fbx.proxad.net) left irc: Ping timeout: 480 seconds
21:54 mgoetzemikap: done :)
21:55 mikapmgoetze: thanks! :)
22:05 mikapmgoetze: i'll send a note regarding this issue through our grml microblogging channel, want to "proof read" it?
22:05 mikap"Did you know, that you can use #FAI (Fully Automatic Installation) with the #Grml kernel? http://bit.ly/1RSty4"
22:06 mikap-> last chance for any modifications ;)
22:06 mgoetzesure :)
22:07 mikapmgoetze: so ok? then i'll send it ;)
ErKa (keryell@wireless-357.sc09.org) joined #fai.
22:11 mikapmgoetze: http://twitter.com/grmlproject/status/5838877600 && http://identi.ca/notice/15042193
22:45 mgoetzeso, gute nacht
allee-k (~allee-k@dslb-188-099-217-195.pools.arcor-ip.net) joined #fai.
ErKa (keryell@wireless-357.sc09.org) left irc: Ping timeout: 480 seconds
allee-k_ (~allee-k@dslb-188-099-217-195.pools.arcor-ip.net) joined #fai.
allee-k (~allee-k@dslb-188-099-217-195.pools.arcor-ip.net) left irc: Read error: Connection reset by peer
allee-k_ (~allee-k@dslb-188-099-217-195.pools.arcor-ip.net) left irc: Ping timeout: 480 seconds
ErKa (keryell@wireless-357.sc09.org) joined #fai.
--- Thu Nov 19 2009

Generated by irclog2html.pl 2.1_h01ger1 by Jeff Waugh - find it at freshmeat.net! Customized by Holger 'h01ger' Levsen