Archive for category fun with Linux
Linux: Reiser4 patches
Posted by JohannesTheDeveloper in fun with Linux on November 29th, 2009
I’ve submitted some patches for reiser4 that make it compile again with the latest git version of the Linux kernel. They can be found here: http://thread.gmane.org/gmane.linux.kernel/919967. We’ll see if they get picked up by -mm. They were.
Compiling the Linux kernel for faster boot times
Posted by JohannesTheDeveloper in fun with Linux on September 21st, 2009
In this blog entry, I try to investigate easy methods to get a “faster” kernel.
Measure
The time of five events are measured:
- [1] (printk timing) A very early kernel message, “ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.AGP_._PRT]”
This message is buffered until syslog starts, so its date information in /var/log/messages can not be used. The following event allows a conversion between the two timings. - [2] (printk timing and date from syslog) The first message when the kernel executes userland: “Adding 2047888k swap on /dev/hda5″
- [3] (date from syslog) first userland daemon message: “acpid: starting up with proc fs”
- [4] (date from syslog) first X program message: (seahorse makes a call to gpgme)
- [5] (date) a program run by the GNOME session messenger stores the output of date +%S.
make clean was performed before each recompile.
System
Gentoo Linux, 64bit, 2.6.30-gentoo-r4 kernel, quite normal End-user system with the GNOME Desktop. HP Pavilion dv8000 single-cpu 2GHz, 1GB RAM.
Optimizing with -O3, -O2 or -Os?
People from Gentoo, GCC, the LKML and many others will tell you that using -O3 is not a good idea. Furthermore, O3 it is known to make the kernel instable.
So let’s try it anyway, and for the fun of it, add -march=native after -m64. We also allow GCC to uninline functions marked as inline.
sed: Remove lines that match a pattern
Posted by JohannesTheDeveloper in fun with Linux on June 27th, 2009
sed '/mypattern/d' file
Deletes all lines that contain the regular expression “mypattern”.
In-place replacement:
sed --in-place '/mypattern/d' file1
sed also supports making backups with e.g. –in-place=.backup .
Shutdown when idle
Posted by JohannesTheDeveloper in fun with Linux on June 20th, 2009
Maybe you want the computer to shutdown after it has done its task. This shuts down your Linux box when the load goes down to zero. Kind of like the “Speed” movies.
while ! cat /proc/loadavg |cut -f2 -d ' '|grep '0\.00'; do sleep 10m; done && poweroff
Alternatively:
while ps 12345; do sleep 10m; done && poweroff
Bash: Chain of commands
Posted by JohannesTheDeveloper in fun with Linux on April 25th, 2009
I wondered more than once how to make a tool that chains together input/output filters using bash.
e.g. you would like to do a iteration of filters:
for i in 1 2 3 4; do grep -v $i; done
So I wrote this chaining tool that does the job in the obvious way:
chain.sh
#!/bin/bash
commands_file=$1
a=$(mktemp)
b=$(mktemp)
cat > $a
while read line; do
$line < $a > $b
mv $b $a
done < $commands_file
cat $a
rm $a
With this, you can do:
for i in 1 2 3 4; do
echo grep -v $i >> mycommands.txt
done
script/chain.sh mycommands.txt
lang=”bash”
Add collaborator to GitHub repository
Posted by JohannesTheDeveloper in fun with Linux on March 6th, 2009
Don’t let them clone the public url: It doesn’t go over ssh and I don’t know how to change the origin url in a branch. *
Steps:
- create ssh-key on new collaborators computer (ssh-keygen)
- create github user
- add public-key to github user account
- let the project owner add you as project member
- git clone git@…
Where 1 < 3, 1 < 2 < 4, 2 < 5 if that means anything to you ;-)
* it works with git remote
Skype in Pidgin
Posted by JohannesTheDeveloper in fun with Linux on February 17th, 2009
To compile it under 64bit Linux, do
$ svn checkout http:// skype4pidgin.googlecode.com/svn/trunk/ skype4pidgin-read-only
$ cd skype4pidgin-read-only
$ make all
$ sudo make install
Restart pidgin. You get 2 additional account types: Skype and Skype (DBUS).
I don’t understand why the author is flamed for not making a independent protocol implementation that doesn’t need Skype running. It is Skype that prohibits that.
Maven: Colorized
Posted by JohannesTheDeveloper in fun with Linux on January 7th, 2009
Maven was written by people who obviously have no idea on how to create good tui (Text User Interface)-tools. They should sit together with the portage, git or other Linux-devs.
The output is unreadable (not to mention that the startup is slow).
So, what I did was wrap maven in a script that colorizes the output. The result looks like this:

This is how to do it:
create the file ~/bin/mvn with the following content (mvn (0 KB))
#!/bin/bash
/usr/bin/mvn $* | sed -e 's/Tests run: \([^,]*\), Failures: \([^,]*\), Errors: \([^,]*\), Skipped: \([^,]*\)/[1;32mTests run: \1[0m, Failures: [1;31m\2[0m, Errors: [1;33m\3[0m, Skipped: [1;34m\4[0m/g' \
-e 's/\(\[WARN\].*\)/[1;33m\1[0m/g' \
-e 's/\(\[INFO\].*\)/[1;34m\1[0m/g' \
-e 's/\(\[ERROR\].*\)/[1;31m\1[0m/g'
replace /usr/bin/mvn with wherever your mvn is (find out with which mvn).
Double-check that you get the encoding right, the weird sign should be hexadecimal 1b. Use a editor that supports encodings for copy+paste.
Give your ~/bin/mvn execute permissions (chmod +x ~/bin/mvn)
Try it out: call ~/bin/mvn in one of your maven projects
What is left to do is to register your new mvn-wrapper so it is called everytime.
Add the following line to your ~/.bashrc :
alias mvn=~/bin/mvn
Execute the command you just added in your running shells so you can use it there too.
You are done.
Changing the distributed mvn startup script
Even better, but a little more intrusive (you need root rights):
change the distributed mvn file. It is a bash script actually.
In gentoo:
$ which mvn
/usr/bin/mvn
$ file /usr/bin/mvn
/usr/bin/mvn: symbolic link to `/usr/share/maven-bin-2.0/bin/mvn'
$ file /usr/share/maven-bin-2.0/bin/mvn
/usr/share/maven-bin-2.0/bin/mvn: Bourne shell script text executable
$
Change the last call in that file to:
exec "$JAVACMD" \
$MAVEN_OPTS \
-classpath "${M2_HOME}"/boot/classworlds-*.jar \
"-Dclassworlds.conf=${M2_HOME}/bin/m2.conf" \
"-Dmaven.home=${M2_HOME}" \
${CLASSWORLDS_LAUNCHER} $QUOTED_ARGS |
sed -e 's/Tests run: \([^,]*\), Failures: \([^,]*\), Errors: \([^,]*\), Skipped: \([^,]*\)/[1;32mTests run: \1[0m, Failures: [1;31m\2[0m, Errors: [1;33m\3[0m, Skipped: [1;34m\4[0m/g' \
-e 's/\(\[WARN\].*\)/[1;33m\1[0m/g' \
-e 's/\(\[INFO\].*\)/[1;34m\1[0m/g' \
-e 's/\(\[ERROR\].*\)/[1;31m\1[0m/g'
That way you have it there directly. Maybe the gentoo devs could add a color use-flag. That’d be fun…
Bash: Timeouts
Posted by JohannesTheDeveloper in fun with Linux on January 7th, 2009
You have a command and want to kill it after a certain time if it hasn’t finished.
This script does it for you:
timeoutwrapper.sh
#!/bin/bash
# License: BSD License
# author: Ram
# author: Johannes Buchner
TIMEOUT=$1
shift
COMMAND="$*"
if [[ "$TIMEOUT" == "" ]] || [[ "$COMMAND" == "" ]]; then
echo "USAGE: $0 <seconds to wait> <command with arguments>"
exit
fi
$COMMAND &
PRODPID=$!
export PRODPID
# record own PID
export PID=$$
# define exit function
exit_timeout() {
echo "Timeout. Checking for unfinished."
for i in ${PRODPID} ; do
ps -p $i |grep -v "PID TTY"
if [ $? == 0 ] ; then
# process still alive
echo "Sending SIGTERM to process $i"
kill $i
fi
done
# timeout exit
exit
}
# Handler for signal USR1 for the timer
trap exit_timeout SIGUSR1
# starting timer in subshell. It sends a SIGUSR1 to the father if it timeouts.
export TIMEOUT
(sleep $TIMEOUT ; kill -SIGUSR1 $PID) &
# record PID of timer
TPID=$!
# wait for all production processes to finish
wait ${PRODPID}
# Normal exit
echo "All processes ended normal"
# kill timer
kill $TPID
Usage examples:
$ bash timeoutwrapper.sh
USAGE: timeoutwrapper.sh <seconds to wait> <command with arguments>
$ bash timeoutwrapper.sh 1 sleep 3
Timeout. Checking for unfinished.
26612 pts/3 00:00:00 sleep
Sending SIGTERM to process 26612
$ bash timeoutwrapper.sh 4 sleep 3
All processes ended normal
$ bash timeoutwrapper.sh 2 du -sh .
Timeout. Checking for unfinished.
26622 pts/3 00:00:00 du
Sending SIGTERM to process 26622
$
PS: I found the script here and adopted it
http://redflo.de/tiki-index.php?page=Bash+script+with+timeout+function
SSH -R is even cooler than -L
Posted by JohannesTheDeveloper in fun with Linux on January 5th, 2009
To be honest with you, I thought for three years now that the -L option of ssh is a cool thing. It connects to the ssh server and offers a remote service (port) locally. Call it port tunnelling. Great against firewalls.
Anyway, consider you have a ssh server in the internet, and two computers behind different firewalls that only let traffic out. But you want to connect from computer A to computer B.
So you could connect to the ssh server from both computers, but you would need some software that reverses your TCP flow. One of the channels has to be the client and one the server. That might even be possible just using pipes and ssh -L.
Ok, so I thought I was clever until I found the -R option.
What it does is to connects to the ssh server and offers a local service (port) remotely. (-L offers a remote service (port) locally.)
Consequent. And works nicely too!
Recent Comments