Archive for the ‘interesting stuff’ Category

Visualization of Social Network

Sunday, January 21st, 2007

Update: I created a tool to convert CSV files to Walrus compatible LibSea files. Check out walruscvs here You can find additional social network visualizations here.

For a long time now I have been a great admirer of Matthew Hurst’s work and I’m continuously impressed by the works posted at visualcomplexity.com. So I decided it was time for me to try something like this myself.

Visualization of large Social Network

What I did is write a program that is able to log in to a very popular German Social Networking website and grab some data from it. I grabbed the friends of my profile (only 2) their friends (about 100) and the friends of their friends (about 5000). I used PHP with cURL for that and saved the data to a MySQL database.

Visualization of large Social Network

Then I looked for tools to visualize the data. Turns out it’s quite hard to find something suitable. Here’s an (incomplete) list of tools one can choose from. Ultimately I ended up using Pajek and Walrus.

The results I got from Pajek were a bit disappointing as the network creation algorithm does not seem to work that well on very large (>5000) nodes and it is unable to render images that emphasize a 3D feeling (so no eye candy):

Chaotic Visualization of large Social Network

However I was able to create two videos of the networks I rendered. Check out video1 here, a visualization of a very small network, and video2, which shows the entire network.

The results I got with Walrus where definitely better. It was quite complicated to get Walrus to accept my data as it heavily relies on a spanning tree, but I managed to get it to work:

Visualization of large Social Network with Walrus Visualization of large Social Network with Walrus

I also was able to create a video of the network I rendered with Walrus, check it out here.

My work of course is not as sophisticated as the items mentioned at the beginning but I still like some of my graphs.

Google – the data octopus

Sunday, January 14th, 2007

Google - the data octopus

Although this post shall be mainly about Google, I will start with another example: Amazon. If you bought a few times at Amazon, you will notice something when you visit their website. They give you recommendations on what to buy next. And most of the time this recommendations are pretty good, most of the time you would really like to own one of the products they recommend.

And probably everyone nowadays knows how they do it. They track everything a user does, from simple browsing, over searches to purchases and put together a profile of each customer or visitor. They compile a really huge database out of this pieces of information. And then they link this pieces together. The process is called “Data Mining“.

An Example: with the help of fancy algorithms and statistical analysis techniques they discover: 100 people bought the latest album by “The Killers”. 15% of those people also bought the latest album by “The Strokes”. So they reason if you bought the latest Storkes album you might also be interested in the Killers album.

This is of course only a very simple example as it only includes 2 features. Considering how many visitors, purchases and products Amazon has.. well. The data they have at their disposal should be quite good. By now they have probably a profile of every single one of us. Although you never bought anything at Amazon, your profile might just be in their database. Humans are not so different.

And what about Google? Do they create profiles of their users too? Hell yes. And the data they can gather from their users might be even better. Here’s a (incomplete) list of services Google offers and my ideas of what data they could gather from that.

  • Search:
    They analyse the keywords you type in, the search results you click and the sponsored links (ads) you click upon. They get a really huge profile of your search habits if you use the Personalized Search Service. Also if you have a personalized homepage all keywords may be tracked back to you.
  • Gmail:
    Obviously: they scan your e-mails for keywords to put together ads. They can get a pretty good idea of what you’re interested in and of what you’re doing by reading your e-mail.
  • Personalized Homepage:
    They know what gadgets you include in your personalized homepage. This also gives them a pointer on what you are interested in. Are you a software developer, politically interested, interested in finances, are you a democrat or a conservative? They may find that out.
  • Google Reader:
    They know: what feeds you like, how regularly you read the feeds, what feeds you read most, how much time you spend reading newsfeeds. And they make no secret of it: Check out this article from their blog.
  • Google Talk:
    That in conjunction with Gmail is their greatest source for social information. They know who you’re friends with! They also know how much time you spend in front of your computer.
  • Google Groups and Blogger:
    They know what topics you’re interested in in terms of newsgroup discussions or blog comments (if the blog you comment on is hosted by Blogger).

Now don’t get me wrong. I’m not a fanatic Google hater. As a matter of fact I use some of the mentioned products myself (including Gmail which is probably the worst in terms of privacy) however I think it’s important for people to be aware of what can be done with their data. And yes, I’m aware of the irony that this blog is powered by Blogger.

New Input Devices

Thursday, December 28th, 2006

As news about the new Nintento Wii and especially the Wii remote resound through the land I decided it is time to put together a roundup of fancy input devices available or in development.

Wii_Remote_Image

The first one to mention would be of course the Ninento Wii remote. It allows the user to interact with the console by means of phyisical gestures. So you can play baseball and literally be the batter or play golf and actually stroke the ball (or at least pretend to do so with the remote in your hand). This video explains the Wii remote’s concept. And here’s another very funny (and sexy) Wii comercial that disses the PS3 quite badly.
And somebody already hacked the Wii remote and is now able to control his Roomba. Check it out.

Furthermore, three researchers at Microsoft “have created an innovative handheld pointing device that works in mid-air” called Soap. There’s a video on how it works and how a Soap can be built here.

Researchers from Switzerland, Italy, Germany, France and the UK have developed a system that makes surfaces of any kind interactive with the help of acoustic sensors. For more information check out this article and the demonstration video.

pic_braingatepipeline1
The most intriguing concept however is a direct connection between computer and brain. There exists a very good wikipedia article about that topic. Of course ethical questions are to consider when those devices are not only used for treating disabilities but to enhance human function. Tough but very interesting topic.

Free Music

Tuesday, December 19th, 2006

A Free Music page was added to the echelon blog. It’s a site to satisfy my need for posting songs I personally like very much to the blog.
All songs so far are from the Bavarian Open Source website. A very cool page where one can download songs from many known and unknown bands. Among the known being “Adam Green”, “The Kaiser Chiefs”, “Mediengruppe Telekomander” and “Deichkind”. Among the unknown being for example “Miwon” and “Lagoon”. It’s a very cool page and a very cool idea. They also have a Top20 list.

On another note, the complete Mozart works are now freely available on the Internet. The International Mozart Foundation apparently “aquired the right to publish the prestigious New Mozart Edition of every Mozart work” (from slashdot). Cool!

Defcon – Everybody Dies

Saturday, December 2nd, 2006

A Telepolis article “Atomkrieg am Bildschirm” recently introduced the game Defcon by Introversion Software. It’s “the worlds first Genocide ’em up”. I played the demo and liked it very much.

defcon_1

It’s a strategy game where up to 6 players try to kill each other by means of nuclear weapons. To do this they may plant nuclear silos, radar stations, airports and fleets on a minimalistic but aesthetic world map. They can move their fleets, launch fighters and bombers and after some time of dancing arround each other, players may launch vast amounts of nuclear missiles to blow the opponents back to the stone age. The player killing the most enemy people wins. Fun! A picutre of the nuclear exchange:

defcon_2

A fully playable demo is available (50MB) and the full version can be obtained for only 14EUR. All strategy fans and genocide lovers should really check it out.

Fusion – Inertial Electrostatic Confinement

Tuesday, November 21st, 2006

“What’s that?” you might ask. Well I did not know either a few days ago. Basically it’s a method to produce fusion.
And what exactly is fusion anyway? Well it’s the oposite of fission: “Nuclear fusion is the process by which multiple nuclei join together to form a heavier nucleus.” And why is this so interesting? “It is accompanied by the release or absorption of energy depending on the masses of the nuclei involved.” (from Wikipedia: Nuclear Fusion) That’s why! (more…)

Old and homebrew CPUs

Wednesday, November 15th, 2006

Slashdot recently had an item about Intel’s release of schematics for its 4004 microprocessor. From the article:

“Intel is celebrating the 35th anniversary of the Intel 4004, their very first microprocessor, by releasing the chip’s schematics, maskworks, and users manual. This historic revelation was championed by Tim McNerney, who designed the Intel Museum’s newest interactive exhibit. Opening on November 15th, the exhibit will feature a fully functional, 130x scale replica of the 4004 microprocessor running the very first software written for the 4004.”

(more…)

Plotting measured data with gnuplot

Wednesday, November 8th, 2006

In conjunction with a physics lecture I am attending this semester a fellow student and I had to create a measurement report of an experiment we did. Working on that report I realized that I had never before felt the need for plotting measured data with a computer. Therefore I naturally did not know what freely available tool could help me with that task. Another fellow student then pointet out gnuplot to me and I gave it a try. And what can I say. I was able to create the desired plot very fast and it was pretty too.

About gnuplot:
Gnuplot is a portable command-line driven interactive data and function plotting utility for UNIX, IBM OS/2, MS Windows, DOS, Macintosh, VMS, Atari and many other platforms.”

One of our final results looked like this:
tiefpass
This illustrates of course only the very basic features of the tool. It’s much more powerfull than our example shows.

Some usefull commands I used to customize the plot:
As I wanted a double logarithmic scale I typed
set logscale xy
I also wanted to see the scale in my plot so I typed
set grid xtics mxtics ytics mytics
I set the lables of the axes with
set xlabel “x name” and set ylabel “y name”
(btw this labeling can also be enhanced with LaTeX style formula expressions)
and I defined the axes’ ranges with
set xrange [1:100] and set yrange [1:100]
the smoothing (interpolation) of the curve can be accomplished by specifying
smooth csplines or smooth bezier
within the plot command.

Med Videos

Thursday, November 2nd, 2006

I am tracking popular Med Blogs for some time now (my favourite being medgadget.com) and came accross several cool videos which I think everyone should take a look at.

First there’s a video that shows the da Vinci Robot Surgery System in action. Very impressive and interesting indeed (and also a bit disgusting).

The second and third videos are clips from a british documentary on autistic savants. (more…)

Rip MP3s off Youtube

Monday, October 23rd, 2006

Ok, this is probably very very old news for the people out there but I’ll describe what I discovered today anyway. Here’s the deal: I heard one song the last two days on the radio which I liked very much. It’s “Gabriel Rios – Broad Daylight” if you must know. I wanted to have that song on my mp3 player so what I basically did is pirate it. From YouTube!

(more…)