So I think I now am number one when it comes to having the best internet speed :D
This is when using my 2.4Ghz speed:
http://www.speedtest.net/result/4586610763.png
This is when using my 5Ghz speed:
http://www.speedtest.net/result/4586617131.png
So I managed to fix most of my connection 'loss', but as you notice, my 5Ghz ain't that much better than my 2.4Ghz.
I guess I'll need to have a look on the layout of my house so I can determine a better location for the router :p
But hey, it's a beginning :D If everything would be working 100% I should be able to reach speeds up to 100-120 Mb/s when downloading and when uploading around 25 Mb/s ^^