Yeah, USB can't keep up with outlet, especially as it gets more charged and you need more of a voltage difference to push in juice.
In my test I did for my blog they both got to about 80% charge in 60 mins, but after that the USB took another 80 mins to finish compared to 30 mins for the wall.
iPhone 3g USB vs outlet charging…take two | When Will Apple?