Is it because the batteries are only 1.2V? It works fine with Duracell alkaline batteries.
Most likely, the manual states you should use 1.5V ones.
There's also a review on lego.com that states there may be a problem with the battery terminals with some makes of batteries. Worth checking.