What kind of camera? Shooting inside or outside? How far away are your subject and what kind of background?
I suspect though, that you're not actually shooting full manual, you just think you are because you have it set on "M". If I had to hazard a guess without any information on your camera, I...