If you're interested in comparing 3D graphics performance on smartphones, you could compare the 3D Mark scores of the phones you're thinking of buying. Should be a good representation of (3D) game performance.
Haven't heard of an app measuring CPU/GPU usage on Android/iOS so far, so I doubt you'll find something that can do that.