I know what you mean about the latency delay sometimes in a computer recording situation. I have the same problem and have to turn off the earphone pass through because there was some serious delay in the setup I had.
Meanwhile, using a standard analog mixerboard with headphone monitoring and mic inputs introduces absolutely no delay whatsoever. Voice just instantly shows up in the headphones. So - look into a DJ mixer board of decent quality (it's pretty affordable if you shop around).