Here's the reddit thread for you question. It seems that not all adapters are created equal, and the thread has suggestions about what ones will work. Have a look
http://www.reddit.com/r/Chromecast/comments/1lpjgw/using_chromecast_without_hdmi_input/