It depends on your modem/router and also your speed. Is it always the same device that can't access it? Or is it say always the last device that logs on that can't?
Also, have you made sure that it is password protected? If it isn't, or if you haven't changed it in a while, it is completely possible that someone else is using the connection.