If you could answer those calls then it is possible that the hacker would know all of your phone's activity. I'm not sure if rebooting your device would be helpful, but you could change a device and make sure to use a more trusted network next time in order to be safe in your browsing. I use vpn. Its easy and understandable. Just try it.