If it's an Android phone, open your App drawer and select "Downloads". Check the one that's downloading and delete it. That should stop it. Otherwise you can go into Settings > Apps > Switch to the "All" Tab (scroll to the left or right) > Locate Downloads and Download Manager > Disable them, Clear Cache, and Clear Data (if possible).