From the sounds of it, the language has been set to United Kingdom during the installation process.
All that you'll need to do is open your settings and set the language to English (United States), then remove the former one.
This can be done either by using Cortana - search for 'region and...