I am trying to connect my bluetooth controller for my smartphone. It seems that after connecting it for a couple mins, it would disconnect me to the WIFI and I have to restart my router again just for my phone to connect.
Im using a Vivo y53 phone
That isn't uncommon. Some phones don't like using both WiFi and Bluetooth at the same time. A way around it is to use data instead.
Also, it may not be the phone. It could be your WiFi connection (your ISP) I would consider checking the connection for any problems. Speed drops, etc. While some devices don't notice those right away, others do. And a need to restart the modem/router to make it work doesn't sound like the phone is the problem. It could even be your modem/router, but start with testing the connection.