Well, it depends on what you are looking to run in VR. If you are talking about games like Fallout VR or other high end titles with lots of effects, maybe not, but there are plenty of games for VR that don't require all that power. You could easily play games like Beat Saber, Fruit Ninja VR, and maybe even Holopoint.
You might have an ideal use case here for a WMR headset too as they require less powerful hardware to drive. You could easily run some of the more simple games.
Then you'd have a VR headset for when you are ready to upgrade and if you drop in something like a Ryzen 5 and a GTX 1060 you'd be able to play just about anything.
I use a WMR headset on my desktop (i5 4590S, RX 470) and laptop (i7 7700HQ, GTX 1060), and I'm at the lower end of being able to run really high end VR experiences. I can play anything, but sometimes things stutter a little. However, there are games like I mentioned above that run great for me, and VR movies and such run on the basic WMR tier which is an Intel 600 series GPU, so there will be things that your system can play.