Yes, when Afterburner is closed, your GPU auto fan settings will take over.
Just tick the box in the AB menu to start with windows and start minimised, that way it runs at startup, applies your overclock and fan curve, but just sits quietly idling on your taskbar if you need to open it for...