I think you're overthinking but yes, once you stop focusing on what you don't want, you stop giving it power right now it's like it has control over you. You give power to your desire when you are happy and positive about your desire. Think of your desire as a rose (or your favorite flower) and your fears as weeds in the ground, are you going to water your beautiful flower or water the weeds in the cement?