Ive been here before, its so tempting, but with an answer like that, I think it's best not to try reaching out again, let him come to you.
BUT, dont get down in negativity-think on the positive side-He answered, and that's something better than nothing and its progress!
Im sure this is a sign that the manifesting is working, but its not quite here yet, and the universe needs a bit more time!
Im sorry if this isnt helpful, but Im sending good vibrations and energy your way and wish you all the best for manifesting him back