He'd already said, "I need to see if I got time." So the ball was in his court. Your job was done at that point; no need to do anything except wait.
Also, as a general guideline, you're never "supposed" to say anything. So get that out of your head. Imagine if you were Chad. Would you ever feel that you were "supposed" to say something? Of course not. That's a cuck idea that there are "hard and fast rules" or "proper etiquette."
Now you're obviously not Chad, which means you've got to create a stronger illusion because people won't buy into your bluff if they don't think you have anything to actually back it up with. But this shouldn't be a problem for you as long as you're patient. People will test your patience. They're just doing this to make sure you're legit not a desperate cuck. They might blow you off, not respond, whatever. But again, you've got to not be bothered when this happens or you'll permanently signal to them that you're needy.