Did I scare him away?

He probably thinks that he's going to end up a rebound. You are still on the phone fighting with with your ex. Yes, you probably scared him off. Shame on you for answering that phone.