How do I ask someone to leave my house in a polite way?

This happened to me recently. A friend was at my place and he forgot his wristwatch, he alerted me few days later that his friend would help get it. I was to step out and give the watch to his friend, to my surprise when I got outside my apartment, there was my friend standing. I wasn’t expecting anyone that day plus I wasn’t in a great mood. He entered, gave him his watch. I expected him to leave, he did not. I was so uncomfortable, and the last thing I’d allow anyone do to me isn’t make me uncomfortable in my own house. He even ordered a takeout from a nearby restaurant. I couldn’t take it anymore, I had to text a friend of mine to fake a call and act like we had a place to be urgently. That was what saved me, he had no choice than to leave even without asking him to.