when you ignore, the person will leave your side, so he/she will be back at usual 'hangout' place, if the companion of course at the companion side, if your housecarl, will be at your house or at jarl place if you have no home.
I once forget where I ask my follower to wait, and finally message...