The vote was held past midnight after opposition parties brought a motion against him, following days of drama.
The motion was first brought against Mr Khan last week, but he blocked it by dissolving parliament.
Sunday’s vote took place after the country’s Supreme Court ruled in favour of opposition parties and said that Mr Khan had acted unconstitutionally.
Mr Khan is now the first Pakistani prime minister to be ousted by a no-confidence vote.