I say let him stay and just ignore him. His votes aren't the problem anyway, just his behavior. And that is solved by ignoring him.
Going the route of legislation to remove him from office is a very dangerous precedent, that could have unintended consequences both now and in the future.
More information about formatting options