UNET Would be nice to be able to "switch" authority from one client to another

I'm using spawnwithAuthority to give players the ability to drive vehicles smoothly but I'd also like to switch them out... the only way I can see doing that now is to spawn a new vehicle when the player "gets in" (touches its trigger collider) and despawning it when he gets out, and replacing it with a server controlled one... then when the other player touches it, spawnwithAuthority replace it with that one.

Am I making any sense?