Toggle object between server and client

I am making a game with UNET that has only two devices (two players). There will be one gameObject that both the players will interact, which will be present in either server side (player 1) or client side (player 2) at any point of time. I don't want both the devices to spawn the gameObject.

How can I toggle the visibility of the gameObject in client, if a bool is true? Please help, it is quite urgent. The bool is a SyncVar

Toggle object between server and client