UNet client response is too slow

I'm testing my game with 2 local instances of game

Client joins server using unity providing matchmaker.

The problem is, when server sends any network packets to client (using SyncVar, NetworkMessages, ClientRPC. i tested them all), it takes almost more than 100ms for packet to arrive client.
and it's too long time for my game because it's realtime multiplayer game.

Is the packet goes through some kind of unity master server to find client?

I don't know why it takes too long time even...

UNet client response is too slow