Avoid connection-per-RPC-call again by caching connections