Go-redis client latency

Hi,
I have a machine with 4 cores running a service in go, which sends only 1 request to redis. When I reduce the amount of cores, the latency of the request to redis gets worse. Any idea?