Just to add to above information,
What is interesting is it works from the browser, not from load runner.
Even after we log off and back into to the Windows RDP?
We are load balancing on ssl session id, not on source ip.
So each new browser session should get a new ssl session id, going to trace it in a tcpdump.
So it seems at some point it stops reusing the ssl session id.