I don't know why but for some reason this did not come to my mind. LOL
Its a bit embarassing really because I work with Java every day and memory reference is a core feature. But I think the SocketSet buzzed my brain making me think that it gave me different objects or something. But anyway, lets forget this mumbo jumbo question.
I have updated my https://github.com/jarlah/d2-simple-socket-server with stateful overridable socket handlers, and to make it able to quickly setup the server I added a default one.
So, I think my brain is straight again now. Just got a bit messed up by the api.
