It was originally called New Amsterdam which came from the Dutch in 1433. I may not have the year right, that is just a guess on my part! I hope this helps you out!
It's not far from New York City, but it is part of the state of Connecticut, not the state of New York. So, technically, no, it's not a suburb of New York City, but for practical purposes, yes it is....