It's New York State. You will see the word "state" in "New York State" uncapitalized all the time, even in newspapers and magazines, which presumably should know better. But that is wrong. People...
New York State borders 5 states and they include; Pennsylvania, New Jersey, Connecticut, Massachusetts, and Vermont. New York State also borders 2 Canadian Provinces, they include Ontario and Quebec.