Assuming you mean New York City, by traveling west. You have a choice of trains, bridges and tunnels. From Rockland County one travels south.
They share a common border.
60.55 kilometres (37.62 miles)
New Jersey is a state, not inside of New York.
No Albany is the capital of New York. New Jersey is a state that borders New York.