When talking about a general direction, the word is often not capitalised, example: the north side of the house.
Place names are capitalised: East Sussex, West Virginia, South Africa.
In other cases, adjectives and nouns normally begin with small letters: Go south for three miles, then go east for another three miles. There is a cold north wind.