According to the Oxford English Dictionary, it's derived from the obsolete adjective "pink" meaning small, which goes back to the 16th century. It is not in any way related or connected to the color...
'To index' is to point out or to show something, so the finger with which you point out or show something is called the index finger, or just another way of calling it is the pointer finger.