Answer:
I'd say the best way to make this happen would be to work your way through to some friends who are friends with him. I had quite the same situation, but my groups of friends is kind of joined to another social subgroup who were friends with him, so every now and then I'd hang out with them a bit more and then when he was around I had a reason to be too.
If you don't have any friends who are friends with him, then make some. This may sound difficult, but by talking to people in the hallways or while sitting next to them in class, you'll be surprised how many friends (or at least friendly acquaintances) you'll make who will be more than happy to get you with him.
Good luck.