Why Does Conan O'brien Wish Nobody Knew He Went To Harvard?

Conan O'Brien says if he could change one thing, it would be that nobody knew where he went to college. He doesn't think his sense of humor comes from there, but people would write him off as "the Harvard guy." As he puts it, it's not Hogwarts or a magical place, just a school where he met some really smart people and some pretty dumb ones.