All primates share a better sense of sight than of smell, eyes at the front of the head, (giving an overlapping field of view and better depth perception), great hands for manipulating small objects, among other traits.
I reckon that in some ways, you can only be as intelligent as your limits will let you be. I.e. You won't be selected to survive ("be intelligent") if you live in a nice, safe, boring box, with nothing around to improve or detriment your lot.
It also depends on what kind of intelligence is helpful in the situation -
Steve Grand, who developed Creatures, a very detailed artificial life simulation reckoned that:
"There's much more to intelligence than logic. Most of the AI pioneers were mathematical magicians and philosophers and to them, thinking was about logic, about reason. But it has to grow out of more primitive systems, and most intelligence is not logical. Most of the time we are not reasoning people. Dogs tend not to argue about syllogisms, but they still seem bright. Chuck IBM's Deep Blue chess computer and a dog into a pond, and see which one climbs out first. Which means that intelligence is grounded in survival. If you haven't got a reason to think, you won't think, and survival is what motivates us."
If it's purely size that you're interested in, then your answer is probably somewhere in nutrition, and the methods that we employed to get that nutrition. If you're searching for a more holistic approach, 'what makes us human?' then it can never fully be answered here. You could try your university's library for books/journal articles on human evolution, for a start.
More generally speaking; according to my biology lecturer last session, the 'hidden' menstrual cycle was a big part of human evolutionary success, because babies can be born all year round. More babies = more chance that some will survive to reproductive age. Also, the long gestational period has some significance.
Also, the development of agriculture 10,000 years ago or so was a biggie. More convienient and larger food supply meant that the ones who thought it up got the food. Give a man a fish, he is fed for a day.. etc.