In my experience tutoring (I mainly specialised in tutoring below average students), a lot of people fail to fulfil their true potential in maths largely because of its nature and how it is taught. A lot of students really dont have the discipline and drive to really reach that potential...