If you are uninterested in physics then go ahead and drop it. Sure, you may be ranked first, but if you don't enjoy the subject then it will be a pain to study for it in yr 12.
For me personally, I dropped engineering in year 11 even though I was ranked 4/80 ish because I found engineering to...