At OP: not really, i do all 3 sciences and am going relatively well at physics and very good at chemistry and biology.
Although i do find unlike Biology and Chemistry i find Physics isn't really a 'straight forward' science so to say, you can't just learn it by reading it, like maths you have...