I personally find it hard (mainly just the calculations >.<), but only because I don't really enjoy it.
There is a vast majority of my class who loves physics and therefore put in the time and effort it requires. If you're interested in the subject, you should definitely pick it, it does have...