If by casually you mean exceedingly unprepared, unpolished, knowing few details... then I agree.
If by casually you mean down to earth and laid back then I strongly disagree, especially when firms have multiple interview stages, i.e. a manager interview, subsequent partner interview. Coming...