cos Voldemort could block it using a shield charm like Protego since it blocks out spells as well as physical entities, or use a disarming charm such as Expelliarmus to make it fly out of Harry's hand. Also, Harry didn't really know too much about Voldemort in the first movie, he was only 11...