Pronunciation is definitely the biggest thing that people notice when you are speaking English.
When you meet a person, and you just say a sentence or two, do you think they will notice your poor vocabulary or bad grammar? Probably not. But they will notice if your pronunciation is good or bad. If your pronunciation is poor, they will immediately think about you as "the guy/girl who speaks bad English". Your pronunciation creates the first impression you make.