What to eat to lose body fat?

I play golf, all the time. I work out. I don't eat sweets. But I'm over weight. What am I doing wrong? I don't eat a whole lot. Usually three meals a day, no second helpings.