Hasn't happened much to me, but a handful of times now. Sometimes my Riolu was the one to engage battle with wild Pokemon, so I'm not sure if those would have attacked regardless.