I guess I was taught to always yield to pedestrians, as a matter of common courtesy.
When creeping along in a store/mall parking lot, I almost always wave everyone on foot to proceed ahead of me.
So I can't quite say what I would have done, since this situation will probably never happen to me.