Have a look here, it gives an "official" answer:
http://www.askthe.police.uk/Content/Q205.htm
I guess that if you were at work you would not know who was actually driving the car - you would only suppose that it was your wife....but can you prove it :p (and would you want to
)