Such exceptions can be allowed for in a properly organised system. Simply notifying the local police station that one's vehicle is at a garage for repair, to be confirmed by the new vehicle tracking system that will be introduced at the same time.
Again, notification to the local nick with the name and address of the prospective purchaser. Being the trusting sort of chap you are you'd want to go along on this test drive wouldn't you, so you'd know exactly who was driving?
If everyone who wants one has got their own car why would anyone need to drive anyone else's car except on a very occasional basis? If it was the case (say) that you had a little Fiesta or something and wanted to borrow a friends or relatives large Volvo estate to carry some stuff around then, again, simple notification to the local nick would sort that one out. It could even be organised so that you could advise the system online. You wouldn't even need to trouble the police, good huh?
Some people have the need to drive a hire vehicle, a van or somesuch, occasionally but again that would be a simple case of entering your details into the database which would be done when you collected the vehicle from the hire depot.
At the same time you would be shown as not being able to drive your own so if it was seen on the road that would mean it had been stolen, isn't that a useful precaution?