We have a small home network - and we dont use AV software. Haven't had issues in years. I try to avoid sites/software that are likely to cause problems and run firewalls, both on routers and PC's. I've never experienced a AV package that doesn't interfere with daily use - so I would rather risk it.
Occasionally I'll run a online virus scan - and when we have a problem, like the lsass virus (or whatever it was called) I either format or apply a fix if available.
The way I see it, there is nothing on any of our PC's that are that sensitive - and if a picture of my bumm was 'leaked' I pity the fool who downloads it