I wear sunglasses but immediately take them off when I go inside a building (never understood those people who think its "cool" to wear them inside).

As a result, I almost never use my sunvisors unless the sun angle is very low and directly blinding me while driving.