After some more observation the problem seems to be the variable compressor valve/solenoid as symptoms are a lot similar to all with that - when car has stayed for a while, cold starts after 5-10 minutes of driving, or driving in high rpms sometimes manages to build the pressure. The AUX fan doesn't kick in until the cold starts blowing, and compressor compressing.