Most likely fluid, a friend with a 6hp19 described that down shift lag on his 5 series.
He changed it with mercon SP which is what Ford uses in the zf transmissions and it was great.
But look into the seals too, if you're handy or have a good mechanic.