I tried this yesterday too and selecting sport made the issue go away. Although I suspect the 2nd to 1st change is just occurring at a slightly higher speed and thus not as noticeable.

I have also found that if try to keep the braking consistent all the way till I stop helps too. Before and what I usually I would do is ease up on the brake right before the car comes to a complete stop to make it as smooth as possible but this just makes the lurch/change down to first way more noticeable.