I had exact same problem. I replaced my transfer case under warranty. The problem has gone since then.
Hmm.... it looks like more common problem. I replaced my transfer case based on the post I saw.. other owner's post about that problem and his fix regarding another owner's question. so there are many out there.
I'm sure that many owners would just drive without noticing or ignoring it since it feels normal in other situation..