They don't take your old passport away cause you are allowed dual citizenship unless you were born US citizen, in my case i got my citizenship a few years ago, i still have both of my passports and travel with one or the other according to my destinations.