Don't use WMP.
Use VLC
http://www.videolan.org/vlc/
No codecs needed. It'll play pretty much anything.
BTW, Divx is a codec. AVI and MPEG if I remember right are wrappers. That means you can have movie.avi or movie.mpg which are both encoded in Divx.