Here's an article on raising orphaned baby mice and rats.
http://www.rmca.org/Articles/orphans.htm
You should never feed cow milk, it's way too hard to digest for most baby animals. I obviously can't say for sure but that may have had something to do with it (or nothing, he may just have gotten sick or had other problems).