I used to use Thunderbird portable. It's true to the standard version, just in a nice portable package. I did, as I wrote above, end up going away from it for another portable solution.
Sadly, there is just too much non-portable software out there. I don't know why Microsoft doesn't make portable software. Perhaps licensing issues. I think the only portable stuff I've seen (and used) is all free.