You're not going to get blown away with a performance increase just so you know.
If you really want to upgrade, I'd look at getting an E8400 and as you said an extra 2GB of memory. Personally I'd hold on to the motherboard for another while. Also depending on the resolution you game at a graphics card upgrade might not be worth it either...
It's up to you really...