Try this:
My link
This is for Windows 7 and it isn't in the task bar. It's a gadget. It's useful because it tells you the CPU load and measures how much memory you are using and if you turn on core temp it tells you the temperatures too.
EDIT: It will say the changing speeds too in the top corner.