Your (server) CPUs are almost certainly too old to save much or any power themselves when idle, but you can automagically turn off power to other things such as the CD-ROM and any USB connectors, etc, when not in use, under recentish Linux flavours as I understand things.
The usual mechanism to do a lot of this is "laptop-mode", but beware that desktop hard drives are not usually rated for lots of power- on/off cycles and may die.
If you can't/won't replace the system with a laptop then you might consider upgrading your machine's power-supply to a newer and more efficient one (eg you might go from 60% to 80% efficient on a better second-hand supply) which might match any other savings yo make.
Newer systems, especially laptops designed to eke out their batteries, have much better scope for power savings on idle, and are often much much faster than old machines too!
Rgds
Damon