There are "super capacitors" that are used for power backup - they are efficient for short-term power take-over, but they are leaky and are not good for long term. Batteries tend to die slowly, more slowly than the leakage on a power backup capacitor, so the capacitor does not do any good. Regular capacitors store so little energy they cannot really be a power source.