Try a lineair power supply, not a switching one. Then check with a scope if you have a smooth output voltage after the power regulator in the circuit. When the problem arises again, check the output voltage after the power regulator again with a scope. You might have an oscillating power supply, or a bad voltage regulator.
The photo is not sharp enough. Re-post it in a sharp, high resolution if you can.