Yup, I heard those too, that's why when the car was garaged they were loosened off and then tightened up again before the car was driven.
Mind you, on an old mini, rusting valve caps is the least of your worries, it's the rest of the car you worry about!