I blew up the photo images but at that resolution, one man's pixel is another man's portal. I can see a black electrical lead with an exposed tail, totally uncorroded, which might be evidence for an electrical device or be totally unconnected (in both senses). Also, I would love to see the remainder of the flattish triangular plate at left - maybe part of a loudspeaker mounting?
Next time I go up a mountain, I shall take a ruler for putting in photos to get a scale, some callipers, and a spring balance, and quite possibly a spectroscope. Hey, maybe its a portable ...
Reason I think not batteries is: I believe I can see flats on the end bit of the one nearest centre, and it is still largely bright. From comparing the scale of fingertips and the other parts in the other photo, I would identify the grey bit as the head of a 10mm bright steel bolt. The one at the bottom even seems to have the business end of a bolt peeking out on the right.
Why has it got obvious copper salts on the lower edge of the "bolt head"? I think the adjacent part is a big flat phosphor-bronze washer that used to retain something that swivelled behind it, causing electrolytic corrosion. It seems a bit thick for a battery casing, and it isn't the normal pitch or plastic insulator used at the top of batteries.
The darkness of the main body is wrong too. Batteries are normally sheathed in Zinc or Alu and they corrode into a light/mid tan (although Cairngorm might be a subtly different environment to inside a Walkman). It just looks like old iron, thick and pitted (somewhat like myself) - in fact some of the pits are deep enough to penetrate a normal battery casing.
Mind you, I can't account for the white irregular blobs - they look just like the mushy electrolyte inside a dry battery for some reason.
No other solution, Jon: meet me at Aviemore Station 11:00 Saturday, and we will go and find the site and figure it out over a beer. Stay well!