We are speaking about energy collected in all the field, with no consideration about the recording device, if I'v understood (?).
I'd rather speak about energy collected from the subject of interest (with no consideration about the recording device). We could use an 8mm lens and collect the energy of the entire Milky Way, but that is pointless if we are trying to capture and render Jupiter.
The same with a portrait shot with a shallow DOF. The energy collected from the out of focus areas is of little interest, since it is blurred, we can just apply noise reduction to these areas, since there are no fine details that need respect.
So the image magnification is useful from an detail standpoint, because of the lens ability to resolve detail, and the recording device ability to record that detail. But from a photon count standpoint (SNR) (from the subject of interest), image magnification plays no role.
I believe this is an important distinction, since we choose focal length for reasons other then photon count. If we are limited by shot noise, we would choose a lens with an greater aperture diameter. If we a limited by resolved detail, we would choose a lens with the correct focal length, and/or, optics that resolve finer detail. In the first case, we increase the SNR, in the second case, we increase our ability to record fine detail.
If focal length alone (constant aperture size), changes the amount of photons collected from a point source, then I am happy to be corrected.