Yes, but not only the tap water-but also, what's contained in the medium.
With regards to magnesium in the diet, would I recommend cal/mag to correct potential deficiencies? is a bit more complex: IMO
Magnesium is a mobile element lending itself to the plant where it is needed and a certain amount of repair can happen if caught soon enough.
Calcium is immobile and once the damage begins you can only hope to prevent future issues, by providing constant availabilty.
A timeline from my experiences have been Magnesium deficiency earlier and later in a grow compared to Calcium, so you could end up giving both nutrients when only one is needed- if you give Cal/Mag for magnesium issue.
When I see people state Cal/Mag it's usually a magnesium deficiency, so I'm not certain I would give Cal/Mag (depending on the stage of the grow).
Treating anything without knowing what it is - is a waste of time/money and a quick pH check helps determine if it's an uptake issue or not and I wouldn't add more Magnesium if already provided without checking the pH.