light - Are we made of stars we're seeing?

Stars really are immensely far, however it's a common misconception that the stars that you can see are millions of light years away. Most of the visible stars are a few tens to a few hundreds of light years away.

However it is possible that there are stars that have exploded in a supernova: Eta Carinae looks to be approaching the end, and is 7500 light years away (so we see it as it was 7500 years ago). It's one of the most powerful stars in the milky way, but it is so distant that it looks like a faint star.

It is impossible for matter from an Eta Carinae supernova to reach the solar system before light from the supernova, because matter must be slower than light. No matter how far the star is, whether near or far, light beats matter in any race. In fact, Eta Carinae is too remote for any matter from its eventual supernova to ever reach the solar system.

The "starstuff" of which we are made was present in the molecular cloud that collapsed to form the solar system about 4.7 billion years ago, that molecular cloud was enriched with material from ancient stars that died during the 8 billion years that elapsed before the formation of the sun.