We know that interstellar space is not empty, there is an
interstellar medium
, which we see most easily in the form of nebula. That is, we can see clouds of gas and dust between the stars, by the fact that these emit, absorb and reflect light.