Space and time are inextricably interwoven through relativity, but the "space" referred to is space in the sense of length, breath, and height, not space as in outer space. The idea of a "fabric" is a metaphor to try to help represent this idea. You could also call it the space-time continuum...