Yeh its like that, but i like to see the whole thing as:
a gravitational field doesn't store energy into an object, it rather provides masses kinetic energy, the OPPOSITE to potential energy, and in that respect you see the logic of the negative sign, for there is negative potential energy...