In general...
the responder is someone who is responding/writing back/criticizing on the poem
the audience is us yes, because we are reading the poem as we are the audience if we watch a play or movie but the poet normally intends his poetry for a specific audience eg, yeats' was for irish...