A buffer is made of a weak acid and a weak base. I used to think the same considering the conjugate of a weak acid is a strong base but you have to remember that buffers are there to balance out and minimise changes in pH. A strong conjugate base acid wouldn't help just as it would be to strong.