I throw away the old one, and replace it with the new one.
I recycle the old one, and replace it with the new one.
I throw the new one away immediately, because I don't use/keep printed books.
I recycle it immediately, because I don't use/keep printed phone books.