Length of time internet history is kept?

I read once that everything is on the Internet .... forever. Even deleted emails can be recovered. Nothing is ever erased; but accessing it might be another matter.