Why are some substances weak when wet - for example, paper?

What causes this?

EDIT: Jon, thanks for your great answer.

I assume when mentioning oil and water it is to do with the fact that oil is a non-polar solvent whereas water is polar (delta + and - right?)

Actually would you be kind enough to fully explain this to me?

Thanks!