Search engines and publishers used to operate on a simple deal: publishers would let the likes of Google trawl their site, ...