#Baiduspider User-agent: Baiduspider Disallow: / #PetalBot User-agent: PetalBot Disallow: / #Magpie Crwaler Brandwatch User-agent: magpie-crawler Disallow: /