CNATech
AI giants promise publishers one way to block scraping
Publishers may soon get one standard instruction to stop artificial intelligence companies from scraping their websites. The proposed system would replace the separate blocking commands now needed for different web crawling bots if companies agree to recognize and honor it.
This card is an AI-assisted summary of reporting published by CNA. Read the original report before relying on it for medical, legal, financial, safety, or emergency decisions.