robots.txt blocks TikTok crawler from product page

If robots.txt disallows TikTok's verification bot, landing-page validation fails and products cannot be approved for delivery.

TikTok Shop / TikTok Catalog Manager validates landing-page URLs for crawlability, format, and uniqueness. Common triggers: invalid characters, relative paths, missing protocol, redirect chains, or hostnames that don't resolve.

1. Test the URL in a private/incognito browser — if it doesn't load instantly, the channel can't load it either.
2. Confirm protocol is `http://` or `https://`. Most channels prefer HTTPS.
3. URL-encode special characters (spaces → %20, ampersands → %26).
4. Eliminate redirect chains — most channels allow max 2 redirects.
5. Remove user-specific tracking parameters from product URLs.

• Hash fragments (#section) — typically stripped, leaving the rest valid only if structurally OK
• WAF rules blocking the channel's crawler — whitelist by IP range or user-agent