About the URL List Cleaner
URL lists from crawls, backlink exports, analytics and spreadsheets are often messy, with duplicates that differ only by tracking parameters, fragments, letter case or a trailing slash. This URL list cleaner tidies them in one pass: it trims whitespace, lowercases hostnames, removes #fragments and tracking parameters such as utm_ and gclid, can force https and add or remove trailing slashes, deduplicates and sorts, then lets you export the result.
It can also extract unique domains, useful for link outreach or disavow reviews, or unique paths for redirect mapping during a migration. Paths are case-sensitive on many servers, so only the hostname is lowercased. The cleaning runs in your browser, so client URL lists stay on your device.
How to use it
- Paste your URLs, one per line.
- Choose cleaning options such as removing tracking parameters or forcing https.
- Optionally extract unique domains or paths and sort them.
- Copy or export the cleaned list.
Frequently asked questions
Why remove tracking parameters from URLs?
Parameters like utm_source or gclid create many versions of the same page in reports and crawls. Removing them groups data by the real page and avoids duplicate entries when building redirect maps, sitemaps or audit lists. Keep parameters that change page content.
Why isn't the whole URL lowercased?
Hostnames are case-insensitive, so lowercasing them is safe. Paths and query strings can be case-sensitive on many servers, so /Page and /page may be different pages. Changing their case could create broken URLs. Check your server before normalizing paths, and only lowercase them if you know the site treats them as identical.
Can I use this to prepare a redirect map?
Yes. Clean and deduplicate the old URLs, extract paths if your redirect rules use relative paths, then match them to new URLs in a spreadsheet. Test the final redirects with a redirect or status code checker. Avoid chains by pointing each old URL directly to its final destination.