Crawl control6 min readReviewed
Marketplace filters and SEO: deciding which filtered views earn a place, and closing off the rest
Filters are where marketplaces lose control of their search presence. Among the crawl complaints site owners send Google, faceted navigation tops the list by a wide margin. This report turns its guidance into a method: a test for which filtered views to keep, how to shut out the rest, and how to check the result in your logs.
1A four-question test
| Question | Pass if |
|---|---|
| Demand | Do people search for this exact combination, in Dutch or English? |
| Stock | Does it usually hold enough listings to be useful? |
| Difference | Is it genuinely different from its parent category? |
| Content | Can it carry its own heading and a few lines of useful text? |
A filtered view that passes all four can be promoted to a proper page; anything else stays out of the index.
2Promote the few
Views that pass the test should stop behaving like filters. Give each a clean, fixed address, a heading and short introduction in the right language, a place in internal navigation and the sitemap. Google's guidance, if you need such URLs crawled, is to use the standard ampersand separator and keep filter order consistent.
3Shut out the many
- Disallow the remaining filter parameters in robots.txt, or move filters to URL fragments so they create no new addresses.
- Remove internal links that point at blocked combinations.
- Return a 404 for combinations with no results, as Google recommends.
- Remember that canonical tags consolidate slowly, and nofollow only helps if used on every link.
4Read the logs
Server logs show exactly which URLs Googlebot requests. Before the change, filter URLs often dominate; afterwards, requests should shift towards categories and listings. Search Console's crawl statistics give a coarser view of the same thing.
5Revisit each quarter
Demand and stock change, so repeat the test every few months and promote or retire views accordingly. For URL patterns and pagination, see listing site architecture; for help putting this in place, marketplace SEO.
6A filter decision table
| Filter | Usual decision on a Dutch marketplace (illustrative) |
|---|---|
| Category plus city | Promote where enough listings exist |
| Language of listing | Usually keep out; handled by language versions |
| Price range | Keep out; changes too often |
| Date, for events | Keep out, except perhaps "this weekend" pages with steady demand |
| Sort order | Always keep out |
7Empty results, as Google advises
Google's December 2024 guidance on faceted navigation suggests that a filter combination which matches nothing should answer with not found, so crawlers do not mistake a blank listing for a real page. On marketplaces, where supply changes daily, that means checking result counts when a filtered page is requested and responding accordingly. It keeps crawlers from wasting time on empty pages and keeps visitors from landing on them from search.
8Parameter order and duplicates
The same filters in a different order can produce different URLs with identical results. Normalise parameter order in links the site generates, and point any variations to one version with a canonical tag. Promoted filter pages should have clean URLs that do not depend on parameter order at all.
9An events platform with date filters
Hypothetically. An event platform lets visitors filter by date, venue type and city. Date filters change daily and are kept out of the index. City and venue type, where supply is steady, become clean landing pages. A single "this weekend" page per city is promoted because people search for it every week. The result is a few dozen strong pages instead of thousands of short-lived ones.
10Measuring the change
Before changing filter rules, record how many URLs Googlebot requests per day by type, how many filter URLs are indexed, and how quickly new listings are crawled. After the change, compare weekly. Success looks like fewer filter requests, faster crawling of new listings and stable or rising search visits to promoted pages.
11Filter checklist
- Each filter has a decision: promote, keep out or canonicalise.
- Promoted views have clean URLs, titles and introductions.
- Empty combinations return not found.
- Logs reviewed before and after changes.
The structure around filters is covered in listing site architecture.
12Filters in two languages
On a platform with Dutch and English versions, filter labels and promoted filter pages need equivalents in both languages, with matching URLs and hreflang. Keep the decision the same in both: a filter promoted in Dutch should normally be promoted in English too, unless demand in one language is negligible. A glossary keeps the labels consistent.
13What users see versus what crawlers see
Filters should work the same for users and crawlers. Avoid hiding filtered content from crawlers while showing it to users, or the reverse. Control crawling through links, robots rules and canonicals, not by serving different content. Search engines treat inconsistent behaviour with suspicion, and users who arrive from search should see the page that was indexed.
14More on this
The structure that filters sit within is covered in listing site architecture, and the order of work in Dutch marketplace SEO. The service is described on marketplace SEO.
15Mobile filter design
On phones, filters usually sit behind a button and apply when the user taps "show results". Design them so applying filters does not create a new indexable URL for every tap, and so the promoted filter pages are reachable through ordinary links in categories and menus. Users get a smooth, fast experience, and crawlers find the few views that matter.
16Who decides which filters to promote
Promoting a filter view creates a page someone must maintain: its title, introduction and place in navigation. Give one named person the decision and the list, review it quarterly with search and supply data, and retire views whose demand or supply has faded. Without an owner, promoted views multiply until they become the problem they were meant to solve.
17A simple test for each view
Before promoting a filtered view, ask three questions: do people search for this combination, does it hold enough active listings most of the time, and can we write a useful introduction for it? A view that passes all three deserves a page. One that fails any of them is better left as a filter for users only.
18A one-page summary
Promote the few views people search for and supply can fill; keep everything else out of the index; answer empty combinations with not found; and check the server logs before and after every change. Repeat each quarter, because demand and supply both move.
19Filters and internal search together
Internal search results behave like filters with infinite combinations, and they belong out of the index for the same reasons. Keep internal search result pages noindexed and out of sitemaps, and use what people type to decide which category or filtered view deserves promotion next. Internal search data is often the clearest evidence of demand a marketplace has. Profile pages, which raise different questions, are covered in marketplace profile SEO, languages in Dutch and English search, model choice in membership versus listings, and promotion on platform marketing.
20Background sources
Links to the bodies and studies mentioned, so the facts can be traced back.
QQuestions
Is blocking filters in robots.txt risky?
It stops crawling, not indexing of URLs already known, so combine it with removing internal links to blocked combinations and give it time.
Why a 404 for empty results?
Google's guidance recommends it for filter combinations with no results, rather than sending them to a general not-found page or an empty listing.
How do we know it worked?
Crawl requests shift from filter URLs to categories and listings in your server logs and in Search Console crawl statistics.