How We Test and Score Cleaning Robots

Every score on this site uses the same published criteria and weightings, so you can compare robots fairly and see exactly why we rank them as we do.

Our sources

We are upfront about this: our rankings are research-based. Unless a review says otherwise, we have not run each product in our own home. Instead, for every model we score, we combine:

  • Maker documentation: spec sheets, user manuals, warranty terms, firmware release notes and app features.
  • Independent hands-on reviews from established publications and lab testers, compared against each other so one outlier doesn't decide a score.
  • Owner reports: forums, long-term owner reviews, support threads and recurring complaints, which we weight heavily for reliability.
  • Price history to judge value and when models tend to be discounted.

When we do test a product hands-on, the review will say so clearly, including how long and in what conditions.

Why we don't trust suction numbers alone

Makers quote suction in pascals (Pa), and the number has roughly doubled every year. It's measured in different ways by different brands, and above about 10,000 Pa the brush design, airflow path and how well the robot seals against the floor matter more. We treat Pa as a rough guide, not a score. More in robot vacuum suction power explained.

Robot vacuum scoring criteria

Each robot vacuum gets a 1–10 score in five areas. The final score is the weighted average below, rounded to one decimal place.

CriterionWeightWhat we assess
Cleaning performance30%Pickup on hard floors, low-pile and high-pile carpet, edges and corners; hair tangling; mopping quality and how well the mop lifts or detaches on carpet
Navigation & obstacle avoidance25%Mapping speed and accuracy, multi-floor maps, how reliably it avoids cables, socks, shoes and pet mess, and how often owners report it getting stuck
Dock & maintenance15%What the dock automates (emptying, mop washing, drying, refilling, draining), how often you still need to step in, and the cost of bags and parts
App & reliability15%App clarity, room and zone control, voice assistant and Matter support, firmware stability and long-term failure reports
Value & support15%Price vs capability, typical discounts, warranty length, parts availability and after-sales support

Window robot and litter box criteria

Product typeWhat we weight most
Window cleaning robotsStreak-free results (30%), safety: rope, backup battery and suction warnings (25%), speed and coverage on framed and frameless glass (20%), noise and ease of use (10%), value (15%)
Self-cleaning litter boxesCat safety: detection sensors, small-cat limits, anti-pinch design (30%), odor control and waste capacity (20%), reliability and jams (20%), litter compatibility and running costs (15%), app and health data (15%)

How a score turns into a ranking

  • Best-of lists rank models by score for that use case. A vacuum that scores 9.0 overall can rank lower in our carpet guide if its carpet pickup is weak.
  • Comparisons pick a winner per category, then give an overall verdict for each type of home.
  • Troubleshooting guides are built from maker manuals, support documentation and the fixes owners report actually worked. We say when a step comes from the manual and when it's an owner workaround.

Prices

We quote makers' launch or list prices (last checked November 2026). We never display Amazon prices, because they change constantly. Robot vacuums in particular are discounted heavily and often, so always check the current price before buying.

Editorial independence

We earn commissions from some links (see our affiliate disclosure). That money never buys a score or a position:

  • No brand can pay to be included, ranked higher or reviewed more kindly.
  • We don't accept payment for reviews, and scores are set before we look at what any retailer pays in commission.
  • If a brand ever lends or gives us a product, the review will say so.
  • Brands don't see our reviews before they're published and can't edit them.

Corrections

Found an error? Email [email protected]. We review every report and update the page's date.