Lusor journal
Comparisons
Stories filed under Comparisons.
Insights · Comparisons8 min read
What the mobile agent leaderboard hides
Lusor's AndroidWorld run passed 116/116 tasks on Mobilerun's fork of the grader and 114/116 on Google's original grader. What that score does not measure, what Lusor publishes so it can be checked, and the questions to ask of any mobile agent leaderboard.
Insights · Comparisons9 min read
Lusor + DeepSeek: 116/116 on AndroidWorld for $2.95
Lusor's production agent on open-weight DeepSeek V4.1 Flash passed 116/116 AndroidWorld tasks on Mobilerun's grader (114/116 on Google's), 5.2× faster per task than Mobilerun's published times, for $2.95 against Lusor's estimate of about $108.70 for Mobilerun.