Вход на сайт

Просмотр новости

Найдите то, что Вас интересует

Gemini 3.5 Flash lands on Google’s Android coding rankings, but it’s 3x the cost for slower performance

Дата публикации: 12-06-2026 15:10:46

Google has released another set of benchmark results to determine the best AI models for Android coding, along with how much each model costs per token. Google’s Gemini 3.5 Flash is easily the most resource-intensive in Android development, and it doesn’t even make the top five.


Основное содержимое страницы с новостью.

Google has released another set of benchmark results to determine the best AI models for Android coding, along with how much each model costs per token. Google’s Gemini 3.5 Flash is easily the most resource-intensive in Android development, and it doesn’t even make the top five.

As the hype for general chatbots is dying down, companies like Google, OpenAI, and Anthropic are shifting towards agentic models with a strength in coding. Users have begun relying on these models for “vibe coding,” which essentially offloads the bulk of software development to LLMs.

Recent models have dramatically improved their Android coding, and Google has kept tabs on which models perform best over the past few months. The “Android Bench” goes through updates as Google releases its own models, like the recent Gemini 3.5 Flash, and compares them to the competition.

The main takeaway is how Google breaks these models down. Each model gets a score out of 100, indicative of the percentage of Android coding cases it can successfully solve across 10 runs. Google lists expected performance and the date the last test was run, with some high performers sticking around since February.

In the latest edition of Android Bench, the results paint a more expensive picture. Gemini 3.5 Flash ranks 6th in the Android Bench list under models like GPT 5.5 and Gemini 3.1 Pro Preview, which was tested in February.

Gemini 3.5 Flash was touted as a cheaper and faster alternative to Gemini 3.1 Pro, with an expected performance gap of 6.1%. The new benchmark results say otherwise in regards to Android development, as Gemini 3.5 Flash has a higher latency and 9% gap in performance success.

The kicker – Google’s latest model costs an average of 355.9 tokens at $147.1 for one benchmark run, compared to Gemini 3.1 Pro Preview’s 73.3 tokens used at around a third of that cost.

Of course, it’s worth noting that Google lists the preview version of Gemini 3.1 Pro. That being said, the preview model scores higher than a model meant to be faster and more efficient.

GPT 5.5 ranks similarly in cost per run, but Gemini 3.5 Flash used up 5.5x more tokens in Android Bench tests. Claude’s previous model, Opus 4.7, ranked 4th at a slightly lower run cost and token usage, sitting right in the middle of the pack. Google has not released benchmark scores for Opus 4.8 or Fable 5, for that matter.

Here are the top ten models ranked by Google in the latest Android Bench release:

ModelScoreAvg LatencyAvg Total TokensAvg Cost
GPT 5.57415.764.7$134.2
GPT 5.472.421.264.2$91.7
Gemini 3.1 Pro Preview72.411.173.3$47.9
Claude Opus 4.768.711.690.0$124.3
Claude Opus 4.666.69.969.5$84.4
Gemini 3.5 Flash63.714.2355.9$147.1
GLM 5.159.733.480.2$46.7
Kimi K2.658.629.994.3$42.5
Claude Sonnet 4.658.48.247.9$40.4
DeepSeek V4 Pro55.435.8132.7$13.7
Claude Sonnet 4.553.713.194.2$61.0

The list includes several open-weight models listed among the well-know closed-weight models like Claude and GPT. The high end of the list has effectively remained unchanged since the last Android Bench, with the exception for GPT 5.3 Codex which has been removed from the list.

You can see the full rankings on Google’s website.

Google has regularly updated this list as more models are tested. At its core, it seems like a solid indicator of model performance in Android development. Gemini 3.5 Flash has been a solid improvement for other LLM and agentic tasks, even as Google has shifted cost and usage limits around. Google’s release numbers can’t be disregarded completely, though Android coding is apparently not Gemini 3.5 Flash’s strong suit.

More on AI:

Add 9to5Google as a preferred source on Google Add 9to5Google as a preferred source on Google

FTC: We use income earning auto affiliate links. More.

Схожие новости

#Наименование новостиТональностьИнформативностьДата публикации
1Вышла Gemini 3.6 Google представила сразу три ИИ-модели: самой дешевой ...0721-07-2026
2Google is changing how it judges AI models for Android coding, updates list with Fable 5011.2508-07-2026
3Google Is Cooking: Gemini 3.5 Pro Mogs Claude Fable 5 in Arena Leak0002-07-2026
4Gemini begins rolling out for existing Android Automotive vehicles0526-06-2026
5Google расширила Gemini, но флагмана все еще нет. Кратко о нейросетях — 22.07.2026011.3222-07-2026
6Gemini in Chrome adds ‘Select from screen’ tool as Gemini 3.5 Flash gains computer use0524-06-2026
7What Gemini app upgrades you get with Google AI Plus & AI Pro0504-07-2026
8Google adjusts Gemini’s new usage limits in response to complaints0529-05-2026
9Google Drive’s Ask Gemini & AI Overviews come to Android with AI Pro0530-06-2026
10Google Home update upgrades Gemini weather forecasts, media on Nest Hub, and voice commands as a whole012.3508-06-2026

Классификация: Пресс-релизы. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 13.22. Источник: 9to5google.com.