Skip to content
Apixo
Blog
news· 4 min read· via The Decoder

Study Finds Chinese AI Political Alignment Varies by Language and Context

A study by Vals reveals that Chinese language models exhibit nuanced political views rather than uniform state censorship, with answers heavily influenced by language and prompt framing.

Study Finds Chinese AI Political Alignment Varies by Language and Context

A comprehensive evaluation by research firm Vals indicates that political alignment across Chinese artificial intelligence models is far more varied and nuanced than widely assumed. Rather than functioning purely as uniform mouthpieces for state positions, Chinese systems demonstrate significant behavioral differences, with their overall pro-government lean registering lower than anticipated in benchmark tests.

To evaluate these systems, Vals established a metric measuring alignment with official Beijing viewpoints on a scale from −1 to +1, where positive numbers reflect alignment with government stances and negative numbers indicate critical positions. The benchmark evaluated political alignment rather than factual precision. Among the findings, individual models diverged sharply: GLM-5.3 Flash openly stated that documented human rights violations have occurred in China, while certain non-Chinese models occasionally mirrored official Chinese perspectives on sensitive geopolitical questions.

How language and context shape AI outputs

The benchmark highlighted that the language used in a prompt significantly steers the political tone of model outputs. When queried in Simplified Chinese—the script used primarily in mainland China—both Western and domestic models produced answers that were substantially more aligned with state positions than when queried in English, Spanish, or Russian. This effect was notably stronger among Chinese models. Vals observed a comparable, albeit narrower, divergence between Simplified Chinese and Traditional Chinese, which is standard in Hong Kong and Taiwan.

Operational context also triggered noticeable shifts. When system instructions framed a model as operating internally within a mainland Chinese enterprise, responses leaned noticeably closer to official policy than when the system prompt indicated the tool was deployed in the United States.

Similar patterns emerged in multimodal generation. In examples released by Vals, OpenAI's GPT Image 2.5 Sunburst adjusted its output based on input language: when prompted in Chinese, generated maps designated Taiwan as "Taiwan Province" and incorporated Beijing's disputed nine-dash line across the South China Sea, features that disappeared when prompted in English. Subtle traces also appeared in text tasks. During a travel app translation benchmark, Qwen3.8 Max rendered the country entry for "Taiwan" as "Taiwan, China," whereas most other models translated the label without adding qualifiers.

Response styles, formatting, and fine-tuning

While popular perception suggests Chinese systems default to blanket refusals on sensitive topics, Vals observed this behavior primarily in DeepSeek models. Most other Chinese models answered sensitive prompts directly, sometimes adopting official narratives. For instance, Kimi K3 contested allegations regarding Uyghur concentration camps in Xinjiang, characterizing the sites as vocational centers established to counter extremism.

Interestingly, the structure of a query altered the degree of political alignment. Constraining models to simple "yes" or "no" choices rather than open responses lowered the pro-government scores of GLM-5.3 Flash and MiMo V2.6 Pro. Incorporating agentic instructions, such as assigning coding assistant tools or granting web search access, also softened pro-government stances—even when the models never executed searches or used the provided tools.

Targeted adaptation can also substantially reshape model behavior. In tests on Thomson 1.0 Small, a model fine-tuned by Thomson Reuters on base model Qwen3.6 35B, the frequency of answers adopting official Chinese positions fell from 84.6 percent down to 15.0 percent. Nevertheless, some specific outputs continued to support Beijing's One-China principle and its stance on "peaceful reunification" with Taiwan.

What it means for developers

For software engineers and system architects deploying large language models internationally, these findings demonstrate that political framing cannot be treated as a static property of any single model family. Instead, model outputs are dynamic, influenced heavily by user interface languages, prompt framing, and agentic workflows.

Developers should also note the testing methodology: queries were translated using GPT-6 Astra, and outputs were automatically graded by GPT-5.6 Luna. Because refusals were scored as neutral (0), an AI system that refuses every query looks neutral on paper, masking potential functional trade-offs. Furthermore, the models were evaluated through third-party provider endpoints, which may lack the additional safety guardrails applied by manufacturers' consumer-facing interfaces under China's regulations requiring alignment with core socialist values.

Developers working on multilingual systems, localized translation layers, or cross-border tools can try top AI models cheaply through one API at https://apixoai.online to evaluate behavioral variations across providers and adjust system prompts accordingly.


Source: Chinese AI models are politically complex, not just government mouthpieces, study finds — The Decoder. Written by the Apixo team from that report.

#ai-news#ai-models#benchmarks#deepseek#qwen#llm-evaluation
Try it with your own tools

One key for Claude, GPT, GLM, DeepSeek and more. Pay per token with crypto.

Get your API key

Keep reading