Qwen3-235B-A22B-Instruct Prioritizing Few-Shot Examples Over Explicit Instructions
#37
by
Mann1904
- opened
Hi everyone,
I'm working with the Qwen3-235B-A22B-Instruct model and encountering a consistent issue where the model's behavior is more heavily influenced by the patterns in few-shot examples than by the explicit, contradictory rules given in the system prompt.
Even when I add critical "meta-instructions" (e.g., "If rules and examples conflict, you MUST follow the rules"), the model still defaults to copying the pattern from the example.
The Problem: "Example Bias" Overriding Rules
The core issue is a direct conflict between a general rule and a specific example. The model incorrectly learns from the example's flawed pattern instead of obeying the correct rule.