13 Commits

Author SHA1 Message Date
Bradley Axen ef0252bb3f fix: improve smoke test prompt for reliable tool calling
The previous prompt 'please list files in the current directory' was
ambiguous and didn't explicitly require tool usage. Models like
qwen/qwen3-coder and z-ai/glm-4.6 would sometimes respond with text
describing what they would do instead of actually calling the tool.

The new prompt explicitly instructs the model to immediately call the
shell tool without asking for confirmation, which should improve
reliability for models with weaker tool-calling capabilities.
2025-12-24 20:39:09 -08:00
Michael Neale 5ca7eb2305 chore: Update gemini versions in test_providers.sh (#6246) 2025-12-23 11:12:19 +11:00
Alex Hancock 7134e89c4b feat: improved UX for tool calls via execute_code (#6205) 2025-12-22 10:42:20 -05:00
Michael Neale d4814042e6 chore: cover code mode with end to end provider tests (#6183) 2025-12-19 12:02:06 +08:00
Salvatore Testa cfdf01567d fix: support Gemini 3's thought signatures (#5806)
Signed-off-by: Salvatore Testa <sal@withpersona.com>
2025-11-20 16:28:27 +11:00
Michael Neale 2bef034303 feat: trying grok for live test (#5732) 2025-11-17 09:37:43 +11:00
Zane 89f7384d57 add clippy warning for string_slice (#5422)
Co-authored-by: Douwe Osinga <douwe@squareup.com>
2025-11-04 17:46:25 -05:00
Michael Neale 7511a533d6 we should run this on main and also test open models at least via ope… (#5556)
adds qwen3-code and GLM 4.6 to test_providers for open model coverage
2025-11-04 09:06:23 +11:00
Alex Hancock 38e7dc8f30 fix: remove qwen3-coder from provider/mcp smoke tests (#5551) 2025-11-03 14:33:49 -05:00
Michael Neale b94535b679 testing tetrate with sonnet (#5428) 2025-10-29 11:40:02 +11:00
Douwe Osinga 6b6c50976c Gemini again (#5390)
Co-authored-by: Douwe Osinga <douwe@squareup.com>
2025-10-27 16:41:00 -04:00
Michael Neale 3c975bb358 live testing script (#5263)
Co-authored-by: Jack Amadeo <jackamadeo@squareup.com>
2025-10-21 16:39:58 +11:00
Douwe Osinga 64b37339e0 Skip subagents for gemini (#5257)
Co-authored-by: Douwe Osinga <douwe@squareup.com>
2025-10-18 17:35:29 -04:00