Compare · Chat · Research notes
Chat & LLM tools — scored
Chat tools look interchangeable until you hold one job constant. Score edit time and invented facts — not homepage demos.
Last reviewed: 2026-08-15. Re-run the protocol after major model or pricing changes.
How do you compare chat LLMs in 15 minutes?
- Write one brief: audience, artifact, must-keep facts, and a fact the model should not invent.
- Run the same brief in two tools.
- Score structure, voice, and whether citations open.
- Note retention / training settings before you paste anything non-public.
What is the scoring rubric?
| Criterion | Weight | How to score |
|---|---|---|
| Job match | 1–5 | Did it produce the artifact you asked for? |
| Invented facts | Gate | Fail if it added a stat or quote you did not supply. |
| Edit time | 1–5 | Include the human rewrite. |
| Privacy fit | Pass/Fail | Fail if you cannot confirm training/retention for the job. |
Which chat tool should I start with?
| Tool | Best fit | Best job | Watch-out | Note |
|---|---|---|---|---|
| ChatGPT | Everyday default | Drafts and tool-using chat | Still invents citations | Strong default if you will edit. |
| Claude | Long documents | Careful rewrites | Plan limits vary | Often wins on long briefs you still fact-check. |
| Gemini | Google Workspace | Docs/Sheets adjacency | Ecosystem ≠ quality | Compare on the same brief, not only Workspace convenience. |
| Perplexity | Linked sources | Research map | Not a finished bibliography | Open every cite before you publish. |
| DeepSeek | Low-cost reasoning | Budget experiments | Data-residency questions | Pilot on non-sensitive tasks first. |
Learn the craft, not just the tool
Practice the transferable habit in What is an LLM?, then Local LLM vs API, Token counter.
FAQ
What is the best ChatGPT alternative?
Claude for long careful writing, Perplexity for sourced research, Gemini for Workspace, DeepSeek for cost. Hold one brief constant.
Should I pick one chat tool for everything?
Pick a default, then keep a second tool for research or privacy-sensitive jobs.