Skip to content

docs: refresh brittle prompt examples for newer models#90

Open
voidborne-d wants to merge 1 commit intoanthropics:masterfrom
voidborne-d:fix-refresh-exercises-for-current-models
Open

docs: refresh brittle prompt examples for newer models#90
voidborne-d wants to merge 1 commit intoanthropics:masterfrom
voidborne-d:fix-refresh-exercises-for-current-models

Conversation

@voidborne-d
Copy link
Copy Markdown

Summary

  • refresh lessons 3 and 4 across all notebook variants so they no longer assume the baseline prompt will always fail on newer Claude models
  • reframe the exercises around reliability and reasoning quality, which still demonstrates the prompting technique even when the first answer is correct
  • add a small validation script to catch future regressions in the model-drift notes

Testing

  • python3 scripts/check_model_drift_notes.py

Fixes #86

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Using Haiku many of the answers which should be incorrect are now correct on first pass. Exercises likely need to be updated.

1 participant