Understanding Hewitt et al. and Using Nalanda Today3 months ago
Overview | What the papers did, in simple language | What the supplement adds | 1. Prompting strategy matters | 2. Ensemble prompting matters | 3. Demographic conditioning is part of the method | 4. Absolute effect sizes need caution | Recommended take-aways for users | How this relates to nalanda | A concrete way to use nalanda today | Scenario 1: Pre/post chapter simulations | Scenario 2: Post-only simulations | Scenario 3: Control-versus-treatment chapter comparisons | What users should currently do themselves | 1. Build or manage a prompt bank manually | 2. Run ensembles manually | 3. Manage demographic profiles manually | 4. Estimate between-condition contrasts downstream | 5. Apply effect calibration explicitly | How to think about the 0.56 factor | When it is reasonable to use it | When to be cautious | Best current practice | A simple recommended workflow for users | Minimal workflow | Better workflow | What nalanda may support later | Final practical advice | References
nalanda 0.0.2.0Rémi Thériault understanding-hewitt-et-al.Rmd