Skip to main content

Adding Custom Autograders and Preset Configs

Learn how to add and edit custom autograder test cases and preset configs to check student code using the Autograder Editor.

Billy Gotsch avatar
Written by Billy Gotsch
Updated today
Banner: This is a free feature

CodeHS allows teachers to create customized autograders to help grade student code against test cases. Create and edit custom autograders or configure preset configs for your custom assignments using the Autograder Editor.

Learn more about CodeHS Autograders and what they can check in this article: CodeHS Autograders 📖

Adding and Editing a Custom Autograder

After creating a custom coding exercise, we can add our own custom autograder from the Create app or the Assignments page.

Adding and Editing an Autograder from the Create App

  1. Navigate to the Create App > Autograder Editor tool

  2. Click on the Edit Autograder button next to the coding exercise.

  3. Add a Custom Autograder file or Preset Config within the editor.

image displaying the autograder editor tool in the create app

⚠️ Adding or editing a custom autograder from the Create app will update the autograder for all Sections the assignment is assigned to, including those in other teachers’ courses.

Adding and Editing an Autograder from the Assignments App

  1. In the Assignments app, click the '[Edit]' button next to the Assignment.

  2. Select the Autograder tab in the Edit modal.

  3. Click 'Create Autograder' or 'Edit Autograder'.

  4. Add a Custom Autograder file or Preset Config within the editor.

gif displaying how to add and edit an autograder to an assignment from the assignments page

⚠️ Editing an autograder from the Assignments app will only make changes to the assignment assigned to the current Course selected in the dropdown menu at the top of the Assignments page.

Editing the Default Autograder from the Assignments app

Autograder edits in the Create App will be the default autograder for any given assignment. You can revert any autograder to it's default or navigate to the default autograder editor when editing from the Assignments page.

When editing the default autograder from the Assignments app, the custom autograder file will not be able to be deleted, and instead will have a toggle box.

image displaying the autograder editor from the assignments page

Revert to the Default Autograder

image displaying the tools to reset the autograder to the default

Navigate to the Default Autograder Editor

image displaying the tool to navigate to the default autograder editor

Adding and Editing Preset Configs

⚠️ This feature is limited to JavaScript, Python, HTML, and Java exercises.

Toggle Preset Configs on or off, and edit their options by clicking the pencil icon next to each field.

image displaying how to edit a Preset Config test

Language Specific Guides for Building Autograders

Each language has its own way of creating and defining autograders with code. Check out this collection of articles for more information on creating language specific autograders: Autograders 📚

For an advanced guide to creating Custom Autograders, take a look at our Autograder Guides 📚.

image indicating "This is a Pro Feature"

Configure the Autograder

Set the autograder's Feedback Level and Visibility settings in the top-right of the Autograder Editor. You can also configure these settings from the Autograders tool in the Code Review App.

image displaying the feedback level and visibility options in the autograder editor

For more information about configuring autograders, check out this article: Editing and Configuring CodeHS Autograders 📖

Still have questions? Contact our team at support@codehs.com to learn more!

Did this answer your question?