Automated Challenges

This feature is currently limited to those with early access. If you have access, you will see an "Automation" tab next to "Questions" in your menu. If you would like to be included, send us an email.

Developers spend a majority of their time reading, extending and maintaining existing code. Our automated challenge measures these skills in a way that will help filter candidates at the first level of your hiring funnel.

To start, go to the "Automation" tab in your menu. From here, you can manually enter a candidate's info to send them the challenge. They will be emailed a link to their challenge and an explanation of how the challenge works.

Entering the information for dozens of candidates is time consuming. If you would like to allow candidates to sign themselves up, you can create a Landing Page from the submenu. Each Landing Page will have a unique url you can send candidates to.

When they finish the challenge, their status will updated on the main automation page, and they will be given a numeric score. The scores are not percentage based, they are all relative to each other. In general, a score > 400 is passing. About 2/3 of candidates who take the challenges score less than 400 points, see here for more details.

If you would like to see a detailed report of the questions they were asked and the answers they gave, you can click on the score. This report shows each question they were given, the test cases they added, how long they spent on it, and their modifications to the code.