︎










︎
Dev Atrophy Test


Are you still a dev lord or just chatGPT's lil" biyatch? Well the Dev Atrophy Test aims to uncover who out there still has the raw dog coding skills buried deep inside their AI-laced cerebral cortex.



As a learn to code platform (Scrimba) we recognise the perceived and real threat from AI both in terms of people’s desire to learn how to code but also in negatively affecting their abilities to code unaied. So we created this micro site - The Dev Atrophy Test, to rate people’s coding knowledge through a series of increasing difficulty levels.  Ironically the site was vibe coded with Vercel’s V0. 🙃




“Brilliantly crafted, brutally honest, and hilariously savage!”

— PRODUCTHUNT COMMENTER



The design and communiation style was inspired by the dev Youtube channel Fireship as well as general dev humor and meme-culture seen on 4chan.


  • Idea to launch: 1 month
  • Copy was initially also oneshotted (vibe coded) and adjusted by human
  • $150 in token costs with Vercel
  • Launch day: 5.5k visitors. 23.7% started the test and 11% got to the results page. 278 clicks to Scrimba ~ 5% CTR.
  • Scrimba traffic went up 14.5% 
  • Total 7000 visits, 750 clicked through to Scrimba, 170 signed up, $1700 in direct recorded subscription sales.



The "polish" ✨

  1. Home page: stats count up, hover effect on cards, brain emoji burst on hover of word "smoothbrained"
  2. Quiz: shaking Bail button with "quitter" tooltip, crying emoji burst when clicking skip button
  3. Results: confetti explosion with gravity, expandable "what you got wrong" section, downloadable image,
  4. Secret message: console message greeting the curious
  5. For long questions where the user has scrolled the page, they are automatically scrolled to the top for the next question
  6. Added top 10 Leaderboard for each level post launch (and Supabase integration for storing data) –  ppl can add their 3 letter name on results page to see if they qualify to get added.

Logic:
  1. Recommended courses are weighted based on performance in the category e.g. make mistakes on hardcore and you’ll be recommended courses from the lower levels (each level has a default of 3 recommended courses)
  2. Regex for code completion questions - not forcing user to write specific strings (thanks to my colleague Frode!).
  3. Dismissible notifications - if you're proceeding too fast and getting questions wrong.
  4. Questions are selected from four groupings of difficulty: easy, beginner, intermediate, hard and distributed to the level e.g. beginner has some easy questions, intermediate has some beginner questions.


CLIENT
Scrimba
ROLE
project lead,
development,
design, marketing
DELIVERABLES
Quiz website where people can take a test, GET ranked and receive course recommendations.
devatrophy.com


︎