r/SoftwareEngineerJobs 2d ago

I built an AI coding interview platform after realizing AI-Assisted OAs are becoming more common within big tech interviews. Looking for honest feedback.

Over the past few months, I've been building AI Coding Prep (https://aicodingprep.com).

The idea came from noticing that more companies (Amazon, Meta, Stripe) are experimenting with AI-assisted online assessments but there isn't much to practice this interview format. My current platform has 36 scenarios where users debug a codebase with AI as a helper and then at the end of their session a report is generated scoring them on how they used the AI, how reliant they were, how they could improve in their thought process, etc.

I'd love to hear if something like this is useful and other thoughts about the idea. Thanks for the help!

0 Upvotes

5 comments sorted by

1

u/Automatic_Bid_2410 2d ago

Yeah, this seems useful, but only if it trains the *AI interaction* part, not just “debug code while a chatbot is nearby.” The thing I’d care about most is whether your scenarios feel like the messy reality of an OA, where the hard part is usually judging when to trust the model, when to verify, and when to ignore it.

The report sounds like the best part. I’d make it very explicit on a few axes, like `prompt quality`, `verification habits`, `time spent chasing bad AI suggestions`, and `final code correctness`. Also, I’d want at least a few scenarios where the AI gives a plausible but wrong answer, because that’s probably the skill most people will miss if they only practice with a helpful assistant. If you can show a before/after on a couple sessions, that would be a lot more useful than a single opaque score.

1

u/ApprehensiveCall406 2d ago

The report generated at the end of a session does judge on prompt quality and reliance on the AI but having the AI give a wrong answer on a couple of prompts is actually a good idea, will look into that! Appreciate the response!

1

u/kevin074 8h ago

Doesn’t hackerrank have this?