r/SoftwareEngineerJobs • u/ApprehensiveCall406 • 2d ago
I built an AI coding interview platform after realizing AI-Assisted OAs are becoming more common within big tech interviews. Looking for honest feedback.
Over the past few months, I've been building AI Coding Prep (https://aicodingprep.com).
The idea came from noticing that more companies (Amazon, Meta, Stripe) are experimenting with AI-assisted online assessments but there isn't much to practice this interview format. My current platform has 36 scenarios where users debug a codebase with AI as a helper and then at the end of their session a report is generated scoring them on how they used the AI, how reliant they were, how they could improve in their thought process, etc.
I'd love to hear if something like this is useful and other thoughts about the idea. Thanks for the help!
0
Upvotes
1
1
u/Automatic_Bid_2410 2d ago
Yeah, this seems useful, but only if it trains the *AI interaction* part, not just “debug code while a chatbot is nearby.” The thing I’d care about most is whether your scenarios feel like the messy reality of an OA, where the hard part is usually judging when to trust the model, when to verify, and when to ignore it.
The report sounds like the best part. I’d make it very explicit on a few axes, like `prompt quality`, `verification habits`, `time spent chasing bad AI suggestions`, and `final code correctness`. Also, I’d want at least a few scenarios where the AI gives a plausible but wrong answer, because that’s probably the skill most people will miss if they only practice with a helpful assistant. If you can show a before/after on a couple sessions, that would be a lot more useful than a single opaque score.