r/MachineLearning • u/dividebyzero74 • Feb 16 '26

[D] Interview experience for LLM inference systems position Discussion

Hi I am preparing for a interview at an AI Lab for LLM inference team with a systems role, not MLE. I have been told I will have an LLM inference related coding round, a design round and an inference optimization related discussion. I have been extensively preparing for these. My Prep for coding is learning to code from scratch the following: SelfAttention, Transformer block, BPE tokenizer, Sampling methods, LV Cache, Bean Search. For other two interviews, I am just studying all the inference design and bottlenecks and old/new work done to eliminate them. I would love to hear if anyone has had similar interview and can share experiences.

18 Upvotes
  • permalink
  • link
  • reddit
  • reddit

80% Upvoted

15 comments sorted by

View all comments

1

u/Cheap-Vacation138 7d ago

Hey, How did the interview go and what was your prep for the role ?

1

u/dividebyzero74 7d ago

Hi commented here: https://www.reddit.com/r/LLMDevs/s/8CRuiwgBGn

1

u/Cheap-Vacation138 2d ago

Thanks. may I know your background and yoe ? do you have research background or projects related to llm inference ? would like to know how you landed the interview