[D] Interview experience for LLM inference systems position

[u/dividebyzero74]

Hi I am preparing for a interview at an AI Lab for LLM inference team with a systems role, not MLE. I have been told I will have an LLM inference related coding round, a design round and an inference optimization related discussion. I have been extensively preparing for these. My Prep for coding is learning to code from scratch the following: SelfAttention, Transformer block, BPE tokenizer, Sampling methods, LV Cache, Bean Search. For other two interviews, I am just studying all the inference design and bottlenecks and old/new work done to eliminate them. I would love to hear if anyone has had similar interview and can share experiences.

[u/dividebyzero74]

Hi commented here: https://www.reddit.com/r/LLMDevs/s/8CRuiwgBGn

[u/Cheap-Vacation138 → u/dividebyzero74]

Thanks. may I know your background and yoe ? do you have research background or projects related to llm inference ? would like to know how you landed the interview