27Databases will be provisioned by a Kubernetes Operator. What must the reconcile loop get right, and what when it cannot reach the API?▼expertRed HatOracleDatabricks○ sign inThe two ideas that decide whether an operator is safe are level-triggered reconciliation and finalizer semantics. The partition question separates people who have written a controller from people who have installed one.Open full answer →
38Walk me through what the kubelet does between PodScheduled and a running container. Why do nodes flap NotReady while pods keep serving?▼expert★ EssentialGoogleRed HatDatadog◆ premiumThe kubelet is a local reconcile loop with its own event stream, probe workers and eviction brain. The detail worth holding onto is that Ready status can reflect either a reported health failure or missing heartbeats, and those have different causes and different fixes.Open full answer →
44Your operator is the top API consumer and etcd is sweating. Explain informers, resourceVersion and the real cost of LIST.▼expert★ EssentialDatadogLinkedInUber◆ premiumRepeated full-resource polling can make an operator an expensive API client. This question separates people who run controllers at ten-thousand-object scale from those who copied a tutorial: watch semantics, cache behaviour, and which LISTs touch etcd.Open full answer →
20kubectl takes ten seconds, operator leader elections flap, and etcd fsync latency is the only red metric. What now?▼expertGoogleRed HatDatabricks○ sign inOne disk metric explaining a whole cluster's weirdness is the point of this question. Restarting etcd first turns a slow cluster into a down one, because a restarted member has to catch up before it can vote.Open full answer →
29After moving a shared directory onto NFS, app threads pile into D state and load average tops 50 while CPUs sit idle. Explain it.▼expert★ EssentialNVIDIAGoldman SachsJPMorgan Chase◆ premiumNFS waits can stall shutdown and inflate load average while CPUs stay idle. Check the blocked kernel path before deciding whether signals or mount recovery can release it.Open full answer →
42New connections to one partner API fail at peak, only through the NAT gateway, while established flows sail on. What is the ceiling?▼expertAmazon & AWSMicrosoftStripe◆ premiumBandwidth graphs look healthy and the partner swears they are fine. The wall is ports, not bits: the available source-port budget depends on the gateway and its address allocation.Open full answer →
40Your platform is connecting agents to internal tools through MCP servers. How do you handle identity and authorisation?▼expertMicrosoftCloudflareGitLab2 notes & comments◆ premiumAn agent is a workload that acts on behalf of a person, holds credentials for several systems, and decides what to call based on text it read. Every one of those properties breaks an assumption in your existing access model.Open full answer →
41A model's output feeds a shell command, a SQL query and a web page. What is your threat model?▼expertCloudflareGitHubMicrosoft2 notes & comments◆ premiumModel output is attacker-influenced data by construction, because the model reads attacker-influenced input. Every rule you already apply to user input applies here, and teams forget because the text came from a system they built.Open full answer →
08Design an authentication service for 100,000 QPS across three regions: 2KB payloads, 10ms processing, 16-core VMs. Do the math out loud.▼expert★ EssentialGoogleMetaAmazon & AWSunlockedThe Google-style NALSD round in miniature. The boxes are easy; what is being scored is whether the numbers fall out of Little's law before you draw them.Open full answer →
29Two pods both believed they held the lock, so the nightly job ran twice. Design locking that survives stalls, pauses, and clock lies.▼expert★ EssentialHashiCorpUberCloudflare◆ premiumLeases prevent dead holders but not overlapping ones. The staff-level answer is fencing tokens and a candid account of why quorum lock services without downstream checks are still probabilistic.Open full answer →
38Design real-time collaborative editing for documents. Where does operational transform win, and where does CRDT?▼expertAtlassianGoogleMicrosoft◆ premiumReciting both acronyms is the median answer. Expert level chooses by connectivity assumptions and undo semantics, then defends CRDT metadata growth with numbers.Open full answer →
41Design the platform that decides whether a model change is safe to ship, for twenty teams shipping weekly.▼expertDatabricksMicrosoftSalesforce2 notes & comments◆ premiumTeams need comparable evaluations before they approve a model change. Design versioned test data, recorded runs and release thresholds that a pipeline can enforce.Open full answer →
42Design log search for four hundred services and fifty teams, at ten terabytes a day.▼expertDatadogElasticSnowflake2 notes & comments◆ premiumThe hard parts are not search. They are deciding what to keep before you pay to store it, isolating one team's query from everyone else's, and making the cost visible to the people generating it.Open full answer →
43Forty teams want to call models. Design the gateway that sits between them and the providers.▼expertStripeSalesforceAtlassian2 notes & comments◆ premiumWithout one, every team implements its own retries, its own key handling, its own logging policy, and nobody can answer what the company spends or what a model change would break.Open full answer →
10Training throughput is 40 percent below what the GPU count predicts. The GPUs look fine. Where do you look?▼expertNVIDIAMetaMicrosoft2 notes & commentsunlockedAt sixteen GPUs and above, the network is the computer. Collectives run at the speed of the worst link in the group, and placement decides which link that is.Open full answer →
16How is rolling out a new model different from rolling out new code, and what does a model canary actually measure?▼expertMetaGoogleDatabricksunlockedCode rollouts ask 'does it work'; model rollouts ask 'is it better', and the second question has no HTTP status code. Shadow traffic, offline eval gates and quality canaries replace the 500-rate dashboards you cannot use.Open full answer →
17You have eight 80GB GPUs and a 70B model. Tensor parallel across all eight, or two replicas of four? Defend the choice.▼expertNVIDIADatabricksMeta2 notes & commentsunlockedBoth configurations fit the weights. Compare cache capacity, collective overhead and replica placement under the actual traffic shape; neither layout wins every workload.Open full answer →
22Long prompts are making short requests slow on the same replica. What is happening, and how would you fix it?▼expertNVIDIADatabricksMicrosoft2 notes & comments○ sign inPrefill and decode are two different workloads sharing one GPU. Their resource demands differ, and an unchunked long prefill can delay active decodes. Profile the actual model and batch shape before choosing a scheduling change.Open full answer →
25Speculative decoding promises a big latency win. When does it not deliver, and what does it cost you?▼expertNVIDIADatabricksMicrosoft2 notes & comments○ sign inIt trades compute for latency, so it wins on an underloaded fleet and can lose on a saturated one. The acceptance rate decides everything, and the acceptance rate depends on traffic you do not control.Open full answer →
32How do you detect that a model in production got worse, when nothing in your infrastructure metrics changed?▼expertDatabricksDatadogMicrosoft2 notes & comments◆ premiumLatency is flat, errors are zero, and the answers are worse. Quality regression is invisible to every metric a platform team normally owns, which is why it needs its own pipeline.Open full answer →
37At 512 GPUs something fails every few hours. How does a training run survive that?▼expertNVIDIAMetaMicrosoft2 notes & comments◆ premiumFailure stops being an event and becomes a rate. Once mean time between failures drops below the length of a run, the design question is not how to avoid interruption but how cheaply you can absorb one.Open full answer →
43A coding agent runs in CI and reads pull request descriptions. An attacker opens a PR. What is the attack, and what stops it?▼expertGitHubGitLabCloudflare2 notes & comments◆ premiumUntrusted text reaching a privileged agent is the whole vulnerability. It is the pull_request_target mistake again, with a model in the middle that will follow instructions it finds in the data.Open full answer →
53A customer asks what stops their prompts from reaching another tenant on your inference platform. What is your answer?▼expertSalesforceSnowflakeMicrosoft2 notes & comments◆ premiumShared batching puts two tenants' data in one process on one device. That is defensible, and it is not what most customers assume they bought, so the answer has to be specific about which boundary exists where.Open full answer →