AI Interview Handbook
CHAPTER 01FOUNDATION

The Preparation Strategy

Build a senior-level positioning system: measurable stories, proof artifacts, deliberate practice, and role-specific preparation.

29 min read Interview drills

Learning objectives

By the end of this chapter, you should be able to:

  • Turn a senior GenAI job description — Bedrock, Vertex AI, RAG, agents, evals, LLMOps — into a ranked preparation backlog instead of studying the whole AI field.
  • Decode recurring GenAI JD language into the hiring signal behind it, and map every signal to honest evidence, a gap-closing artifact, or an explicit learning plan.
  • Prioritize preparation work on an effort-versus-signal grid, and defend why eval harnesses and cost models beat certificate cramming.
  • Assemble a five-artifact GenAI proof stack — eval harness, RAG benchmark, guarded agent demo, inference-cost analysis, and a two-cloud reference build.
  • Construct senior answers that connect requirements, design choices, failure modes, token economics, operations, and outcomes.
  • Run a weekly preparation cadence with timed rehearsal across design, coding, troubleshooting, behavioral, and written formats.
  • Calibrate every claim and example metric so no practice result is ever presented as personal production experience.

1. Preparation is evidence selection

This book is deliberately not a survey of artificial intelligence. It is a conversion plan: turn existing production-engineering competence into evidence for Senior GenAI, AI Platform, GenAI Solutions Architect, and Forward Deployed interviews on AWS and GCP. The highest-return work is therefore not memorizing more model names. It is choosing which claims you want an interviewer to believe and constructing honest, inspectable support for each claim.

Use a three-layer model. A signal is what the role needs to infer — for example, "can decide whether a RAG change is safe to ship" or "can keep an agent's blast radius bounded." Evidence is what makes that inference reasonable — an eval harness with a CI gate, a retrieval benchmark, an incident analysis, a cost model, or an accurately described past decision. A delivery is how the evidence appears in the interview: a two-minute story, a whiteboard design, a working repository, or a written memo. Weak preparation jumps from a topic name straight to a rehearsed explanation. Strong preparation joins all three layers and lets feedback flow backwards.

Figure 1 The evidence loop: signals drive artifacts, deliveries generate feedback, feedback re-ranks the backlog
flowchart LR
  JD["Live GenAI job description"] --> SIG["Required hiring signal"]
  SIG --> EV["Proof artifact (honest, inspectable)"]
  EV --> DEL["Interview delivery (story, design, repo, memo)"]
  DEL --> FB["Feedback and exposed gaps"]
  FB --> SIG
    

The five-part readiness test

For every priority topic, ask whether you can pass all five tests below. A topic is not interview-ready until each is plausible. This kills the common illusion that reading Bedrock or Vertex documentation equals being able to reason in a live system-design conversation.

  • Define — state the concept precisely, including its unit of measure (recall@k, p95 TTFT, cost per successful task).
  • Design — place it in an architecture under stated quality, latency, cost, and security constraints.
  • Implement — build a small honest version: a harness, a benchmark, a guarded tool call.
  • Debug — inject a deliberate failure (bad chunking, poisoned tool output, judge drift) and diagnose it out loud.
  • Defend — argue one consequential trade-off and name the reversal condition that would change your mind.

2. Decode the job description into a signal matrix

GenAI job descriptions in 2026 are keyword-dense but highly decodable. "Hands-on with Amazon Bedrock," "productionize LLM applications on Vertex AI," "design agentic workflows," and "establish evaluation frameworks" are not synonyms — each phrase encodes a different question the interview loop must resolve. Extract the verbs and objects from two or three live postings, then build the matrix below before you study anything. Re-check postings at application time; GenAI requirements drift quarter to quarter.

JD phrase (verbatim pattern)Question the interviewer is resolvingBest evidence formWeak substituteDeep dive
"Hands-on with Amazon Bedrock / Vertex AI"Can they make model-selection, throughput, guardrail, and cost decisions on a managed platform, not just call an API?Two-cloud reference build with a decision memo on model choice, pricing mode, and quotasConsole screenshots or a certification badge aloneCh. 08–09
"Production RAG / grounded generation"Can they diagnose retrieval quality and latency separately from generation quality?Golden question set, hybrid-versus-dense benchmark with nDCG/recall and p95 latency, chunking ablationA framework quickstart that answers five demo questionsCh. 04
"Design agentic workflows / multi-step automation"Can they bound autonomy: idempotent tools, approval boundaries, recovery from partial failure?Agent demo with an explicit state machine, guardrails, budget caps, and a replayed failure transcriptA happy-path chatbot that calls one toolCh. 05
"Establish evaluation frameworks / LLM quality"Can they decide whether a change is safe to ship?Versioned eval set, LLM-judge calibrated against human labels, slice analysis, CI gate that has actually blocked a changeOne aggregate "accuracy" number from a leaderboardCh. 06
"LLMOps / observability / reliability"Can they operate model-backed systems like production software?Traces with token-level spans, drift and safety alarms, rollback plan, runbook, SLOsAn architecture diagram with no failure pathCh. 11
"Optimize inference cost / scale efficiently"Do they reason in dollars per successful task, not tokens per request?Cost model comparing on-demand tokens, provisioned throughput, caching, and model routing, with a stated denominator"We switched to a cheaper model"Ch. 02
"Fine-tuning / PEFT / model adaptation"Do they know when adaptation beats prompting and RAG — and when it does not?Adaptation decision memo plus a small LoRA run with a before/after eval delta and cost accountingName-dropping LoRA and QLoRACh. 03
"Customer-facing / forward deployed / solutions"Can they turn customer ambiguity into a safe, phased rollout that shows value early?Discovery memo, assumptions log, pilot plan with adoption metrics and stop conditionsA premature product pitchCh. 12

Label the evidence honestly

Mark each cell experienced, built for practice, understood but not operated, or gap. Those labels are valuable in the room. A credible statement such as "I have not operated Bedrock provisioned throughput at enterprise scale; here is the cost model and load test I built to learn the trade-offs" is stronger than an inflated production claim — and it survives follow-up probes, which inflated claims never do. Never present a tutorial metric, a synthetic benchmark, a team result, or a hypothetical design as your personal production outcome.

3. The 16-chapter curriculum as a preparation map

The rest of this handbook is organized so that the signal matrix above has a place to send you. Do not read it linearly like a textbook. Anchor on the chapters your matrix flags as high-frequency and weak-evidence; treat the others as reference material with a small breadth budget. The mindmap below is the territory; your matrix is the route.

Figure 2 The 16-chapter curriculum grouped as a preparation map — anchor where your evidence gap is largest
mindmap
  root(("GenAI prep map"))
    Foundations
      02 LLM internals and serving
      03 Prompting and adaptation
    Applications
      04 Retrieval and production RAG
      05 Agentic systems
      06 Evaluation and quality
    Platform
      07 Enterprise integration
      10 Data and cloud platform
      11 LLMOps and security
    Clouds
      08 AWS Bedrock and SageMaker
      09 GCP Vertex AI and Gemini
    Synthesis
      12 System design and FDE
      13 Leadership and coding
    Execution
      14 Role to topic map
      15 Twelve week sequence
      16 References and readiness
    

A useful traversal for most senior GenAI loops follows the spine below: decode signals first, refresh only the foundations those signals need, build artifacts in the application chapters, map them onto both clouds, then rehearse synthesis. Chapter 15 turns this spine into a full 12-week execution sequence, so this chapter deliberately stays at the strategy layer.

4. Prioritize by effort versus hiring signal

Preparation time is the scarce resource, so manage it as a portfolio. Score each candidate activity on two axes: how much build effort it demands, and how much hiring signal it generates for your target roles. The quadrant chart below positions the artifacts this chapter recommends against common low-signal temptations. Positions are judgments to be re-derived from your own matrix, not universal constants.

Figure 3 Effort versus hiring signal for candidate preparation investments (positions are illustrative defaults)
quadrantChart
  title Effort versus hiring signal
  x-axis Low build effort --> High build effort
  y-axis Low hiring signal --> High hiring signal
  quadrant-1 Flagship bets
  quadrant-2 Quick wins
  quadrant-3 Parking lot
  quadrant-4 Money pits
  Eval harness with CI gate: [0.55, 0.92]
  RAG benchmark report: [0.45, 0.85]
  Guarded agent demo: [0.68, 0.8]
  Inference cost model: [0.28, 0.75]
  Two cloud reference build: [0.82, 0.72]
  Story ledger rewrite: [0.2, 0.62]
  Leaderboard trivia tracking: [0.15, 0.12]
  Pretraining an LLM from scratch: [0.92, 0.18]
  Certificate cramming: [0.55, 0.28]
    

To turn the picture into a schedule, use a deliberately simple priority product. Its purpose is to expose opportunity cost, not to be precise: if a role repeatedly mentions Bedrock, RAG quality, and evaluation, another evening on pretraining mathematics is a poor trade unless the posting explicitly asks for it.

priority(topic) = role_frequency × evidence_gap × interview_urgency

# Example only: each factor scored 1 (low) to 3 (high)
evals_and_rag_quality = 3 × 2 × 3 = 18
agent_guardrails      = 2 × 3 × 2 = 12
pretraining_theory    = 1 × 2 × 1 = 2
Figure 4 A default effort allocation for senior GenAI loops — rebalance with your own matrix before adopting it
pie title Default preparation weights in percent
  "Retrieval and production RAG" : 15
  "Evaluation and quality" : 15
  "Cloud stacks AWS and GCP" : 15
  "System design and FDE" : 15
  "Agentic systems" : 10
  "Serving and token economics" : 10
  "LLMOps and security" : 10
  "Leadership and coding" : 10
    

Deepen

Pick one or two recurring, high-value skills where you already have foundation — for most 2026 GenAI loops, evaluation and retrieval quality are the prime candidates because they anchor every ship decision.

Repair

Pick the risk that can sink a loop outright: vague token-economics reasoning, no agent failure story, weak SQL, or no answer to "how did you know it was safe to ship?" Practise it in small, timed units.

Maintain

Keep existing strengths fluent through spaced recall. Do not rebuild familiar Python, FastAPI, or core cloud networking from zero; those are covered as refreshers in Chapters 07 and 10.

Defer

Record fascinating but low-signal topics — new model gossip, exotic architectures — in a dated parking lot with a revisit trigger. Deferral is a strategy decision, not a value judgment.

5. The GenAI proof stack: five artifacts, one scenario

A proof stack is a small set of artifacts that covers many signals without becoming a portfolio museum. The efficient move is to build all five artifacts around one shared scenario — for example, an enterprise document assistant with retrieval, tool use, and strict tenancy rules. The shared scenario lets you reason deeply in any interview instead of maintaining unrelated demos, and every artifact feeds the same evidence dossier.

Figure 5 The five-artifact GenAI proof stack, all derived from one shared scenario and feeding one dossier
flowchart TD
  SCN["Shared scenario (enterprise doc assistant)"] --> EVH["Eval harness with CI gate"]
  SCN --> RAGB["RAG benchmark (hybrid vs dense)"]
  SCN --> AGD["Agent demo with guardrails"]
  SCN --> COST["Inference cost analysis"]
  SCN --> REF["Two-cloud reference build"]
  EVH --> DOSS["Evidence dossier + design memos"]
  RAGB --> DOSS
  AGD --> DOSS
  COST --> DOSS
  REF --> DOSS
    
ArtifactSignals it coversCore metrics it must carryBuilt in
Eval harness — versioned dataset, LLM-judge calibrated against your own human labels (see Zheng et al., LLM-as-a-Judge), CI gateEvaluation judgment, ship/no-ship discipline, LLMOpsTask success rate with slices, judge–human agreement, gate pass/fail historyCh. 06
RAG benchmark — golden set, chunking and hybrid-retrieval ablations over the classic retrieval-augmented pattern (Lewis et al.)Retrieval depth, grounded-generation qualityRecall@k, nDCG@10, faithfulness, p95 retrieval latencyCh. 04
Agent demo with guardrails — explicit state machine, idempotent tools, budget caps, approval boundary, replayable failure transcript (patterns in Anthropic's building-effective-agents guidance)Agent reliability, bounded autonomy, safetyTask completion rate, tool-error recovery rate, guardrail-violation countCh. 05
Inference-cost analysis — tokens × price versus provisioned throughput versus caching and routing, expressed per successful taskToken economics, FinOps credibilityCost per successful task, cache hit rate, break-even utilization for provisioned capacityCh. 02
Cloud reference build — the same scenario deployed thin on both clouds with IAM, logging, and a rollback pathPlatform ownership, AWS and GCP fluencyDeployment reproducibility, p95 end-to-end latency, monthly cost estimateCh. 08–09

AWS

  • Amazon Bedrockmanaged FM inference, guardrails, agents
  • Bedrock Knowledge Basesmanaged RAG over your corpus
  • OpenSearch Serverlessvector plus keyword hybrid retrieval
  • Lambda + API Gatewayserving glue and tool endpoints
  • CloudWatch + Cost Explorertraces, alarms, token spend

Google Cloud

  • Vertex AIGemini models, Model Garden, tuning
  • Vertex AI Search / RAG Enginemanaged grounding and retrieval
  • Vertex AI Vector SearchANN retrieval at scale
  • Cloud Runserving glue and tool endpoints
  • Cloud Monitoring + BigQuerytraces, alarms, spend analysis

Keep a story ledger beside the artifact stack

Artifacts prove capability; the story ledger proves experience. For every real story, record: situation and stakes; exact personal responsibility; collaborators; the alternatives considered; the action; the observable result; what you would change; and which claims need qualification. Replace confidential names and values only when necessary, and say that values are rounded or anonymized. If you lack a metric, state what was observed and what you would measure now — never reverse-engineer an impressive number.

6. Answer at senior scope

Senior answers reveal a decision process. Begin by locating the goal, users, risk, and constraints. Establish a simple baseline. Decompose the system and make boundaries explicit. Compare alternatives against criteria. Cover failure, security, rollout, observability, and ownership. Close with validation and what would change your mind. The same sequence works in GenAI system design, troubleshooting, project deep dives, and customer discovery — Chapter 12 drills it against full design prompts.

Figure 6 The senior answer sequence — every stage is a chance to show judgment, not coverage
flowchart LR
  G["Goal, users, risk"] --> C["Constraints (quality, latency, cost, privacy)"]
  C --> B["Smallest credible baseline"]
  B --> T["Alternatives and trade-offs"]
  T --> F["Failure modes and security"]
  F --> R["Rollout and ownership"]
  R --> M["Measurement and reversal conditions"]
    

Separate facts, assumptions, and decisions

Say "the requirement states," "I am assuming," and "I would choose" rather than blending all three. Ask a small number of high-value clarifying questions, then proceed with declared assumptions. In a 45-minute design session, exhaustive discovery is impossible; the signal is whether your assumptions are consequential and whether the design can absorb being wrong about them.

Make influence observable

Staff-level influence is a mechanism, not a title: you wrote an options memo, instrumented a disputed bottleneck, ran the eval that settled a model-choice argument, created an adoption path, mentored an owner, or changed a standard. Explain the resistance and how feedback altered the plan. "I convinced everyone" is weaker than a transparent decision process that let reasonable people converge. Chapter 13 covers the delivery mechanics.

7. The preparation operating cadence

Preparation needs short feedback loops, and GenAI preparation needs them more than most because the vendor surface moves monthly while the underlying judgment moves slowly. Run a weekly cycle that always ends in deliverables — an artifact increment, a recorded mock, a rewritten story — never in "hours studied."

  1. Monday — diagnoseRe-scan two live postings; re-rank the backlog with the priority product; pick the week's one artifact increment and one repair item.
  2. Tuesday–Thursday — buildDeep-work blocks on the proof stack: extend the eval harness, run one benchmark ablation, harden one agent tool, or update the cost model with current published pricing.
  3. Friday — rehearseOne timed mock in a rotating format: design, coding, troubleshooting, behavioral, or a written memo. Record it.
  4. Weekend — review and updateScore the recording against a rubric; extract one or two observable corrections; update the signal matrix, story ledger, and parking lot.
5artifacts in the proof stack — one shared scenario
1 in 5practice blocks spent on timed, mixed rehearsal
2 cloudsevery artifact mapped to both Bedrock and Vertex AI
0tolerated unqualified claims in any delivery
FormatWhat to practiseEvidence to captureUseful review question
GenAI system designAmbiguity, scale, retrieval and model choice, guardrails, rolloutFinal diagram and decision logDid constraints actually drive the architecture?
Technical deep diveOne real or practice system, including a failureRecording, claim ledger, missing-detail listDid I distinguish my work from the team's?
CodingCorrectness, tests, streaming and async patterns, complexityTimed solution and post-review patchDid I validate edge cases before optimizing?
TroubleshootingHypotheses, instrumentation, isolating retrieval vs generation vs infraIncident timeline and next experimentDid I change one variable at a time?
BehavioralOwnership, conflict, failure, influence mechanismTwo-minute and six-minute versionsWas the action mechanism concrete?
Written memoConcise asynchronous decision-makingOne page with a requested decisionCan a reader act without a meeting?

Use a stop-doing list

  • Stop adding notes once a topic passes the five-part readiness test; move to the next gap.
  • Stop polishing demo UX while the artifact lacks a baseline and a metric definition.
  • Stop tracking weekly model-release gossip unless a target role requires vendor-frontier depth; log it in the parking lot instead.
  • Stop rehearsing only successful stories — failure analysis is where operational judgment becomes visible.

8. Make every outcome measurable

Senior GenAI interviews repeatedly probe evidence across quality, latency, cost, safety, reliability, and customer impact. Treat these as a balanced evidence set rather than quoting whichever number looks best. Each dimension has a defensible form and a weak substitute, and interviewers are well calibrated to the difference. The AWS Well-Architected Generative AI Lens uses essentially this decomposition for production reviews, which makes it a useful shared vocabulary in AWS-facing loops.

DimensionDefensible evidenceWeak substitute
QualityVersioned task set, metric definition, slices, baseline, judge calibrationOne impressive response
Latencyp50/p95/p99 TTFT and end-to-end at stated concurrency and boundaryAn unqualified average
CostProvider plus platform cost per successful task, with cache and routing effectsToken count alone
SafetyGuardrail-violation rate on an adversarial set, escalation path, audit trail"We enabled the guardrail feature"
ReliabilityAvailability or successful-task SLI over a declared window, with rollback evidence"It was stable"
Customer impactAdoption, time saved, error reduction, or business result with provenanceFeature shipped

If exact production values are confidential, use approved ranges or explain the measurement method and direction. Never invent precision. The senior signal is the causal chain from decision to measurable outcome — and an honest account of confounders.

Interview playbook

Use the CONTEXT answer frame when a question is broad:

  1. C — Customer and consequence: who needs what, and what happens if the system is wrong, unsafe, or late?
  2. O — Objectives and constraints: define quality, latency, cost per task, privacy, scale, and timeline.
  3. N — Narrow baseline: the smallest system that tests the value proposition — often managed RAG before custom anything.
  4. T — Trade-offs and topology: draw boundaries, compare alternatives (managed versus custom, prompt versus tune, single model versus router), justify the choice.
  5. E — Exceptions: dependency failure, bad retrieval, prompt injection, abusive input, partial agent completion.
  6. X — eXecution: sequencing, ownership, migration, approvals, and communication.
  7. T — Tests and telemetry: eval gates, SLOs, guardrail monitoring, feedback loops, and reversal conditions.

Common traps

  • Model-first: naming a model, vector database, or agent framework before defining the problem and constraints.
  • Unbounded "we": making team output sound like personal implementation. State your role explicitly.
  • Metric theater: quoting an eval score without dataset, denominator, baseline, judge calibration, or business meaning.
  • Perfect hindsight: omitting uncertainty, disagreement, or what changed during delivery.
  • Demo scope: ignoring authorization, tenant isolation, retries, evaluation, rollout, or on-call ownership.
  • Vendor recital: listing Bedrock or Vertex features instead of criteria, measurement, and failure behavior.

For experience questions, use Situation → Stakes → My responsibility → Options → Action → Result → Reflection. If a result is qualitative, keep it qualitative. If discussing a portfolio exercise, label it as such before presenting any numbers.

Question bank

Practise aloud. Each answer should use evidence appropriate to its claim and should survive the probes without invented detail.

Q1Why does your preparation prioritize evaluation and retrieval over foundation-model training?

Strong answer outline

  1. Anchor to recurring responsibilities in live senior GenAI postings: ship decisions, RAG quality, platform operations — not pretraining.
  2. Explain comparative advantage: production engineering background converts fastest into eval and retrieval evidence.
  3. Describe the opportunity cost and a small breadth budget for serving internals (Chapter 02) so model reasoning stays credible.

Follow-up probes

  • What job-description change would make you rebalance?
  • What concrete artifact will the prioritized time produce?
Self-check

Pass if the answer connects role frequency, honest evidence gaps, and a named deliverable; fail if it dismisses model fundamentals categorically.

Q2Walk me through how you would decode a GenAI job description into a study plan.

Strong answer outline

  1. Extract verbs and objects — "operate," "evaluate," "advise," "Bedrock," "agentic" — from two or three live postings.
  2. Map each phrase to the hiring signal behind it and label current evidence: experienced, practiced, understood, or gap.
  3. Rank by role frequency × evidence gap × urgency; commit to weekly deliverables, not hours.

Follow-up probes

  • Show me one real phrase you decoded and what it changed.
  • What did you explicitly defer, and what is the revisit trigger?
Self-check

Pass if a real opportunity-cost decision is named; fail if the plan is "cover everything important."

Q3What counts as proof of production-RAG competence?

Strong answer outline

  1. Name four layers: code proof, decision proof (ADR), measurement proof (golden set, ablations), operations proof (traces, rollback).
  2. Separate retrieval metrics (recall@k, nDCG) from generation metrics (faithfulness, task success) and system metrics (p95, cost per task).
  3. Include a failure injection — bad chunking or index drift — and the degradation path.

Follow-up probes

  • Which artifact would you show first and why?
  • What can a small portfolio project not prove?
Self-check

Pass if limitations are explicit and the artifact is inspectable; fail if a screenshot of a good answer is treated as production evidence.

Q4You have more depth on one cloud than the other. The role is on the weaker cloud. How do you prepare and how do you answer?

Strong answer outline

  1. State that platform judgment transfers: managed FM inference, vector retrieval, IAM boundaries, and observability exist on both clouds.
  2. Show the mapping concretely — Bedrock ↔ Vertex AI, Knowledge Bases ↔ Vertex AI Search, OpenSearch ↔ Vector Search — and where the mapping breaks (pricing modes, quota models, guardrail features).
  3. Present the two-cloud reference build as the gap-closing artifact and name what you still have not operated.

Follow-up probes

  • Which service pair has the most misleading equivalence?
  • What would you validate in your first week on the weaker cloud?
Self-check

Pass if transfer is argued mechanism-by-mechanism with honest gaps; fail if the answer is "clouds are basically the same."

Q5How do you present a benchmark without overstating it?

Strong answer outline

  1. Label the environment: production, anonymized production, or synthetic practice.
  2. State corpus, queries, judgment provenance, metric, baseline, hardware, and run conditions.
  3. Show trade-offs, variance across runs, limitations, and the next test needed before a real decision.

Follow-up probes

  • Is the gain statistically or just numerically visible?
  • Could there be leakage between your golden set and your tuning loop?
Self-check

Pass if another engineer could interpret and challenge the result; fail if only a favorable percentage survives retelling.

Q6Which single proof artifact would you build first for these roles, and why?

Strong answer outline

  1. Argue for the eval harness: it is the artifact every other artifact depends on for credibility — benchmarks, agent claims, and cost trade-offs all need a quality denominator.
  2. Describe its parts: versioned dataset, calibrated judge, slices, CI gate, and a change it actually blocked.
  3. Show how it compounds: the RAG benchmark and agent demo reuse the same harness.

Follow-up probes

  • How do you know your LLM judge is trustworthy?
  • What would make you build the cost model first instead?
Self-check

Pass if the choice is justified by dependency structure, not fashion; fail if the answer is "the most impressive demo."

Q7You have never run Bedrock Agents or Vertex AI Agent Builder in production. The JD asks for agentic experience. How do you answer?

Strong answer outline

  1. Say so directly, then separate transferable agent engineering — state machines, idempotent tools, budgets, approval boundaries — from vendor-specific operations.
  2. Present the guarded agent demo: injected tool failure, replayed transcript, guardrail-violation count.
  3. Name the operating claims you cannot make (quota behavior at scale, real user abuse patterns) and how you would validate them.

Follow-up probes

  • Which agent failure mode worries you most in production?
  • What would you test in week one with real tenant data?
Self-check

Pass if honesty is paired with relevant depth and a learning plan; fail if a demo is relabeled as production ownership.

Q8How do you prepare for an ambiguous GenAI system-design prompt?

Strong answer outline

  1. Identify user, value, scale, quality bar, latency budget, cost ceiling, privacy, and failure consequence.
  2. Ask only the questions that materially change the design, then declare assumptions and proceed.
  3. Start with a managed baseline, evolve it at pressure points, and reserve time for guardrails, rollout, and measurement.

Follow-up probes

  • Which assumption in your last mock was most dangerous?
  • How would your design change at ten times the traffic — or one tenth the budget?
Self-check

Pass if ambiguity becomes explicit decisions; fail if questioning consumes the session or everything is silently assumed.

Q9How do you choose metrics for a GenAI proof artifact?

Strong answer outline

  1. Trace user value to component metrics: retrieval quality, generation faithfulness, guardrail violations, latency percentiles, cost per successful task.
  2. Always pair a primary metric with a counter-metric — quality with latency, cost with success rate.
  3. Define slices and acceptance thresholds before running the favored variant.

Follow-up probes

  • Which of your metrics can be gamed, and how?
  • What is the denominator of "cost per successful task" in your artifact?
Self-check

Pass if metrics have definitions and decision consequences; fail if a dashboard is mistaken for a quality model.

Q10Show me how you reason about token economics for a workload.

Strong answer outline

  1. Start from traffic shape: requests per day, input/output token distribution, cacheable prefix share, latency tolerance.
  2. Compare on-demand per-token pricing, batch, and provisioned throughput on both clouds; compute the utilization break-even, citing current published pricing rather than memory.
  3. Add levers in order of leverage: prompt and context reduction, caching, model routing, then capacity commitments — each with its quality counter-metric.

Follow-up probes

  • When does provisioned throughput lose to on-demand despite high volume?
  • How does an aggressive router protect quality?
Self-check

Pass if the unit of analysis is dollars per successful task with stated assumptions; fail if the answer is a cheaper-model reflex. Depth lives in Chapter 02.

Q11Models and vendor features change monthly. How do you keep preparation current without chasing news?

Strong answer outline

  1. Split knowledge into durable (retrieval math, eval design, failure modes, cost reasoning) and volatile (model names, prices, feature flags).
  2. Invest build time in durable artifacts; refresh volatile facts from primary docs in a short weekly slot, just before interviews.
  3. Keep a parking lot with revisit triggers so novelty does not hijack the backlog.

Follow-up probes

  • Name one durable principle that survived the last two model generations.
  • What volatile fact did you re-check this week?
Self-check

Pass if the durable/volatile split is explicit and primary sources are named; fail if currency means reading headlines.

Q12What makes a GenAI project story senior rather than merely trendy?

Strong answer outline

  1. Frame the consequential decision and its uncertainty — model choice, managed versus custom, ship gate — not the novelty of the stack.
  2. Clarify personal ownership, alternatives, stakeholder influence, and operational follow-through after launch.
  3. State result and reflection, including a decision you would now revise.

Follow-up probes

  • Who disagreed with the decision and why?
  • Who operated the system after launch, and what paged them?
Self-check

Pass if the story reveals judgment and leverage; fail if seniority is implied by using this year's tools.

Q13What should you do when a mock interview goes badly?

Strong answer outline

  1. Separate knowledge gaps from delivery, structure, and time-management failures — they need different fixes.
  2. Choose one observable behavior correction and one technical correction; write both down.
  3. Re-answer the same prompt after a delay and compare against the rubric.

Follow-up probes

  • What evidence would show the correction worked?
  • When do you seek external critique instead of self-review?
Self-check

Pass if feedback becomes a testable change; fail if the response is simply more reading or more unrelated mocks.

Q14Give your two-minute positioning for a Senior GenAI or Forward Deployed role.

Strong answer outline

  1. State the production problem class you solve — for example, taking LLM applications from demo to operated, evaluated, cost-bounded systems — without inflating title or scope.
  2. Select two or three substantiated strengths matched to this role's signals, each backed by an artifact or a real story.
  3. Name the ownership you are seeking and bridge to one evidence-rich example the interviewer can pull on.

Follow-up probes

  • Why this role rather than a research or foundation-model role?
  • Which of your claims should we investigate first?
Self-check

Pass if every sentence can lead to concrete evidence and fits in two minutes; fail if it is a biography, a tool list, or an unsupported superlative.

Proof artifact: the GenAI evidence dossier

Create a version-controlled dossier that maps one target role to inspectable proof across the five-artifact stack. This artifact tests preparation discipline; it is not a claim about Purnendu's past outcomes, and its README must say so.

Build steps

  1. Save a dated copy or structured summary of one live senior GenAI job description. Extract no more than ten decision-relevant signals using the matrix format from Section 2.
  2. Create the matrix with columns for signal, importance, evidence label, artifact or story, limitation, and next action. Commit it so the history shows re-ranking over time.
  3. Stand up the shared scenario thin: a small document corpus, an eval set of 100–200 questions with labels, and a baseline RAG pipeline on one cloud's managed path (Bedrock Knowledge Bases or Vertex AI Search).
  4. Add the five artifacts incrementally: eval harness with a CI gate; hybrid-versus-dense RAG benchmark; agent demo with guardrails and a replayable failure; inference-cost model using current published Bedrock and Vertex pricing; and the second-cloud mirror of the reference build.
  5. Write six real-experience story cards. Record exact personal scope and mark every number as exact, rounded/anonymized, or unavailable.
  6. Record a 45-minute design mock and a two-minute positioning statement. Score both with the same rubric, then repeat one week later.
  7. Publish a README covering reproducibility, secrets and privacy boundaries, current pricing-check dates, and what the practice system does not prove.

Metrics to capture

  • Coverage: percentage of top signals with at least one inspectable proof; report gaps separately rather than hiding them in an average.
  • Readiness: count of topics passing all five tests — define, design, implement, debug, defend.
  • Artifact quality: each artifact carries its core metrics from the Section 5 table, with baselines and counter-metrics.
  • Delivery: rubric scores for framing, assumptions, trade-offs, failure handling, measurement, and clarity across recorded mocks.
  • Claim hygiene: number of unqualified "we" statements, unsupported metrics, or practice results phrased as experience. Target zero.
  • Cadence: planned versus completed weekly deliverables, not passive study hours.

Deliberate failure injection

Three injections, one lesson each. First, remove the baseline and dataset description from the RAG benchmark report and ask a reviewer to interpret the claimed gain; it should become non-actionable, demonstrating why measurement provenance is engineering quality. Second, disable one guardrail in the agent demo, replay the failure transcript, and document the blast radius and the recovery path. Third, delete the denominator from the cost model — present "monthly spend" without "per successful task" — and note how the number stops supporting any decision. Restore each and record the difference.

What to present

Present the one-page signal matrix first, then one proof chain end to end: role need → decision → artifact → metric → injected failure → lesson. Use example numbers only if clearly labeled as hypothetical or portfolio measurements. Keep the complete repository available, but do not force an interviewer through every file.

Chapter review

Interview preparation for senior GenAI roles is a constrained engineering program. Decode live JD language into hiring signals, allocate effort by evidence gap on the effort-versus-signal grid, build a five-artifact proof stack around one shared scenario mapped to both Bedrock and Vertex AI, rehearse senior decision-making on a weekly cadence, and keep every claim honestly labeled. The goal is not to sound universally expert. It is to make relevant, honest competence easy to verify.

Glossary

Hiring signal
The conclusion an interviewer must draw about capability, judgment, or collaboration — the decoded meaning behind a JD phrase.
Signal matrix
A table mapping JD phrases to signals, best evidence forms, honest evidence labels, and next actions.
Proof stack
Five GenAI artifacts on one shared scenario: eval harness, RAG benchmark, guarded agent demo, inference-cost analysis, two-cloud reference build.
Evidence label
An explicit distinction among production experience, practice implementation, conceptual understanding, and a gap.
Reversal condition
New evidence or a threshold that would cause a technical decision — managed RAG, provisioned throughput, model choice — to be revisited.
Story ledger
A claim-calibrated inventory of real experiences, responsibilities, results, and lessons.
Token economics
Reasoning about GenAI cost in dollars per successful task across pricing modes, caching, and routing — not raw token counts.
Counter-metric
A measure that exposes harmful optimization of a primary metric, such as latency beside retrieval quality or quality beside cost.

Mastery checklist

  • I can derive a ranked backlog from a current senior GenAI job description.
  • I can decode Bedrock/Vertex/RAG/agent/eval JD phrases into the signal behind each.
  • I can label each claim as experience, portfolio proof, conceptual knowledge, or gap.
  • I can place any preparation activity on the effort-versus-signal grid and defend the placement.
  • I have (or have scheduled) all five proof-stack artifacts on one shared scenario.
  • My cost artifact states a denominator and a break-even, checked against current published pricing.
  • I can explain one system through goal, constraints, alternatives, failure, rollout, and measurement.
  • I have six stories with exact personal scope and no invented metrics.
  • I have repeated a mock prompt after applying rubric-based feedback.
  • I can name what I deliberately deferred and the trigger for revisiting it.
Search all 12 chaptersResults include concepts, worked examples, and interview questions.