The Preparation Strategy
Build a senior-level positioning system: measurable stories, proof artifacts, deliberate practice, and role-specific preparation.
Learning objectives
By the end of this chapter, you should be able to:
- Turn a senior GenAI job description — Bedrock, Vertex AI, RAG, agents, evals, LLMOps — into a ranked preparation backlog instead of studying the whole AI field.
- Decode recurring GenAI JD language into the hiring signal behind it, and map every signal to honest evidence, a gap-closing artifact, or an explicit learning plan.
- Prioritize preparation work on an effort-versus-signal grid, and defend why eval harnesses and cost models beat certificate cramming.
- Assemble a five-artifact GenAI proof stack — eval harness, RAG benchmark, guarded agent demo, inference-cost analysis, and a two-cloud reference build.
- Construct senior answers that connect requirements, design choices, failure modes, token economics, operations, and outcomes.
- Run a weekly preparation cadence with timed rehearsal across design, coding, troubleshooting, behavioral, and written formats.
- Calibrate every claim and example metric so no practice result is ever presented as personal production experience.
1. Preparation is evidence selection
This book is deliberately not a survey of artificial intelligence. It is a conversion plan: turn existing production-engineering competence into evidence for Senior GenAI, AI Platform, GenAI Solutions Architect, and Forward Deployed interviews on AWS and GCP. The highest-return work is therefore not memorizing more model names. It is choosing which claims you want an interviewer to believe and constructing honest, inspectable support for each claim.
Use a three-layer model. A signal is what the role needs to infer — for example, "can decide whether a RAG change is safe to ship" or "can keep an agent's blast radius bounded." Evidence is what makes that inference reasonable — an eval harness with a CI gate, a retrieval benchmark, an incident analysis, a cost model, or an accurately described past decision. A delivery is how the evidence appears in the interview: a two-minute story, a whiteboard design, a working repository, or a written memo. Weak preparation jumps from a topic name straight to a rehearsed explanation. Strong preparation joins all three layers and lets feedback flow backwards.
flowchart LR
JD["Live GenAI job description"] --> SIG["Required hiring signal"]
SIG --> EV["Proof artifact (honest, inspectable)"]
EV --> DEL["Interview delivery (story, design, repo, memo)"]
DEL --> FB["Feedback and exposed gaps"]
FB --> SIG
The five-part readiness test
For every priority topic, ask whether you can pass all five tests below. A topic is not interview-ready until each is plausible. This kills the common illusion that reading Bedrock or Vertex documentation equals being able to reason in a live system-design conversation.
- Define — state the concept precisely, including its unit of measure (recall@k, p95 TTFT, cost per successful task).
- Design — place it in an architecture under stated quality, latency, cost, and security constraints.
- Implement — build a small honest version: a harness, a benchmark, a guarded tool call.
- Debug — inject a deliberate failure (bad chunking, poisoned tool output, judge drift) and diagnose it out loud.
- Defend — argue one consequential trade-off and name the reversal condition that would change your mind.
2. Decode the job description into a signal matrix
GenAI job descriptions in 2026 are keyword-dense but highly decodable. "Hands-on with Amazon Bedrock," "productionize LLM applications on Vertex AI," "design agentic workflows," and "establish evaluation frameworks" are not synonyms — each phrase encodes a different question the interview loop must resolve. Extract the verbs and objects from two or three live postings, then build the matrix below before you study anything. Re-check postings at application time; GenAI requirements drift quarter to quarter.
| JD phrase (verbatim pattern) | Question the interviewer is resolving | Best evidence form | Weak substitute | Deep dive |
|---|---|---|---|---|
| "Hands-on with Amazon Bedrock / Vertex AI" | Can they make model-selection, throughput, guardrail, and cost decisions on a managed platform, not just call an API? | Two-cloud reference build with a decision memo on model choice, pricing mode, and quotas | Console screenshots or a certification badge alone | Ch. 08–09 |
| "Production RAG / grounded generation" | Can they diagnose retrieval quality and latency separately from generation quality? | Golden question set, hybrid-versus-dense benchmark with nDCG/recall and p95 latency, chunking ablation | A framework quickstart that answers five demo questions | Ch. 04 |
| "Design agentic workflows / multi-step automation" | Can they bound autonomy: idempotent tools, approval boundaries, recovery from partial failure? | Agent demo with an explicit state machine, guardrails, budget caps, and a replayed failure transcript | A happy-path chatbot that calls one tool | Ch. 05 |
| "Establish evaluation frameworks / LLM quality" | Can they decide whether a change is safe to ship? | Versioned eval set, LLM-judge calibrated against human labels, slice analysis, CI gate that has actually blocked a change | One aggregate "accuracy" number from a leaderboard | Ch. 06 |
| "LLMOps / observability / reliability" | Can they operate model-backed systems like production software? | Traces with token-level spans, drift and safety alarms, rollback plan, runbook, SLOs | An architecture diagram with no failure path | Ch. 11 |
| "Optimize inference cost / scale efficiently" | Do they reason in dollars per successful task, not tokens per request? | Cost model comparing on-demand tokens, provisioned throughput, caching, and model routing, with a stated denominator | "We switched to a cheaper model" | Ch. 02 |
| "Fine-tuning / PEFT / model adaptation" | Do they know when adaptation beats prompting and RAG — and when it does not? | Adaptation decision memo plus a small LoRA run with a before/after eval delta and cost accounting | Name-dropping LoRA and QLoRA | Ch. 03 |
| "Customer-facing / forward deployed / solutions" | Can they turn customer ambiguity into a safe, phased rollout that shows value early? | Discovery memo, assumptions log, pilot plan with adoption metrics and stop conditions | A premature product pitch | Ch. 12 |
Label the evidence honestly
Mark each cell experienced, built for practice, understood but not operated, or gap. Those labels are valuable in the room. A credible statement such as "I have not operated Bedrock provisioned throughput at enterprise scale; here is the cost model and load test I built to learn the trade-offs" is stronger than an inflated production claim — and it survives follow-up probes, which inflated claims never do. Never present a tutorial metric, a synthetic benchmark, a team result, or a hypothetical design as your personal production outcome.
3. The 16-chapter curriculum as a preparation map
The rest of this handbook is organized so that the signal matrix above has a place to send you. Do not read it linearly like a textbook. Anchor on the chapters your matrix flags as high-frequency and weak-evidence; treat the others as reference material with a small breadth budget. The mindmap below is the territory; your matrix is the route.
mindmap
root(("GenAI prep map"))
Foundations
02 LLM internals and serving
03 Prompting and adaptation
Applications
04 Retrieval and production RAG
05 Agentic systems
06 Evaluation and quality
Platform
07 Enterprise integration
10 Data and cloud platform
11 LLMOps and security
Clouds
08 AWS Bedrock and SageMaker
09 GCP Vertex AI and Gemini
Synthesis
12 System design and FDE
13 Leadership and coding
Execution
14 Role to topic map
15 Twelve week sequence
16 References and readiness
A useful traversal for most senior GenAI loops follows the spine below: decode signals first, refresh only the foundations those signals need, build artifacts in the application chapters, map them onto both clouds, then rehearse synthesis. Chapter 15 turns this spine into a full 12-week execution sequence, so this chapter deliberately stays at the strategy layer.
4. Prioritize by effort versus hiring signal
Preparation time is the scarce resource, so manage it as a portfolio. Score each candidate activity on two axes: how much build effort it demands, and how much hiring signal it generates for your target roles. The quadrant chart below positions the artifacts this chapter recommends against common low-signal temptations. Positions are judgments to be re-derived from your own matrix, not universal constants.
quadrantChart
title Effort versus hiring signal
x-axis Low build effort --> High build effort
y-axis Low hiring signal --> High hiring signal
quadrant-1 Flagship bets
quadrant-2 Quick wins
quadrant-3 Parking lot
quadrant-4 Money pits
Eval harness with CI gate: [0.55, 0.92]
RAG benchmark report: [0.45, 0.85]
Guarded agent demo: [0.68, 0.8]
Inference cost model: [0.28, 0.75]
Two cloud reference build: [0.82, 0.72]
Story ledger rewrite: [0.2, 0.62]
Leaderboard trivia tracking: [0.15, 0.12]
Pretraining an LLM from scratch: [0.92, 0.18]
Certificate cramming: [0.55, 0.28]
To turn the picture into a schedule, use a deliberately simple priority product. Its purpose is to expose opportunity cost, not to be precise: if a role repeatedly mentions Bedrock, RAG quality, and evaluation, another evening on pretraining mathematics is a poor trade unless the posting explicitly asks for it.
priority(topic) = role_frequency × evidence_gap × interview_urgency
# Example only: each factor scored 1 (low) to 3 (high)
evals_and_rag_quality = 3 × 2 × 3 = 18
agent_guardrails = 2 × 3 × 2 = 12
pretraining_theory = 1 × 2 × 1 = 2
pie title Default preparation weights in percent
"Retrieval and production RAG" : 15
"Evaluation and quality" : 15
"Cloud stacks AWS and GCP" : 15
"System design and FDE" : 15
"Agentic systems" : 10
"Serving and token economics" : 10
"LLMOps and security" : 10
"Leadership and coding" : 10
Deepen
Pick one or two recurring, high-value skills where you already have foundation — for most 2026 GenAI loops, evaluation and retrieval quality are the prime candidates because they anchor every ship decision.
Repair
Pick the risk that can sink a loop outright: vague token-economics reasoning, no agent failure story, weak SQL, or no answer to "how did you know it was safe to ship?" Practise it in small, timed units.
Maintain
Keep existing strengths fluent through spaced recall. Do not rebuild familiar Python, FastAPI, or core cloud networking from zero; those are covered as refreshers in Chapters 07 and 10.
Defer
Record fascinating but low-signal topics — new model gossip, exotic architectures — in a dated parking lot with a revisit trigger. Deferral is a strategy decision, not a value judgment.
5. The GenAI proof stack: five artifacts, one scenario
A proof stack is a small set of artifacts that covers many signals without becoming a portfolio museum. The efficient move is to build all five artifacts around one shared scenario — for example, an enterprise document assistant with retrieval, tool use, and strict tenancy rules. The shared scenario lets you reason deeply in any interview instead of maintaining unrelated demos, and every artifact feeds the same evidence dossier.
flowchart TD
SCN["Shared scenario (enterprise doc assistant)"] --> EVH["Eval harness with CI gate"]
SCN --> RAGB["RAG benchmark (hybrid vs dense)"]
SCN --> AGD["Agent demo with guardrails"]
SCN --> COST["Inference cost analysis"]
SCN --> REF["Two-cloud reference build"]
EVH --> DOSS["Evidence dossier + design memos"]
RAGB --> DOSS
AGD --> DOSS
COST --> DOSS
REF --> DOSS
| Artifact | Signals it covers | Core metrics it must carry | Built in |
|---|---|---|---|
| Eval harness — versioned dataset, LLM-judge calibrated against your own human labels (see Zheng et al., LLM-as-a-Judge), CI gate | Evaluation judgment, ship/no-ship discipline, LLMOps | Task success rate with slices, judge–human agreement, gate pass/fail history | Ch. 06 |
| RAG benchmark — golden set, chunking and hybrid-retrieval ablations over the classic retrieval-augmented pattern (Lewis et al.) | Retrieval depth, grounded-generation quality | Recall@k, nDCG@10, faithfulness, p95 retrieval latency | Ch. 04 |
| Agent demo with guardrails — explicit state machine, idempotent tools, budget caps, approval boundary, replayable failure transcript (patterns in Anthropic's building-effective-agents guidance) | Agent reliability, bounded autonomy, safety | Task completion rate, tool-error recovery rate, guardrail-violation count | Ch. 05 |
| Inference-cost analysis — tokens × price versus provisioned throughput versus caching and routing, expressed per successful task | Token economics, FinOps credibility | Cost per successful task, cache hit rate, break-even utilization for provisioned capacity | Ch. 02 |
| Cloud reference build — the same scenario deployed thin on both clouds with IAM, logging, and a rollback path | Platform ownership, AWS and GCP fluency | Deployment reproducibility, p95 end-to-end latency, monthly cost estimate | Ch. 08–09 |
AWS
- Amazon Bedrockmanaged FM inference, guardrails, agents
- Bedrock Knowledge Basesmanaged RAG over your corpus
- OpenSearch Serverlessvector plus keyword hybrid retrieval
- Lambda + API Gatewayserving glue and tool endpoints
- CloudWatch + Cost Explorertraces, alarms, token spend
Google Cloud
- Vertex AIGemini models, Model Garden, tuning
- Vertex AI Search / RAG Enginemanaged grounding and retrieval
- Vertex AI Vector SearchANN retrieval at scale
- Cloud Runserving glue and tool endpoints
- Cloud Monitoring + BigQuerytraces, alarms, spend analysis
Keep a story ledger beside the artifact stack
Artifacts prove capability; the story ledger proves experience. For every real story, record: situation and stakes; exact personal responsibility; collaborators; the alternatives considered; the action; the observable result; what you would change; and which claims need qualification. Replace confidential names and values only when necessary, and say that values are rounded or anonymized. If you lack a metric, state what was observed and what you would measure now — never reverse-engineer an impressive number.
6. Answer at senior scope
Senior answers reveal a decision process. Begin by locating the goal, users, risk, and constraints. Establish a simple baseline. Decompose the system and make boundaries explicit. Compare alternatives against criteria. Cover failure, security, rollout, observability, and ownership. Close with validation and what would change your mind. The same sequence works in GenAI system design, troubleshooting, project deep dives, and customer discovery — Chapter 12 drills it against full design prompts.
flowchart LR
G["Goal, users, risk"] --> C["Constraints (quality, latency, cost, privacy)"]
C --> B["Smallest credible baseline"]
B --> T["Alternatives and trade-offs"]
T --> F["Failure modes and security"]
F --> R["Rollout and ownership"]
R --> M["Measurement and reversal conditions"]
Separate facts, assumptions, and decisions
Say "the requirement states," "I am assuming," and "I would choose" rather than blending all three. Ask a small number of high-value clarifying questions, then proceed with declared assumptions. In a 45-minute design session, exhaustive discovery is impossible; the signal is whether your assumptions are consequential and whether the design can absorb being wrong about them.
Make influence observable
Staff-level influence is a mechanism, not a title: you wrote an options memo, instrumented a disputed bottleneck, ran the eval that settled a model-choice argument, created an adoption path, mentored an owner, or changed a standard. Explain the resistance and how feedback altered the plan. "I convinced everyone" is weaker than a transparent decision process that let reasonable people converge. Chapter 13 covers the delivery mechanics.
7. The preparation operating cadence
Preparation needs short feedback loops, and GenAI preparation needs them more than most because the vendor surface moves monthly while the underlying judgment moves slowly. Run a weekly cycle that always ends in deliverables — an artifact increment, a recorded mock, a rewritten story — never in "hours studied."
- Monday — diagnoseRe-scan two live postings; re-rank the backlog with the priority product; pick the week's one artifact increment and one repair item.
- Tuesday–Thursday — buildDeep-work blocks on the proof stack: extend the eval harness, run one benchmark ablation, harden one agent tool, or update the cost model with current published pricing.
- Friday — rehearseOne timed mock in a rotating format: design, coding, troubleshooting, behavioral, or a written memo. Record it.
- Weekend — review and updateScore the recording against a rubric; extract one or two observable corrections; update the signal matrix, story ledger, and parking lot.
| Format | What to practise | Evidence to capture | Useful review question |
|---|---|---|---|
| GenAI system design | Ambiguity, scale, retrieval and model choice, guardrails, rollout | Final diagram and decision log | Did constraints actually drive the architecture? |
| Technical deep dive | One real or practice system, including a failure | Recording, claim ledger, missing-detail list | Did I distinguish my work from the team's? |
| Coding | Correctness, tests, streaming and async patterns, complexity | Timed solution and post-review patch | Did I validate edge cases before optimizing? |
| Troubleshooting | Hypotheses, instrumentation, isolating retrieval vs generation vs infra | Incident timeline and next experiment | Did I change one variable at a time? |
| Behavioral | Ownership, conflict, failure, influence mechanism | Two-minute and six-minute versions | Was the action mechanism concrete? |
| Written memo | Concise asynchronous decision-making | One page with a requested decision | Can a reader act without a meeting? |
Use a stop-doing list
- Stop adding notes once a topic passes the five-part readiness test; move to the next gap.
- Stop polishing demo UX while the artifact lacks a baseline and a metric definition.
- Stop tracking weekly model-release gossip unless a target role requires vendor-frontier depth; log it in the parking lot instead.
- Stop rehearsing only successful stories — failure analysis is where operational judgment becomes visible.
8. Make every outcome measurable
Senior GenAI interviews repeatedly probe evidence across quality, latency, cost, safety, reliability, and customer impact. Treat these as a balanced evidence set rather than quoting whichever number looks best. Each dimension has a defensible form and a weak substitute, and interviewers are well calibrated to the difference. The AWS Well-Architected Generative AI Lens uses essentially this decomposition for production reviews, which makes it a useful shared vocabulary in AWS-facing loops.
| Dimension | Defensible evidence | Weak substitute |
|---|---|---|
| Quality | Versioned task set, metric definition, slices, baseline, judge calibration | One impressive response |
| Latency | p50/p95/p99 TTFT and end-to-end at stated concurrency and boundary | An unqualified average |
| Cost | Provider plus platform cost per successful task, with cache and routing effects | Token count alone |
| Safety | Guardrail-violation rate on an adversarial set, escalation path, audit trail | "We enabled the guardrail feature" |
| Reliability | Availability or successful-task SLI over a declared window, with rollback evidence | "It was stable" |
| Customer impact | Adoption, time saved, error reduction, or business result with provenance | Feature shipped |
If exact production values are confidential, use approved ranges or explain the measurement method and direction. Never invent precision. The senior signal is the causal chain from decision to measurable outcome — and an honest account of confounders.
Interview playbook
Use the CONTEXT answer frame when a question is broad:
- C — Customer and consequence: who needs what, and what happens if the system is wrong, unsafe, or late?
- O — Objectives and constraints: define quality, latency, cost per task, privacy, scale, and timeline.
- N — Narrow baseline: the smallest system that tests the value proposition — often managed RAG before custom anything.
- T — Trade-offs and topology: draw boundaries, compare alternatives (managed versus custom, prompt versus tune, single model versus router), justify the choice.
- E — Exceptions: dependency failure, bad retrieval, prompt injection, abusive input, partial agent completion.
- X — eXecution: sequencing, ownership, migration, approvals, and communication.
- T — Tests and telemetry: eval gates, SLOs, guardrail monitoring, feedback loops, and reversal conditions.
Common traps
- Model-first: naming a model, vector database, or agent framework before defining the problem and constraints.
- Unbounded "we": making team output sound like personal implementation. State your role explicitly.
- Metric theater: quoting an eval score without dataset, denominator, baseline, judge calibration, or business meaning.
- Perfect hindsight: omitting uncertainty, disagreement, or what changed during delivery.
- Demo scope: ignoring authorization, tenant isolation, retries, evaluation, rollout, or on-call ownership.
- Vendor recital: listing Bedrock or Vertex features instead of criteria, measurement, and failure behavior.
For experience questions, use Situation → Stakes → My responsibility → Options → Action → Result → Reflection. If a result is qualitative, keep it qualitative. If discussing a portfolio exercise, label it as such before presenting any numbers.
Question bank
Practise aloud. Each answer should use evidence appropriate to its claim and should survive the probes without invented detail.
Q1Why does your preparation prioritize evaluation and retrieval over foundation-model training?
Strong answer outline
- Anchor to recurring responsibilities in live senior GenAI postings: ship decisions, RAG quality, platform operations — not pretraining.
- Explain comparative advantage: production engineering background converts fastest into eval and retrieval evidence.
- Describe the opportunity cost and a small breadth budget for serving internals (Chapter 02) so model reasoning stays credible.
Follow-up probes
- What job-description change would make you rebalance?
- What concrete artifact will the prioritized time produce?
Pass if the answer connects role frequency, honest evidence gaps, and a named deliverable; fail if it dismisses model fundamentals categorically.
Q2Walk me through how you would decode a GenAI job description into a study plan.
Strong answer outline
- Extract verbs and objects — "operate," "evaluate," "advise," "Bedrock," "agentic" — from two or three live postings.
- Map each phrase to the hiring signal behind it and label current evidence: experienced, practiced, understood, or gap.
- Rank by role frequency × evidence gap × urgency; commit to weekly deliverables, not hours.
Follow-up probes
- Show me one real phrase you decoded and what it changed.
- What did you explicitly defer, and what is the revisit trigger?
Pass if a real opportunity-cost decision is named; fail if the plan is "cover everything important."
Q3What counts as proof of production-RAG competence?
Strong answer outline
- Name four layers: code proof, decision proof (ADR), measurement proof (golden set, ablations), operations proof (traces, rollback).
- Separate retrieval metrics (recall@k, nDCG) from generation metrics (faithfulness, task success) and system metrics (p95, cost per task).
- Include a failure injection — bad chunking or index drift — and the degradation path.
Follow-up probes
- Which artifact would you show first and why?
- What can a small portfolio project not prove?
Pass if limitations are explicit and the artifact is inspectable; fail if a screenshot of a good answer is treated as production evidence.
Q4You have more depth on one cloud than the other. The role is on the weaker cloud. How do you prepare and how do you answer?
Strong answer outline
- State that platform judgment transfers: managed FM inference, vector retrieval, IAM boundaries, and observability exist on both clouds.
- Show the mapping concretely — Bedrock ↔ Vertex AI, Knowledge Bases ↔ Vertex AI Search, OpenSearch ↔ Vector Search — and where the mapping breaks (pricing modes, quota models, guardrail features).
- Present the two-cloud reference build as the gap-closing artifact and name what you still have not operated.
Follow-up probes
- Which service pair has the most misleading equivalence?
- What would you validate in your first week on the weaker cloud?
Pass if transfer is argued mechanism-by-mechanism with honest gaps; fail if the answer is "clouds are basically the same."
Q5How do you present a benchmark without overstating it?
Strong answer outline
- Label the environment: production, anonymized production, or synthetic practice.
- State corpus, queries, judgment provenance, metric, baseline, hardware, and run conditions.
- Show trade-offs, variance across runs, limitations, and the next test needed before a real decision.
Follow-up probes
- Is the gain statistically or just numerically visible?
- Could there be leakage between your golden set and your tuning loop?
Pass if another engineer could interpret and challenge the result; fail if only a favorable percentage survives retelling.
Q6Which single proof artifact would you build first for these roles, and why?
Strong answer outline
- Argue for the eval harness: it is the artifact every other artifact depends on for credibility — benchmarks, agent claims, and cost trade-offs all need a quality denominator.
- Describe its parts: versioned dataset, calibrated judge, slices, CI gate, and a change it actually blocked.
- Show how it compounds: the RAG benchmark and agent demo reuse the same harness.
Follow-up probes
- How do you know your LLM judge is trustworthy?
- What would make you build the cost model first instead?
Pass if the choice is justified by dependency structure, not fashion; fail if the answer is "the most impressive demo."
Q7You have never run Bedrock Agents or Vertex AI Agent Builder in production. The JD asks for agentic experience. How do you answer?
Strong answer outline
- Say so directly, then separate transferable agent engineering — state machines, idempotent tools, budgets, approval boundaries — from vendor-specific operations.
- Present the guarded agent demo: injected tool failure, replayed transcript, guardrail-violation count.
- Name the operating claims you cannot make (quota behavior at scale, real user abuse patterns) and how you would validate them.
Follow-up probes
- Which agent failure mode worries you most in production?
- What would you test in week one with real tenant data?
Pass if honesty is paired with relevant depth and a learning plan; fail if a demo is relabeled as production ownership.
Q8How do you prepare for an ambiguous GenAI system-design prompt?
Strong answer outline
- Identify user, value, scale, quality bar, latency budget, cost ceiling, privacy, and failure consequence.
- Ask only the questions that materially change the design, then declare assumptions and proceed.
- Start with a managed baseline, evolve it at pressure points, and reserve time for guardrails, rollout, and measurement.
Follow-up probes
- Which assumption in your last mock was most dangerous?
- How would your design change at ten times the traffic — or one tenth the budget?
Pass if ambiguity becomes explicit decisions; fail if questioning consumes the session or everything is silently assumed.
Q9How do you choose metrics for a GenAI proof artifact?
Strong answer outline
- Trace user value to component metrics: retrieval quality, generation faithfulness, guardrail violations, latency percentiles, cost per successful task.
- Always pair a primary metric with a counter-metric — quality with latency, cost with success rate.
- Define slices and acceptance thresholds before running the favored variant.
Follow-up probes
- Which of your metrics can be gamed, and how?
- What is the denominator of "cost per successful task" in your artifact?
Pass if metrics have definitions and decision consequences; fail if a dashboard is mistaken for a quality model.
Q10Show me how you reason about token economics for a workload.
Strong answer outline
- Start from traffic shape: requests per day, input/output token distribution, cacheable prefix share, latency tolerance.
- Compare on-demand per-token pricing, batch, and provisioned throughput on both clouds; compute the utilization break-even, citing current published pricing rather than memory.
- Add levers in order of leverage: prompt and context reduction, caching, model routing, then capacity commitments — each with its quality counter-metric.
Follow-up probes
- When does provisioned throughput lose to on-demand despite high volume?
- How does an aggressive router protect quality?
Pass if the unit of analysis is dollars per successful task with stated assumptions; fail if the answer is a cheaper-model reflex. Depth lives in Chapter 02.
Q11Models and vendor features change monthly. How do you keep preparation current without chasing news?
Strong answer outline
- Split knowledge into durable (retrieval math, eval design, failure modes, cost reasoning) and volatile (model names, prices, feature flags).
- Invest build time in durable artifacts; refresh volatile facts from primary docs in a short weekly slot, just before interviews.
- Keep a parking lot with revisit triggers so novelty does not hijack the backlog.
Follow-up probes
- Name one durable principle that survived the last two model generations.
- What volatile fact did you re-check this week?
Pass if the durable/volatile split is explicit and primary sources are named; fail if currency means reading headlines.
Q12What makes a GenAI project story senior rather than merely trendy?
Strong answer outline
- Frame the consequential decision and its uncertainty — model choice, managed versus custom, ship gate — not the novelty of the stack.
- Clarify personal ownership, alternatives, stakeholder influence, and operational follow-through after launch.
- State result and reflection, including a decision you would now revise.
Follow-up probes
- Who disagreed with the decision and why?
- Who operated the system after launch, and what paged them?
Pass if the story reveals judgment and leverage; fail if seniority is implied by using this year's tools.
Q13What should you do when a mock interview goes badly?
Strong answer outline
- Separate knowledge gaps from delivery, structure, and time-management failures — they need different fixes.
- Choose one observable behavior correction and one technical correction; write both down.
- Re-answer the same prompt after a delay and compare against the rubric.
Follow-up probes
- What evidence would show the correction worked?
- When do you seek external critique instead of self-review?
Pass if feedback becomes a testable change; fail if the response is simply more reading or more unrelated mocks.
Q14Give your two-minute positioning for a Senior GenAI or Forward Deployed role.
Strong answer outline
- State the production problem class you solve — for example, taking LLM applications from demo to operated, evaluated, cost-bounded systems — without inflating title or scope.
- Select two or three substantiated strengths matched to this role's signals, each backed by an artifact or a real story.
- Name the ownership you are seeking and bridge to one evidence-rich example the interviewer can pull on.
Follow-up probes
- Why this role rather than a research or foundation-model role?
- Which of your claims should we investigate first?
Pass if every sentence can lead to concrete evidence and fits in two minutes; fail if it is a biography, a tool list, or an unsupported superlative.
Proof artifact: the GenAI evidence dossier
Create a version-controlled dossier that maps one target role to inspectable proof across the five-artifact stack. This artifact tests preparation discipline; it is not a claim about Purnendu's past outcomes, and its README must say so.
Build steps
- Save a dated copy or structured summary of one live senior GenAI job description. Extract no more than ten decision-relevant signals using the matrix format from Section 2.
- Create the matrix with columns for signal, importance, evidence label, artifact or story, limitation, and next action. Commit it so the history shows re-ranking over time.
- Stand up the shared scenario thin: a small document corpus, an eval set of 100–200 questions with labels, and a baseline RAG pipeline on one cloud's managed path (Bedrock Knowledge Bases or Vertex AI Search).
- Add the five artifacts incrementally: eval harness with a CI gate; hybrid-versus-dense RAG benchmark; agent demo with guardrails and a replayable failure; inference-cost model using current published Bedrock and Vertex pricing; and the second-cloud mirror of the reference build.
- Write six real-experience story cards. Record exact personal scope and mark every number as exact, rounded/anonymized, or unavailable.
- Record a 45-minute design mock and a two-minute positioning statement. Score both with the same rubric, then repeat one week later.
- Publish a README covering reproducibility, secrets and privacy boundaries, current pricing-check dates, and what the practice system does not prove.
Metrics to capture
- Coverage: percentage of top signals with at least one inspectable proof; report gaps separately rather than hiding them in an average.
- Readiness: count of topics passing all five tests — define, design, implement, debug, defend.
- Artifact quality: each artifact carries its core metrics from the Section 5 table, with baselines and counter-metrics.
- Delivery: rubric scores for framing, assumptions, trade-offs, failure handling, measurement, and clarity across recorded mocks.
- Claim hygiene: number of unqualified "we" statements, unsupported metrics, or practice results phrased as experience. Target zero.
- Cadence: planned versus completed weekly deliverables, not passive study hours.
Deliberate failure injection
Three injections, one lesson each. First, remove the baseline and dataset description from the RAG benchmark report and ask a reviewer to interpret the claimed gain; it should become non-actionable, demonstrating why measurement provenance is engineering quality. Second, disable one guardrail in the agent demo, replay the failure transcript, and document the blast radius and the recovery path. Third, delete the denominator from the cost model — present "monthly spend" without "per successful task" — and note how the number stops supporting any decision. Restore each and record the difference.
What to present
Present the one-page signal matrix first, then one proof chain end to end: role need → decision → artifact → metric → injected failure → lesson. Use example numbers only if clearly labeled as hypothetical or portfolio measurements. Keep the complete repository available, but do not force an interviewer through every file.
Chapter review
Interview preparation for senior GenAI roles is a constrained engineering program. Decode live JD language into hiring signals, allocate effort by evidence gap on the effort-versus-signal grid, build a five-artifact proof stack around one shared scenario mapped to both Bedrock and Vertex AI, rehearse senior decision-making on a weekly cadence, and keep every claim honestly labeled. The goal is not to sound universally expert. It is to make relevant, honest competence easy to verify.
Glossary
- Hiring signal
- The conclusion an interviewer must draw about capability, judgment, or collaboration — the decoded meaning behind a JD phrase.
- Signal matrix
- A table mapping JD phrases to signals, best evidence forms, honest evidence labels, and next actions.
- Proof stack
- Five GenAI artifacts on one shared scenario: eval harness, RAG benchmark, guarded agent demo, inference-cost analysis, two-cloud reference build.
- Evidence label
- An explicit distinction among production experience, practice implementation, conceptual understanding, and a gap.
- Reversal condition
- New evidence or a threshold that would cause a technical decision — managed RAG, provisioned throughput, model choice — to be revisited.
- Story ledger
- A claim-calibrated inventory of real experiences, responsibilities, results, and lessons.
- Token economics
- Reasoning about GenAI cost in dollars per successful task across pricing modes, caching, and routing — not raw token counts.
- Counter-metric
- A measure that exposes harmful optimization of a primary metric, such as latency beside retrieval quality or quality beside cost.
Mastery checklist
- I can derive a ranked backlog from a current senior GenAI job description.
- I can decode Bedrock/Vertex/RAG/agent/eval JD phrases into the signal behind each.
- I can label each claim as experience, portfolio proof, conceptual knowledge, or gap.
- I can place any preparation activity on the effort-versus-signal grid and defend the placement.
- I have (or have scheduled) all five proof-stack artifacts on one shared scenario.
- My cost artifact states a denominator and a break-even, checked against current published pricing.
- I can explain one system through goal, constraints, alternatives, failure, rollout, and measurement.
- I have six stories with exact personal scope and no invented metrics.
- I have repeated a mock prompt after applying rubric-based feedback.
- I can name what I deliberately deferred and the trigger for revisiting it.
Primary sources
Links checked . Vendor pricing and features are volatile; re-verify at application time.
- Amazon Bedrock — official documentation
- Amazon Bedrock — pricing modes (on-demand, batch, provisioned throughput)
- AWS Well-Architected Framework — Generative AI Lens
- Vertex AI — official documentation
- Generative AI on Vertex AI — official documentation
- Vertex AI — pricing
- Anthropic — Building effective agents (engineering guidance)
- Lewis et al. — Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (arXiv:2005.11401)
- Zheng et al. — Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (arXiv:2306.05685)