Anthropic CCAR-P Value Pack (Frequently Bought Together)

A Claude architect at a health services organization is defining evaluation metrics for a clinical-summary pipeline. The pipeline must remain within a per-query cost ceiling and must never surface patient data to unauthorized roles.
Which two metrics directly address these requirements? (Select two.)

• A. Role-based access-control enforcement rate measured on a red-team dataset
• B. Throughput measured as successful requests processed per minute
• C. Per-query token cost measured against the defined cost ceiling
• D. Response latency at the 95th percentile across a one-week sample window
• E. BLEU score computed against a human-annotated reference summary set

Explanation: Only visible for PracticeTorrent members. You can sign-up / login (it's free).

During an architectural review, the security team identifies a risk that adversarial content injected into retrieved documents could manipulate the model's behavior.
Which mitigation most directly addresses this threat?

• A. Restrict outbound tool calls to an approved destination allow-list.
• B. Treat all retrieved content as untrusted input and apply input classifiers with output validation.
• C. Score outputs against a stable adversarial evaluation set on each model-version change.
• D. Require citations for each claim and constrain responses to source-supported content.

Explanation: Only visible for PracticeTorrent members. You can sign-up / login (it's free).

You are reviewing a peer's Claude Code permission rules for an enterprise rollout. The rules grant unrestricted Bash access to all projects across all developers.
Which response is most appropriate?

• A. Replace unrestricted Bash with narrowly scoped tool patterns that allow only the specific commands the workflows require, and add explicit deny rules for sensitive operations.
• B. Approve the unrestricted Bash access as written on the grounds that narrowing the rules would add configuration complexity, accepting the full attack surface for all engineers across all projects.
• C. Disable all permission rules for the enterprise rollout so every command across every project runs without any tool-pattern scoping or explicit deny rules for sensitive operations.
• D. Add unrestricted access to additional tool categories as well, so that Bash is not asymmetrically more permissive than other tools, expanding the attack surface further in the name of consistency.

Explanation: Only visible for PracticeTorrent members. You can sign-up / login (it's free).

You are evaluating retrieval-strategy claims used by a peer team.
For each claim, select yes if the statement is generally accurate. Otherwise, select no.

Explanation:
Yes, Yes, Yes, No, No
Dense vector retrieval represents semantic similarity, making it suitable for matching paraphrases and conceptually related language even when the query and source do not share identical words. Sparse lexical retrieval, including BM25-style matching, retains strong sensitivity to exact tokens and is therefore valuable for identifiers, product codes, technical names, and uncommon terminology.
Structured query retrieval is appropriate when the required operation depends on explicit fields, predicates, joins, counts, grouping, or aggregation over a relational schema. In that situation, generating or invoking a constrained database query is more precise than approximating the operation through semantic similarity.
Hybrid retrieval is not identical to dense retrieval. It combines semantic and lexical candidate sets, typically followed by rank fusion or reranking. Anthropic's contextual-retrieval guidance explains that semantic search captures meaning and paraphrases, while BM25 captures exact terminology; combining them improves coverage. Contextual Retrieval , Contextual Retrieval Cookbook Random sampling is not a relevance strategy. It provides no systematic relationship between the query and selected evidence, producing unstable coverage and preventable hallucination risk. Production Q & A requires deterministic or evaluated relevance mechanisms, access filters, suitable indexes, and measurable retrieval metrics such as recall at k .
Study Guide references/topics: Dense retrieval; sparse retrieval; structured queries; hybrid search; rank fusion; retrieval evaluation; production RAG design.

An operations engineer reports that a Claude-based pipeline began returning malformed JSON responses after a scheduled maintenance window, causing downstream processing failures.
Which two investigative steps most directly isolate the root cause? (Select two.)

• A. Switch to a different Claude model tier to rule out provider-side changes as a contributing factor.
• B. Clear the prompt cache and resubmit all pending requests to eliminate stale cached prefixes.
• C. Increase the max_tokens limit to determine whether output truncation is causing incomplete JSON structures.
• D. Compare the current system prompt and output schema configuration against the last known good version from before the maintenance window.
• E. Replay a set of premaintenance requests against the current configuration and inspect the raw model output before downstream parsing.

Explanation: Only visible for PracticeTorrent members. You can sign-up / login (it's free).