Start free trial
Trending New Genres Authors
EnglishEnglish
EspañolSpanish
简体中文Chinese
繁體中文Chinese (Traditional)
FrançaisFrench
DeutschGerman
日本語Japanese
PortuguêsPortuguese
ItalianoItalian
한국어Korean
РусскийRussian
NederlandsDutch
العربيةArabic
PolskiPolish
हिन्दीHindi
Tiếng ViệtVietnamese
SvenskaSwedish
ΕλληνικάGreek
TürkçeTurkish
ไทยThai
ČeštinaCzech
RomânăRomanian
MagyarHungarian
УкраїнськаUkrainian
IndonesiaIndonesian
DanskDanish
SuomiFinnish
БългарскиBulgarian
עבריתHebrew
NorskNorwegian
HrvatskiCroatian
CatalàCatalan
SlovenčinaSlovak
LietuviųLithuanian
SlovenščinaSlovenian
СрпскиSerbian
EestiEstonian
LatviešuLatvian
فارسیPersian
മലയാളംMalayalam
தமிழ்Tamil
اردوUrdu
Searching...
SoBrief
Practicing Trustworthy Machine Learning

Practicing Trustworthy Machine Learning

Consistent, Transparent, and Fair AI Pipelines
A model can expose data, amplify bias, or fail in production. Build safeguards across its lifecycle.
by Yada Pruksachatkun 2023 300 pages
4.95
111 ratings
Listen
Immersive
V2.3
Amazon Kindle Audible
Try Full Access for 3 Days
Unlock listening & more!
Continue

Key Takeaways

Treat trustworthiness as a production requirement, not a model score.

Accuracy is only a start. A model can perform well on a fixed test set yet leak information, fail on unfamiliar inputs, treat groups unequally, or offer explanations that mislead. These are not distant, hypothetical risks: the book points to examples ranging from biased healthcare triage to data exposure and adversarial attacks. Trustworthiness means testing how the whole machine learning pipeline behaves in the world, not simply celebrating its benchmark score.

Build for deployment. The book organizes practical safeguards around privacy, fairness, interpretability, robustness, and safety. Each requires choices about data, model behavior, users, and consequences. No single metric proves a system trustworthy, and no technique makes it harmless by itself.

Analysis

What's striking is the shift from treating trust as a property of a model to treating it as a property of a sociotechnical system. Reliability engineering makes a similar move: safety depends on components, operators, and the environment interacting as intended. This framing prevents a common category error, where a high accuracy score is mistaken for evidence of ethical or secure behavior. It also complicates accountability: responsibility cannot rest solely with the engineer who tuned the model when product decisions and data practices shape the same risks.

Protect model outputs as carefully as the training data.

Predictions can reveal secrets. A membership inference attack tries to identify whether a particular example was used to train a model. Model inversion goes further by reconstructing information represented in the training data, while model extraction uses queries and predictions to build a copycat model. The book notes that membership attacks are often less serious than inversion or extraction, but any exposed output can become useful to an attacker.

Match safeguards to threats. Differential privacy limits how much a single record can affect a model's output, usually at some cost to accuracy. Homomorphic encryption supports computation on encrypted data, while secure multi-party computation lets organizations compute jointly without exposing each participant's inputs. Federated learning keeps raw data at its source. These techniques address different risks, and none automatically ensures legal compliance.

Analysis

This is a useful extension of ordinary cybersecurity thinking: the interface itself can be a data leak, even when the database is locked down. The principle of least privilege suggests limiting query volume and detail, as well as access to logits, which expose more than a final label. Yet restriction is not a complete defense. A service still needs to consider how legitimate use, repeated queries, and combinations with outside information change the attack surface.

Measure fairness where people experience the model's decisions.

Start with the harm. The book distinguishes unequal allocation of resources, unequal quality of service, and damaging representation. It also separates individual fairness, which asks whether similar people receive similar treatment, from group or parity fairness, which compares a chosen outcome metric across cohorts. Because fairness has no universal definition, teams must decide which harm matters in their particular application.

Test outcomes by group. A healthcare algorithm that used past spending to identify patients for extra care underestimated Black patients' needs because unequal access had already reduced their spending. In a separate investigation, COMPAS flagged Black defendants as higher risk for violent reoffending more often than White defendants, despite poor predictive results overall. Evaluation requires relevant cohorts, task-appropriate metrics, and comparisons of both fairness and model performance.

Analysis

The healthcare example exposes a measurement problem, not just a bad feature choice: a convenient variable can encode the unequal system that produced it. This connects algorithmic fairness to construct validity, the question of whether a measure actually captures the concept it claims to represent. Cohort metrics make disparities visible, but they do not settle which trade-offs are acceptable. Choosing a parity target is partly a social and institutional judgment, so affected communities and domain experts belong in that decision.

Use explanations to investigate models, never to certify them.

An explanation has a scope. Interpretability concerns whether people can understand a model's decisions; explainability often concerns its internal structure. Methods can describe one prediction or summarize broader behavior, and may depend on the model type or treat it as a black box. LIME approximates a prediction with a simpler model nearby; SHAP assigns contributions to input features using an approach derived from cooperative game theory.

Check the explanation itself. A heatmap that highlights image regions or a feature score that names influential words can help uncover suspicious behavior. But such displays can be unstable or misleading, and feature contribution is not proof of causation. The book recommends testing explanations with intended users and using simpler, inherently interpretable models when high-stakes decisions require understandable reasoning.

Analysis

Explanations can improve human oversight, but they also create a new object of trust: the explanation method. This resembles the distinction in science between a measurement instrument and the phenomenon it measures. A clear-looking chart is not necessarily a faithful account of a model's reasoning. Human factors research adds another concern: people may defer to polished automated explanations. Good evaluation therefore asks not only whether an explanation is legible, but whether it helps people detect errors and make better decisions.

Break models with realistic shifts before reality does.

Test beyond the training distribution. Robustness is a model's ability to handle variation in data. Non-adversarial tests apply realistic changes, such as rotating or partially obscuring an image, or rephrasing a sentence. Text tests should check that a perturbation remains fluent and preserves meaning. Adversarial tests deliberately search for changes that fool the model, either toward a chosen wrong answer or toward any wrong answer.

Small changes can matter. The book describes image classifiers whose predictions changed when nearly invisible text was overlaid on an image. It also shows that harder, ambiguous images could be fooled with smaller changes than confidently classified images. Training with augmentation or adversarial examples can help, but training against one kind of noise does not guarantee resilience to another. Test the variations the application is likely to encounter.

Analysis

Robustness testing is a form of stress testing: it asks which assumptions fail first when conditions move away from the ideal. That connects naturally to distribution shift, where production data changes over time or differs from historical samples. A useful test suite should therefore be grounded in the actual setting, not just in attacks that are easy to generate. There is a limit, however: no finite set of perturbations covers every possible input, so passing tests is evidence of resilience, not a guarantee.

Audit data provenance before blaming the algorithm.

Data choices carry consequences. The book warns against using data without suitable consent, safeguards, or a clear connection to the modeling goal. Poor sampling can leave groups underrepresented; labels can be wrong; and seemingly neutral features can act as proxies for sensitive traits. A COVID X-ray model, for example, learned to rely on whether a patient was lying down, a clue associated with serious illness in its data, rather than the disease itself.

Synthetic data is not a shortcut to truth. It can provide precise labels, protect some individual information, or help pre-train models. But generated images may reproduce familiar patterns while missing rare cases. The book describes abstract fractal data as useful for pre-training, while warning that a model trained only on synthetic examples may fail on real-world variation. Verify data quality, consent, provenance, and fit for purpose.

Analysis

This chapter's central lesson resembles the old statistical warning that a large sample cannot rescue a biased sampling process. Provenance also determines what claims a model can support: a dataset gathered for one population or purpose may not generalize to another. Synthetic data changes the source of error rather than eliminating error. Its value depends on which structures it preserves and which it smooths away, a particularly important limitation when rare events are exactly what a system must detect.

Use causal tests and uncertainty intervals to temper confident claims.

Association is not cause. A predictive model may find that two variables move together without identifying what would happen if one changed. Causal inference begins with a hypothesis about relationships, defines the effect to estimate, measures its strength, and tests alternative explanations. The book recommends checks such as using a placebo treatment that should produce no effect and examining whether estimates change across samples.

Report how shaky the estimate is. Aleatoric uncertainty concerns ambiguity or noise in the inputs; epistemic uncertainty concerns cases outside what the model has learned. Classification confidence, the gap between the top two predicted classes, and entropy offer different views of uncertainty. Confidence intervals and bootstrap resampling show how estimates vary across samples. A fairness score that looks acceptable but has a wide interval may not support a confident conclusion.

Analysis

Causal reasoning and uncertainty address different forms of overconfidence. Causal models challenge the story behind a prediction; uncertainty estimates challenge how precisely the system knows its answer. Together they encourage a scientific posture: state assumptions, test alternatives, and make conclusions proportional to evidence. Neither is magic. Causal conclusions depend on defensible assumptions about the data-generating process, while uncertainty estimates can be poorly calibrated. Their value comes from making those limitations explicit enough to examine.

Pay trust debt before failures make it public.

Shortcuts compound. Trust debt is the future cost of neglecting safeguards, documentation, or ethical questions during development. Technical debt can arise from poorly tracked data, fragile dependencies, feedback loops, or missing monitoring. Ethical debt arises when decisions overlook potential harms, especially when those harms become visible only after deployment. In both cases, the people who bear the cost may not be the people who chose the shortcut.

Make the work organizational. The book frames responsible development as risk management as well as maintenance. Organizations can set standards, train teams to apply them, then improve the process using operational feedback. Trust needs should be assessed for each use case, with metrics and thresholds chosen alongside relevant stakeholders. A fairness or privacy intervention may cost time or performance, but ignoring a risk can create larger legal, operational, or human costs.

Analysis

The debt metaphor is powerful because it captures delayed costs and uneven repayment. Unlike ordinary software maintenance, however, ethical debt may be charged to people outside the organization, including those with little power to contest a decision. That makes prioritization more than an efficiency exercise. Risk registers and review gates can help, but they cannot substitute for meaningful participation by affected groups or for the authority to stop deployment when mitigation is inadequate.

Make every model traceable across data, decisions, and updates.

Document the pipeline, not just the model. Datasheets record how datasets were collected, processed, intended to be used, and maintained. Model cards summarize a model's intended use, evaluation, limitations, and ethical considerations. DAG Cards extend this idea to the connected pipeline, linking data transformations, upstream models, training, evaluation, and deployment.

Keep watching after release. Production data can drift, model behavior can change, and upstream components can pass their problems downstream. Monitoring records metrics over time; observability makes useful information available for diagnosing problems. The book recommends tracking trust metrics alongside performance and using anomaly detection, change-point detection, or control charts to identify meaningful shifts. Documentation is most useful when tied to actual code and updated with the system.

Analysis

Traceability turns documentation into operational memory. In complex engineering, incident analysis depends on reconstructing what changed, when, and through which dependencies. Machine learning adds hidden links: an apparently new failure may originate in a changed source dataset or upstream model. Automated documentation reduces the burden of keeping records current, but it cannot record every judgment that shaped a project. Human decisions and unresolved risks still need explicit, reviewable notes.

Demand evidence before adopting the next AI breakthrough.

Separate progress from promotion. The book cautions against claims that equate narrow benchmark results with human capability, hide limitations, or read like product marketing. Ask how a metric was measured, what uncertainty surrounds it, what human work supported the result, and whether the test resembles the intended use.

New tools solve specific constraints. Quantization can reduce the memory and compute needed to run large models, but reduced precision may worsen brittleness or disparities for underrepresented examples. Diffusion models enable powerful image generation, with their own safety and misuse concerns. Quantum machine learning remains limited to small research demonstrations in the book's account, and is not a general fix for problems in ordinary machine learning. Treat emerging methods as candidates for testing, not ready-made guarantees.

Analysis

The book's skepticism is most useful when it is discriminating rather than cynical. A research result can be genuinely important and still be far from dependable deployment. This is a familiar problem in evidence-based medicine, where efficacy under controlled conditions does not automatically establish effectiveness in everyday care. For new AI methods, the equivalent questions concern replication, external validity, costs, and failure modes. A healthy innovation culture protects room for experimentation while requiring stronger evidence as the stakes rise.

Analysis

The book's deepest contribution is a change in unit of analysis. Trustworthiness is not a score attached to a trained model; it is a set of obligations distributed across data collection, model design, interfaces, organizational decisions, and post-deployment operations. That systems view explains why technically impressive models can still fail: an unfair proxy in a dataset, an overexposed prediction API, or an unexamined feedback loop can outweigh careful model tuning.

Its practical strength is the conversion of broad principles into engineering routines. Privacy attacks become threat models and controls. Fairness becomes cohort-based measurement tied to a specified harm. Interpretability becomes a question of audience, scope, and validation. Robustness becomes deliberate testing under realistic and adversarial variation. Documentation and monitoring connect these activities to the lifespan of a product rather than leaving them in a research notebook.

The book also resists two tempting simplifications. First, no single technique is a universal safety shield: differential privacy, encryption, federated learning, fairness constraints, and explanations each address bounded problems with their own costs. Second, trust cannot be reduced to mathematical optimization. Metrics can reveal disparities, but stakeholders must still decide which outcomes matter, whose risks count, and what threshold justifies deployment.

A useful extension is to see trustworthy machine learning as a learning system for the organization itself. Monitoring only helps if someone can interpret an alert, investigate its cause, and change the product or halt it. Documentation only helps if decisions remain revisable. The central practical test is therefore not whether a team has adopted a toolkit, but whether its processes can discover harm, assign responsibility, and respond before damage becomes normal operating procedure. This makes trustworthiness less like a final certification and more like a capacity for continuous correction.

Summary in 30 Seconds
Accuracy alone cannot establish that a machine learning system is safe or fair. Test privacy risks in model outputs, measure disparate harms across relevant groups, and treat explanations as investigative aids rather than proof. Probe realistic data shifts, audit data quality and consent, and report uncertainty around estimates. Document the full pipeline and monitor it after deployment, so teams can detect problems and respond before harms become entrenched.
Contains spoilers

Last updated:

Report Issue

Review Summary

4.95 out of 5
Average of 111 ratings from Goodreads and Amazon.

Practicing Trustworthy Machine Learning receives high praise with a 4.99/5 rating from 108 reviews. Readers commend it as one of the best AI safety books with code examples, noting its consistent use of PyTorch and HuggingFace. The book assumes prior knowledge of neural network construction in PyTorch. One reviewer, who discloses being an author, highlights its uniqueness in providing code examples for AI safety, setting it apart from other books in the field.

Your rating:
4.87
87 ratings
Want to read the full book?

Glossary

Differential privacy

Limits individual data influence

A mathematical privacy method that adds controlled randomness so that an algorithm's output changes only a limited amount when one person's record is added, removed, or changed. It aims to preserve useful patterns about groups while reducing what can be inferred about an individual. Stronger protection generally comes with a cost to model accuracy or utility.

Homomorphic encryption

Computes on encrypted data

A cryptographic method that allows certain computations to be performed on ciphertext without first revealing the underlying data. The result remains encrypted and can be decrypted by someone with the appropriate key. Different forms support different operations and computational depths. It can protect data during computation, but it adds overhead and depends on secure key management.

Secure multi-party computation

Computes across private inputs

A family of methods that allows multiple parties to jointly compute a result while keeping their individual inputs private from one another. Participants contribute protected shares of their data, perform parts of a computation, and combine results. It can support collaboration, such as analysis across hospitals, without pooling raw records in one accessible database.

Federated learning

Trains where data resides

A training approach in which a model is sent to locations holding data, trained locally, and updated using information returned from those locations. Raw data need not be collected into a central database. Federated learning can reduce exposure from data centralization, but model updates and system design still require privacy and security safeguards.

Parity fairness

Compares outcomes across groups

A family of group-fairness approaches that checks whether a selected model metric is comparable across cohorts defined by sensitive or otherwise relevant attributes. The metric might be selection rates, error rates, or another task-specific measure. Parity is not a universal definition of fairness: teams must justify which groups and outcomes to compare.

LIME

Explains one local prediction

Local interpretable model-agnostic explanation is a method for approximating a complex model's behavior near a particular input with a simpler, more interpretable surrogate. It perturbs the input, observes the model's outputs, and fits a local explanation. The result describes nearby behavior, not necessarily the model's global logic or causal reasoning.

DAG Cards

Documents connected ML pipelines

A pipeline documentation approach that represents machine learning stages and their dependencies as a directed acyclic graph. It can connect data sources, transformations, models, evaluation, and deployment, including links to upstream components. The goal is to make pipeline structure and relevant metadata accessible to technical teams and organizational stakeholders.

Datasheets for Datasets

Records dataset context

A structured documentation approach for recording why a dataset was created, what it contains, how it was collected and processed, appropriate uses, distribution restrictions, and maintenance plans. It helps dataset users assess relevance, limitations, privacy concerns, and potential effects on downstream machine learning systems.

Model cards

Reports model use and limits

Structured documents that describe a machine learning model's development, intended and out-of-scope uses, evaluation data, performance and trust metrics, relevant groups or conditions, ethical considerations, and limitations. Model cards help users and developers understand what evidence supports a model and where its behavior may not be reliable.

Trust debt

Future costs of neglected safeguards

The accumulating technical and ethical costs of postponing work needed to make machine learning systems dependable and responsible. Technical trust debt can include poorly tracked data, fragile dependencies, and missing monitoring. Ethical debt can arise from assumptions or decisions that expose people to harm. The costs may surface after deployment and fall on people beyond the development team.

About the Author

Unfortunately, there is no information provided about Yada Pruksachatkun in the given documents. The author section is empty, and the other documents do not contain any biographical details or background information about the author. Without additional context, it is not possible to provide a summary about the author's life, career, or contributions to the field of machine learning or AI safety.

Download PDF

To save this Practicing Trustworthy Machine Learning summary for later, download the free PDF. You can print it out, or read offline at your convenience.
Download PDF
File size: 0.33 MB     Pages: 18

Download EPUB

To read this Practicing Trustworthy Machine Learning summary on your e-reader device or app, download the free EPUB. The .epub digital book format is ideal for reading ebooks on phones, tablets, and e-readers.
Download EPUB
File size: 1.41 MB     Pages: 20
Want to read the full book?
Follow
Listen
Home
Swipe
Library
Get App
Try Full Access for 3 Days
Listen, bookmark, and more
Compare Features Free Pro
📖 Read Summaries
Read unlimited summaries. Free users get 3 per month
🎧 Listen to Summaries
Listen to unlimited summaries in 40 languages
—
❤️ Unlimited Bookmarks
Free users are limited to 4
—
📜 Unlimited History
Free users are limited to 4
—
📥 Unlimited Downloads
Free users are limited to 1
—
Risk-Free Timeline
Today: Get Instant Access
Listen to full summaries of 26,000+ books. That's 12,000+ hours of audio!
Day 2: Trial Reminder
We'll send you a notification that your trial is ending soon.
Day 3: Your subscription begins
You'll be charged on Nov 24,
cancel anytime before.
Consume 2.8× More Books
2.8× more books Listening Reading
Our users love us
1M+ readers
Trustpilot Rating
TrustPilot
4.6 Excellent
This site is a total game-changer. I've been flying through book summaries like never before. Highly, highly recommend.
— Dave G
Worth my money and time, and really well made. I've never seen this quality of summaries on other websites. Very helpful!
— Em
Highly recommended!! Fantastic service. Perfect for those that want a little more than a teaser but not all the intricate details of a full audio book.
— Greg M
Save 62%
Yearly
$119.88 $44.99/year/yr
$3.75/mo
Monthly
$9.99/mo
Start a 3-Day Free Trial
3 days free, then $44.99/year. Cancel anytime.
Unlock a world of fiction & nonfiction books
26,000+ books for the price of 2 books
Read any book in 10 minutes
Discover new books like Tinder
Request any book if it's not summarized
Read more books than anyone you know
#1 app for book lovers
Lifelike & immersive summaries
30-day money-back guarantee
Download summaries in EPUBs or PDFs
Cancel anytime in a few clicks

Why one summary?

Scanner
Find a barcode to scan

⭐
⭐
⭐
We have a special gift for you
Open
38% off
DISCOUNT FOR YOU
⭐
⭐
⭐
$79.99
$49.99/year
Only $4.16 per month
Continue
2 taps to start, super easy to cancel
Settings
General
Widget
Loading...