Start free trial
Trending New Genres Authors
EnglishEnglish
EspañolSpanish
简体中文Chinese
繁體中文Chinese (Traditional)
FrançaisFrench
DeutschGerman
日本語Japanese
PortuguêsPortuguese
ItalianoItalian
한국어Korean
РусскийRussian
NederlandsDutch
العربيةArabic
PolskiPolish
हिन्दीHindi
Tiếng ViệtVietnamese
SvenskaSwedish
ΕλληνικάGreek
TürkçeTurkish
ไทยThai
ČeštinaCzech
RomânăRomanian
MagyarHungarian
УкраїнськаUkrainian
IndonesiaIndonesian
DanskDanish
SuomiFinnish
БългарскиBulgarian
עבריתHebrew
NorskNorwegian
HrvatskiCroatian
CatalàCatalan
SlovenčinaSlovak
LietuviųLithuanian
SlovenščinaSlovenian
СрпскиSerbian
EestiEstonian
LatviešuLatvian
فارسیPersian
മലയാളംMalayalam
தமிழ்Tamil
اردوUrdu
Searching...
SoBrief
Confident Data Skills

Confident Data Skills

Master the Fundamentals of Working with Data and Supercharge Your Career
Turn messy data into decisions people can use, and make data skills your career advantage.
by Kirill Eremenko 2018 272 pages
4.12
211 ratings
Listen
Immersive
V2.3
Amazon Kindle Audible
Try Full Access for 3 Days
Unlock listening & more!
Continue

Key Takeaways

Treat data as a record of behavior, then ask what story it can support

Everyday traces matter. Data is information about the world, not merely numbers in a spreadsheet. A commute recorded by cameras, a trip counted by transit systems, or a page highlighted on an e-reader can all leave useful traces. Eremenko calls the residue of ordinary actions data exhaust. It can reveal patterns, but it is a record of what has happened, not a direct window into what someone will do next.

Patterns become narratives. Netflix used viewing histories to identify audiences who liked both Kevin Spacey’s work and political dramas, helping inform its decision to produce House of Cards. The lesson is not that data can write a hit show. It can show creators where an audience may exist, while human judgment and creative execution remain essential.

Analysis

What's striking is the shift from treating data as a technical object to seeing it as a trace of human activity. That makes the storyteller metaphor useful: analysis assembles fragments into a defensible account. Yet traces are selective. A click can indicate interest, habit, accident, or a recommendation someone never wanted. Netflix’s example also hints at a feedback loop: past choices shape future offerings, which then shape future choices. Data can illuminate behavior, but it can also narrow the options people encounter. Strong analysis keeps those distinctions visible.

Define the business question before opening the dataset

A problem is not yet a question. A request such as customers are leaving or profits are low names a concern, but does not specify what evidence would help resolve it. The analyst must learn why the issue matters now, who needs the answer, what a useful outcome looks like, and whether the required data exists. In a case at photo company VSCO, a broad question about subscribers became a focused inquiry into which user groups were most likely to buy.

Join two perspectives. A bottom-up review of records can reveal what is happening; a top-down conversation with leaders and operating teams can explain why it matters. Combining both helps avoid technically correct advice that the organization cannot use. Agree on scope, milestones, and success criteria with stakeholders, preferably in writing, before the investigation expands.

Analysis

This is a practical defense against a common organizational failure: mistaking available data for a meaningful research agenda. The approach resembles problem framing in design and operations research, where a better definition can matter more than a more sophisticated tool. Stakeholder conversations also expose tacit knowledge that databases rarely encode. But agreement is not proof that the framing is right. Frontline employees and customers may see consequences that executives miss. A robust question should welcome those perspectives while still defining a testable decision.

Spend time cleaning data before trusting any result

Messy inputs mislead. Data preparation, also called data wrangling, makes information consistent enough for analysis. The book estimates that this work can take 60 to 80 percent of a project. Errors include incorrect entries, damaged values, missing fields, and outliers that may be either mistakes or genuine rare events. A phone number accidentally entered as product sales, for example, could badly distort an average.

Prepare, then verify. Eremenko describes ETL, or extract, transform, load: copy data from its source, standardize and clean it, then place it in a suitable destination such as a database. Keep the original intact, check row counts and vulnerable fields, and document gaps. Missing values may be derived, left blank, replaced with a median, or excluded, depending on the question. No repair is neutral: each choice affects what the analysis can claim.

Analysis

Data cleaning is not housekeeping; it is part of measurement. In measurement science, a precise calculation cannot rescue an instrument that records the wrong thing. The same logic applies here: an immaculate dataset can still represent a biased collection process. Missingness may itself carry information, while replacing every blank with an average can flatten meaningful differences. The useful discipline is to record what was changed, why it was changed, and how alternative choices might affect the result. Cleanliness improves reliability, but it does not certify truth.

Match the model to whether groups are known or hidden

Start with the task. Classification assigns records to categories already defined, such as likely to leave an airline or likely to stay. Clustering looks for groups whose number and shape are not known in advance, such as customer segments with similar spending patterns. Decision trees divide records through a sequence of tests; random forests combine many trees to make a less fragile prediction. K-nearest neighbours classifies a new case by comparing it with nearby examples.

Probabilities need context. Naive Bayes updates a probability as evidence arrives, while logistic regression estimates the likelihood of a yes-or-no outcome. The book’s breathalyser example assumes one drunk driver among 1,000 and a 5 percent false-positive rate. A positive test then means only about a 2 percent chance the driver is actually drunk. Base rates can overturn an intuitive reading of a result.

Analysis

The distinction between known labels and discovered groups is a memorable first filter for choosing a model. The breathalyser example adds a vital lesson: a test result is not the same as the probability that a person belongs to a category. Decision thresholds should reflect the cost of false alarms and missed cases, not just a model’s apparent accuracy. A further caution is that clusters are analytical constructions, not natural kinds. A model can sort people consistently without proving that its categories are meaningful or fair.

Balance exploration with exploitation when every test has a cost

Learn while acting. Reinforcement learning improves choices through feedback: a successful action receives a positive signal, and an unsuccessful one a negative signal. The multi-armed bandit problem models a choice among options with unknown payoffs. In the book’s casino example, each slot machine has an uncertain chance of returning a reward. Testing every machine equally may waste money; choosing one too early may miss a better option.

Adapt the experiment. Upper confidence bound, or UCB, favors options with promising results or substantial uncertainty. Thompson sampling estimates a probability distribution for each option, then samples from those estimates to choose what to try. Both balance exploration, gathering evidence, with exploitation, using the best current evidence. Unlike a basic A/B test that divides traffic evenly, these methods can shift attention toward stronger options as results accumulate.

Analysis

The bandit framing captures a real tension in experimentation: learning has value, but experiments consume time, money, or user attention. Adaptive testing can reduce the cost of prolonged equal comparisons, especially when feedback arrives continuously. However, an algorithm only optimizes the reward it is given. If a campaign maximizes clicks while harming customer trust, the model can succeed by the metric and fail by the purpose. Exploration also needs limits when the test affects health, finances, or access to essential services.

Use visuals to discover patterns and make decisions legible

Look before and after modeling. Visual analytics uses charts and interactive views to inspect data for patterns, gaps, and anomalies. It can guide an investigation, then help interpret its results. In one example, a beverage company mapped sales and store locations, noticing that product demonstrations at Sam’s Club could lift sales at nearby Walmart stores. The initial discovery prompted the team to connect location data with sales performance.

Make the evidence readable. A presentation visualization has a different audience and purpose: it must help stakeholders understand a finding. Charles Minard’s chart of Napoleon’s 1812 invasion of Russia combined troop counts, routes, geography, and temperature. It showed an army shrinking from 422,000 to 10,000 people. Clear labels, relevant context, and restrained design let one image carry a complex account.

Analysis

A visual can serve as both an analytical instrument and a communication device, but those jobs should not be confused. Exploratory graphics invite questions; polished graphics can make a conclusion feel settled. Minard’s layered map is powerful because each visual channel carries a distinct piece of evidence, while the Sam’s Club example shows how spatial context can reveal a relationship hidden in a table. Good design still requires skepticism: scales, color, and omitted categories can steer interpretation as forcefully as words.

Turn analysis into a story stakeholders can act on

Results need translation. A technically sound analysis creates little value if decision-makers cannot understand what it means. Organize the presentation around the problem, the route taken, the finding, and its practical implication. Use plain language, explain necessary technical terms, and connect results to outcomes that matter to the audience. Executives may need a credible estimate of costs or savings; operating teams may need to know what changes in their daily work.

Make the work visible. At Australian superannuation fund Sunsuper, Eremenko used analysis to reduce a customer-service backlog from 40 days to three. He then presented the approach to the operations team, helping them understand how the improvement had been achieved and where data could help again. The presentation was not decoration at the end. It helped turn a result into organizational knowledge and support.

Analysis

The emphasis on communication recognizes that analysis travels through institutions, not straight into action. A compelling account gives people enough context to judge a recommendation, and sharing the method helps build trust rather than dependence on a single analyst. The Sunsuper example also shows why a result should be paired with an explanation of how it was produced. Still, a persuasive story can overstate certainty. Good presentation makes the evidence memorable without hiding uncertainty, trade-offs, or the possibility that implementation will change the outcome.

Build safeguards alongside data use, not after a breach

Data can protect and expose. Recorded information may help diagnose illness or establish where a person was, but the same accumulation can enable surveillance, theft, or coercive decisions. The book highlights the Heartbleed security flaw, which exposed protected information from affected websites, and the Equifax breach, which potentially affected 143 million US consumers. Such examples shift the practical concern from fictional machines rebelling to people misusing systems and personal records.

Make responsibility part of the work. The author argues for educating people about how their information is collected and used rather than assuming technology can simply be stopped. For practitioners, that means asking who has access, whether collection is necessary, how sensitive records are stored, and how misuse could be prevented. The book also recommends offline backups and closing unused accounts. Useful data practice requires security and ethical judgment, not only analytical skill.

Analysis

The chapter’s strongest ethical point is that privacy risk is built into ordinary infrastructure, not reserved for dramatic AI scenarios. Security measures such as backups address data loss, while questions of consent, purpose, and access address the power created by data collection. These are related but distinct problems. Education helps users make informed choices, yet individual vigilance cannot compensate for weak institutional safeguards or opaque business practices. Responsible analysis therefore treats governance as a design requirement, not a warning label added after a system is deployed.

Combine domain expertise, practical reps, and communication to build a data career

Bring another discipline with you. Eremenko argues that experience in finance, linguistics, art, or another field can help a data practitioner ask better questions and interpret findings in context. Transferable strengths such as teamwork, visual judgment, and public speaking also matter. The book presents data work as a broad practice, not a contest to memorize every algorithm before starting.

Build skill by doing. Use public datasets to practise the whole project, from defining a problem through explaining a result. The author recommends learning tools such as R or Python, sharing work with professional communities, seeking mentors, and applying even when job descriptions request more experience than a beginner has. The point is not that technical depth is unnecessary. It is that practical judgment and clear explanations make technical skill useful to an employer.

Analysis

This career advice is strongest when understood as a combination of depth and translation: a practitioner needs enough technical competence to test claims and enough subject knowledge to know which claims matter. Public projects and mentoring can make that combination visible to employers. Communication is not a soft extra when analysis must influence decisions; it is part of the work itself. One caution is that hiring forecasts and favored tools age quickly. Durable preparation comes from learning how to frame problems, evaluate evidence, and keep adapting as software and roles change.

Analysis

Confident Data Skills is a practical introduction to data science, organized around a five-part project workflow and carried by personal stories, industry examples, and accessible explanations of algorithms. Its central contribution is a correction to the popular image of data science as coding alone. The work begins with asking a useful question, depends heavily on preparing trustworthy information, and succeeds only when results reach people who can act on them. The author’s own career narrative reinforces the claim that prior expertise and communication are assets, not detours.

The book is especially effective at making technical distinctions usable. It separates classification from clustering, explains why base rates change the meaning of test results, and makes exploration versus exploitation intuitive through the slot-machine problem. Its examples give beginners handles for understanding methods without requiring immediate mastery of mathematics. That accessibility also creates a limit: algorithms can sound more decisive than they are. Actual model performance depends on choices about variables, data quality, thresholds, and consequences. A clean prediction is not automatically causal evidence, a fair decision, or a wise business choice.

The strongest reading of the book is therefore as a map for entering the discipline, not a substitute for technical training or ethical governance. Its workflow asks practitioners to combine evidence with institutional context: consult stakeholders, preserve and check data, select methods suited to the question, and communicate uncertainty. The privacy discussion is valuable, though the suggestion that society should adapt to data collection can understate asymmetries between individuals and institutions. Consent is not meaningful when people cannot understand or refuse the terms. Taken together, the book offers a durable professional principle: data becomes valuable through disciplined interpretation, and that interpretation remains a human responsibility.

Summary in 30 Seconds
Useful analysis starts with a precise business question, not with a dataset. Data preparation can consume 60 to 80 percent of a project, and every choice about missing or unusual values shapes the result. Match methods to the task, and account for base rates: with one case among 1,000 and a 5 percent false-positive rate, a positive result may mean only a 2 percent chance of the condition. Clear visuals and plain-language explanations help teams act, while privacy and security belong in the work from the start.
Contains spoilers

Last updated:

Report Issue

Review Summary

4.12 out of 5
Average of 211 ratings from Goodreads and Amazon.

Confident Data Skills receives mostly positive reviews, praised for its comprehensive overview of data science careers and skills. Readers appreciate the accessible explanations of complex topics, practical examples, and career guidance. The book is recommended for beginners and those considering a career change. Some criticisms include repetitive content and lack of technical depth. Overall, reviewers find it a valuable introduction to data science, covering everything from problem identification to data analysis and presentation skills.

Your rating:
4.54
121 ratings
Want to read the full book?

Glossary

Data exhaust

Traces left by actions

Information produced as a by-product of ordinary activity, often without a person deliberately creating a dataset. Online searches, purchases, location records, and interactions with digital services can leave such traces. Organizations may combine them to infer interests or behavior. The term emphasizes that data collection extends beyond forms or surveys people knowingly complete.

Big data

Data beyond conventional processing

Datasets whose scale or complexity exceeds what conventional hardware and software can process in a reasonable time. The book describes them through volume, meaning size; velocity, meaning how quickly information arrives; and variety, meaning the different forms it takes. What counts as big changes as technology and processing capacity improve.

Data Science Process

Workflow from question to action

A project workflow that guides data work from defining the problem through preparing information, analyzing it, making findings visible, and communicating them to stakeholders. The book presents the stages as a way to reduce errors and keep work tied to a useful decision. It is a practical structure, not the only possible method.

ETL

Extract, transform, load

A data preparation sequence: extract information from its source, transform it into a consistent and usable form, then load it into a destination such as a data warehouse. Transformation may include joining or reshaping tables and addressing errors, missing values, and formatting problems. The goal is to make the data suitable for analysis while preserving the original source.

Unstructured analytics

Analysis of non-tabular information

Methods for working with information that does not arrive in a neat table of numerical fields, such as text, audio, video, and images. Such material often needs preparation and interpretation before it can be analyzed. The book notes that this work can involve subjective choices, especially when qualitative responses are grouped into categories.

Classification

Assign records to known groups

An analytical task that assigns new or existing observations to categories defined in advance. A model might predict whether an airline customer will stay or leave, using patterns in past customer records. Classification methods include decision trees, random forests, K-nearest neighbours, Naive Bayes, and logistic regression.

Clustering

Discover groups in data

An analytical task that finds groups of similar records when the number and identity of useful categories are not known beforehand. Methods such as K-means and hierarchical clustering organize observations according to similarity. The resulting groups can help reveal patterns, but their usefulness depends on the question and how similarity is measured.

Reinforcement learning

Learn through action and feedback

A form of machine learning in which a system explores possible actions and uses rewards or penalties from their outcomes to improve its choices. The book compares this process to learning through trial and error. It can be used when a system must act with incomplete information and update its strategy as feedback arrives.

Multi-armed bandit problem

Choose among uncertain options

A decision problem in which several options have unknown reward rates, and repeated choices are used both to learn which option is best and to earn rewards. Its name comes from the levers of old slot machines. The challenge is balancing exploration, which gathers information, with exploitation, which uses the best current estimate.

Upper confidence bound (UCB)

Choose using optimistic bounds

A strategy for the multi-armed bandit problem that tracks estimated returns and uncertainty for each option. It favors an option whose upper confidence bound is high, either because observed results are strong or because uncertainty leaves room for a better outcome. As more evidence accumulates, uncertainty narrows and choices can shift.

Thompson sampling

Sample possible option values

A probabilistic strategy for the multi-armed bandit problem. It maintains a probability distribution for each option’s likely reward, samples a possible value from each distribution, and tests the option with the strongest sampled value. New outcomes update the distributions. This approach can accommodate data updates in batches rather than requiring an update after every observation.

Visual analytics

Inspect data through visuals

The use of charts, maps, and interactive views to inspect information for patterns, anomalies, and gaps. Analysts can use visual analytics while formulating a question or examining model results. It helps people explore large datasets, but an initial visual pattern is a lead for investigation, not proof that a relationship is causal.

Fermi questions

Estimate through explicit assumptions

Interview or reasoning questions that ask for a rough estimate when exact information is unavailable. The answer is judged less by whether the final number is correct than by whether the person states assumptions, breaks the problem into manageable parts, and reasons coherently. The term refers to physicist Enrico Fermi, known for making estimates from limited information.

About the Author

Kirill Eremenko is a prominent figure in the data science education field. He is the author of "Confident Data Skills" and has created numerous online courses on data science topics. Eremenko is known for his ability to explain complex concepts in an accessible manner, making data science approachable for beginners and career changers. His work focuses on practical applications of data science in business settings. Eremenko is also the founder of SuperDataScience, an online platform offering data science courses and resources. His teaching style emphasizes building confidence and providing a comprehensive understanding of the data science landscape.

Download PDF

To save this Confident Data Skills summary for later, download the free PDF. You can print it out, or read offline at your convenience.
Download PDF
File size: 0.36 MB     Pages: 17

Download EPUB

To read this Confident Data Skills summary on your e-reader device or app, download the free EPUB. The .epub digital book format is ideal for reading ebooks on phones, tablets, and e-readers.
Download EPUB
File size: 1.44 MB     Pages: 20
Want to read the full book?
Follow
Listen
Home
Swipe
Library
Get App
Try Full Access for 3 Days
Listen, bookmark, and more
Compare Features Free Pro
📖 Read Summaries
Read unlimited summaries. Free users get 3 per month
🎧 Listen to Summaries
Listen to unlimited summaries in 40 languages
—
❤️ Unlimited Bookmarks
Free users are limited to 4
—
📜 Unlimited History
Free users are limited to 4
—
📥 Unlimited Downloads
Free users are limited to 1
—
Risk-Free Timeline
Today: Get Instant Access
Listen to full summaries of 26,000+ books. That's 12,000+ hours of audio!
Day 2: Trial Reminder
We'll send you a notification that your trial is ending soon.
Day 3: Your subscription begins
You'll be charged on Nov 25,
cancel anytime before.
Consume 2.8× More Books
2.8× more books Listening Reading
Our users love us
1M+ readers
Trustpilot Rating
TrustPilot
4.6 Excellent
This site is a total game-changer. I've been flying through book summaries like never before. Highly, highly recommend.
— Dave G
Worth my money and time, and really well made. I've never seen this quality of summaries on other websites. Very helpful!
— Em
Highly recommended!! Fantastic service. Perfect for those that want a little more than a teaser but not all the intricate details of a full audio book.
— Greg M
Save 62%
Yearly
$119.88 $44.99/year/yr
$3.75/mo
Monthly
$9.99/mo
Start a 3-Day Free Trial
3 days free, then $44.99/year. Cancel anytime.
Unlock a world of fiction & nonfiction books
26,000+ books for the price of 2 books
Read any book in 10 minutes
Discover new books like Tinder
Request any book if it's not summarized
Read more books than anyone you know
#1 app for book lovers
Lifelike & immersive summaries
30-day money-back guarantee
Download summaries in EPUBs or PDFs
Cancel anytime in a few clicks

Why one summary?

Scanner
Find a barcode to scan

⭐
⭐
⭐
We have a special gift for you
Open
38% off
DISCOUNT FOR YOU
⭐
⭐
⭐
$79.99
$49.99/year
Only $4.16 per month
Continue
2 taps to start, super easy to cancel
Settings
General
Widget
Loading...