Start free trial
Trending New Genres Authors
EnglishEnglish
EspañolSpanish
简体中文Chinese
繁體中文Chinese (Traditional)
FrançaisFrench
DeutschGerman
日本語Japanese
PortuguêsPortuguese
ItalianoItalian
한국어Korean
РусскийRussian
NederlandsDutch
العربيةArabic
PolskiPolish
हिन्दीHindi
Tiếng ViệtVietnamese
SvenskaSwedish
ΕλληνικάGreek
TürkçeTurkish
ไทยThai
ČeštinaCzech
RomânăRomanian
MagyarHungarian
УкраїнськаUkrainian
IndonesiaIndonesian
DanskDanish
SuomiFinnish
БългарскиBulgarian
עבריתHebrew
NorskNorwegian
HrvatskiCroatian
CatalàCatalan
SlovenčinaSlovak
LietuviųLithuanian
SlovenščinaSlovenian
СрпскиSerbian
EestiEstonian
LatviešuLatvian
فارسیPersian
മലയാളംMalayalam
தமிழ்Tamil
اردوUrdu
Searching...
SoBrief
Beyond Test Scores

Beyond Test Scores

A Better Way to Measure School Quality
What if a school's test score tells you less than the questions families need answered?
by Jack Schneider 2017 336 pages
4.13
53 ratings
Listen
Immersive
V2.3
Amazon Kindle Audible
Try Full Access for 3 Days
Unlock listening & more!
Continue

Key Takeaways

Judge schools by what they do, not by one convenient score

A misleading recommendation. In 2013, a Boston Globe housing tool told Jack Schneider’s family to move a few blocks because its school rankings favored Cambridge over their home in Somerville. The rankings relied on SAT results and adult-to-student ratios, neither a reliable portrait of what students experienced in school. Raw scores also obscured Somerville’s context: half its students came from homes where English was not the first language, and many faced economic disadvantage.

A better question. Schneider helped build a replacement tool that let families weigh different priorities, such as learning growth, resources, college preparation, school culture, and diversity. With equal weights, Somerville High ranked fifteenth among Massachusetts high schools, despite much lower rankings on raw state test scores. The point was not that one score was correct, but that school quality cannot be reduced to one.

Analysis

The opening episode captures a problem of false precision: a crisp ranking can make a weak proxy feel like a definitive answer. Personalizing priorities is a useful correction because families value different things, but it does not make the underlying data complete or neutral. A customized score can still hide uncertainty behind a polished interface. The strongest use of such a tool is as a map of questions and trade-offs, not as an automated answer about where a child belongs.

Treat test scores as clues about learning, not verdicts on schools

A real but narrow signal. Standardized tests can reveal basic academic difficulties and help identify where support is needed. But they cover a limited slice of learning, often through machine-scored questions that reward recall more readily than interpretation, creativity, or problem-solving. Psychologist Lee Shulman recalled acing multiple-choice history questions after cramming, then earning a middling course grade because he could not use those facts to build an argument.

A tilted playing field. Test results also reflect family income, parental education, language, familiarity with test content, and testing conditions. In one example, students learning English misunderstood a prompt about a mysterious trunk as referring to an elephant’s trunk. A test score can therefore describe something about a student’s current performance while telling much less about the school’s contribution or the full scope of that student’s knowledge.

Analysis

The distinction between measuring performance and explaining its causes is crucial. A score can be valid for a narrow purpose and still be misused as evidence about an entire institution. The same caution applies whenever outcomes are produced jointly by organizations and the people they serve: hospitals, for example, cannot be judged fairly without considering patients’ starting conditions. Yet context must not become an excuse to accept persistent gaps. The useful response is neither dismissal nor blind faith, but comparison of multiple forms of evidence.

Notice how rankings turn unequal starting points into school stigma

Numbers travel farther than context. A low test average can follow a school into news stories, real-estate listings, and family conversations, even when the number reflects student background as much as school practice. Commercial rating sites often simplify scores further, presenting schools as a ladder from best to worst. That can make a small numerical difference seem like a meaningful difference in children’s daily lives.

Stigma reshapes schools. Families may use race or income as shortcuts for judging quality, even though neither is a direct measure of teaching. When families with more resources leave, schools can lose advocacy and community support; students can also see that families with options have gone elsewhere. The result is a feedback loop: limited measures strengthen a negative reputation, and the reputation can deepen the conditions the ranking was supposed to describe.

Analysis

The book’s account treats reputation as an active force, not a harmless label. A rating changes what families consider, where money flows, and which schools gain influential advocates. This is a reminder that public information systems do not merely report social reality; they can help organize it. Still, reputation is not always baseless, and stigma should not shield schools from scrutiny. Fair evaluation must separate evidence of institutional practice from demographic signals while remaining alert to real failures within any population.

Measure the conditions for learning, not only its testable outcomes

Schools are ecosystems. Schneider’s framework begins with conditions that make good learning possible: capable teachers working in supportive environments, safe and trusting relationships, and adequate facilities, staff, curriculum, and community support. It also asks what students gain, including academic knowledge, engagement, problem-solving ability, preparation for work or college, civic capacity, persistence, creativity, and physical and emotional well-being.

Inputs and outcomes differ. A school can offer strong conditions without producing the same results for every student, because children arrive with different circumstances. Conversely, a school can post high scores while neglecting safety, arts, or student connection. The framework therefore resists a single composite grade. It is intended as a living guide that communities can revise, not a universal formula that declares every school good or bad in the same way.

Analysis

The framework’s key strength is its refusal to treat academic attainment as the sole purpose of schooling. It recognizes both instrumental goods, such as learning to reason, and goods valuable in themselves, such as safety and belonging. That breadth also creates a hard design problem: more measures mean more complexity, and some outcomes are harder to attribute to schools than others. Separating conditions from results helps clarify responsibility, but does not eliminate disputes about which goals deserve priority or how much influence schools can reasonably exert.

Build trustworthy data from surveys, student work, and repeated checks

Ask people who know the school. Student and teacher surveys can reveal safety, belonging, relationships, teaching practices, and engagement, but a vague question can measure the wrong thing. Asking whether a teacher is “good,” for instance, leaves students to decide whether that means kind, entertaining, demanding, or effective. Several precise questions about one topic are more dependable than a single broad judgment, especially when answers are compared across students, teachers, and administrative records.

Watch students do the work. Performance assessment asks students to demonstrate a skill, such as writing an argument, conducting an experiment, or solving an applied problem. Portfolios can show development over time and provide material for useful feedback, though designing tasks and training scorers takes time and money. Schneider’s team also tested Ecological Momentary Assessment, which gathers brief responses repeatedly, often by text, to capture changing experiences rather than relying on one survey day.

Analysis

This approach replaces the fantasy of a perfect measure with triangulation: different imperfect instruments can check and enrich one another. A survey captures experience; a portfolio shows work; attendance records show behavior. Agreement across these sources is more informative than a solitary statistic, while disagreement can point to a question worth investigating. The trade-off is substantial labor and the risk of survey fatigue. Data collection earns its place only when the information helps educators respond, rather than simply adding another reporting obligation.

Make school information clear without sorting every school into winners and losers

Design for interpretation. A spreadsheet full of unfamiliar measures can be public yet practically unusable. Somerville’s online tool gave each school a visual profile across several dimensions, with brief explanations and the option to explore more detail. It used colors to show distance from community-defined targets, rather than assigning one overall grade or ranking schools against one another. That mattered because every school could have strengths and weaknesses, and a relative ranking makes someone look last even when all are doing well.

A promising small test. In a deliberative poll with 45 Somerville residents, people using the richer tool rated it 15 to 25 percent higher for usefulness, learning, and confidence than the state data site. Their “I don’t know” responses about schools they did not know fell from 121 to 10. Their ratings of unfamiliar schools also more closely matched ratings from people familiar with them. The study was small, so it offers encouraging evidence, not a final verdict.

Analysis

The experiment tests an important distinction: transparency is not achieved merely by publishing information. People need an interface that helps them understand what a measure means and what it leaves out. Avoiding a league table also reduces the temptation to treat tiny differences as decisive. But visual simplicity can create its own authority. Color bands and benchmarks should remain traceable to their assumptions, and users should be able to inspect the underlying evidence rather than mistaking a friendly display for certainty.

Use accountability to direct support, not trigger automatic punishment

Testing became a governing tool. Standardized exams spread partly because they were inexpensive, easy to compare, and allowed officials to monitor schools from a distance. Under No Child Left Behind, states tested math and English annually in grades three through eight and once in high school, with sanctions for schools missing targets. The law exposed achievement gaps, but its narrow measures encouraged test-focused teaching and curriculum cuts. Its demand that every student reach proficiency by 2014 proved unworkable.

Make responsibility reciprocal. The Every Student Succeeds Act gave states more flexibility, but test scores remained central. Schneider argues for multiple measures, more emphasis on growth, local participation in setting sensible benchmarks, and a period for testing new measures before attaching consequences. Accountability should also examine whether governments provide adequate resources. Data can identify needs and guide support without automatically triggering closures, firings, or other penalties.

Analysis

The distinction between information and enforcement is more than a technical detail. When a measure carries severe consequences, people have reason to optimize the number rather than the underlying work. A supportive system can still set expectations, but it must also ask whether schools have the staff, time, and resources needed to meet them. Local input improves relevance, though it can produce uneven standards or protect entrenched interests. Shared authority therefore needs public benchmarks and transparent review, not simply deference to local preference.

Choose schools for fit, not borrowed prestige or demographic shorthand

Start with what matters to your child. Before comparing schools, families can name priorities such as special education, arts, safety, language support, distance, or challenging coursework. Then look beyond raw averages: examine growth and subgroup results, ask about teacher turnover and support staff, and visit the school. Student work, classroom interactions, schedules, and conversations with students and teachers can reveal things that a rating cannot.

Treat anecdotes carefully. Word of mouth can offer detail, but a parent usually knows one child’s experience, not the whole school. A negative story can also dominate several positive ones, and social networks often expose families to people who share their backgrounds and assumptions. The aim is not to find an abstract “best” school. It is to gather evidence from multiple sources and judge whether the school’s actual strengths fit a particular student and family.

Analysis

This advice turns school choice from brand shopping into a problem of matching needs with evidence. It also recognizes a practical limit: families differ in time, transportation, money, and access to choice, so better information alone cannot make options equal. The suggestion to visit is valuable because schools are lived environments, not just outcome reports. Yet visits are snapshots too, and polished tours can mislead. Direct observation should complement systematic data and candid conversations, not replace them.

Treat public education as a shared good, not a private race

A tree is worth more than lumber. In the closing story, a storm-damaged maple in Schneider’s yard could be valued at about $150 for its usable wood. That calculation ignored its shade, fall colors, syrup, and the swing used by his daughter. A narrow measure might have made selling the tree seem sensible while missing nearly everything that made it valuable.

Schools have the same problem. Test scores can reveal something important, just as lumber value says something about a tree. But treating scores as the whole measure reduces education to competition for status or economic advantage. Schools also help young people build relationships, discover interests, participate in civic life, and lead fulfilling lives. Better measurement matters because it can protect this broader purpose, but measurement is only a tool. The ultimate aim is to create safe, challenging, well-rounded schools for all children, not merely a few winners.

Analysis

The maple story makes the book’s deepest argument concrete: a metric is useful only in relation to the purpose it serves. The danger is not that academic outcomes matter too much in every setting, but that a narrow indicator quietly defines what counts as valuable. A broader conception also resists zero-sum thinking, since schools can improve without requiring others to decline. Still, public ideals need operational tests. The challenge is to measure humane aims without turning them into rigid targets that crowd out the very qualities they are meant to protect.

Analysis

The book’s central contribution is not simply a longer list of school indicators. It reframes measurement as a civic choice: what a society counts determines what schools are expected to become. Test scores are attractive because they are portable, cheap, and apparently objective. Their political power comes from this convenience, not from their ability to represent the full work of schooling. Schneider’s Somerville project shows how a practical alternative can begin: ask communities what matters, distinguish school conditions from student outcomes, collect several kinds of evidence, and present results in a form people can actually use.

The argument is strongest when it treats measurement as both epistemic and institutional. A narrow score can misdescribe a school, but the description can then alter enrollment, reputation, staffing, and public investment. Measurement therefore does not merely observe schools. It participates in shaping their futures. The book’s emphasis on support rather than automatic punishment follows from this insight: high stakes can encourage institutions to protect indicators instead of improving the experiences those indicators are meant to represent.

The framework also raises hard questions that it cannot settle by adding more data. Which outcomes count, who defines an acceptable level, and how should communities resolve conflicts between priorities? A locally agreed benchmark can be more legitimate than a distant mandate, but agreement is not proof of fairness. Some voices are easier to hear, and survey responses can reflect unequal expectations as well as unequal conditions. Broader systems also bring costs, privacy concerns, and the possibility of overwhelming educators with measurement work.

The most defensible reading is therefore experimental, not utopian. No scorecard can capture a school in full, and a multi-measure system can still mislead if its assumptions are hidden. Its value lies in making those assumptions visible, preserving room for context, and prompting better questions. The book asks readers to replace the fantasy of a universal ranking with a more democratic practice: define educational purposes openly, gather evidence proportionate to those purposes, and use the findings to improve the shared institution rather than sort families into winners and losers.

Summary in 30 Seconds
Test scores can reveal academic needs, but they capture only a narrow slice of learning and reflect students' backgrounds as well as school practice. A fuller assessment considers learning conditions, student growth, safety, engagement, and demonstrated skills. Surveys, student work, and repeated check-ins add useful evidence, while clear profiles help families compare priorities without reducing schools to a single rank. In a small Somerville study, residents rated a richer school information tool 15 to 25 percent higher for usefulness, and uncertainty about unfamiliar schools fell from 121 responses to 10.
Contains spoilers

Last updated:

Report Issue

Review Summary

4.13 out of 5
Average of 53 ratings from Goodreads and Amazon.

Beyond Test Scores receives high praise from readers for its insightful critique of standardized testing and proposal of alternative school evaluation methods. Reviewers appreciate Schneider's evidence-based approach, describing it as humane and progressive. The book is recommended for educators, parents, and policymakers seeking a more comprehensive understanding of school quality. Readers find it helpful in evaluating schools and making informed decisions about education. Many reviewers emphasize the book's value in challenging conventional metrics and offering a framework for assessing schools beyond test scores.

Your rating:
4.58
96 ratings
Want to read the full book?

Glossary

Somerville School Quality Framework

Broad school-quality model

A community-informed model for assessing school quality through both the conditions schools provide and the outcomes students experience. It includes teaching and the work environment, school culture, and resources, as well as academic learning and student character and well-being. The framework is intended to be revised to reflect local values and improved measurement, rather than treated as a fixed universal ranking.

Value-added measures (VAMs)

Predicted versus actual scores

Statistical estimates that compare students’ actual test results with scores predicted from factors such as prior achievement and student background. VAMs are used in efforts to estimate how much a teacher or school contributes to learning. Schneider cautions that individual teacher ratings can be unstable because of small student samples, classroom assignment patterns, delayed learning effects, and limitations in the tests themselves.

Ecological Momentary Assessment (EMA)

Repeated real-time surveys

A survey approach that asks people brief questions repeatedly in their everyday settings, rather than collecting all responses in one long survey. In the Somerville project, students received questions by text and teachers used a phone application. Repeated answers can reveal changes over time and reduce reliance on a single day’s response, though participation and access to technology must be managed carefully.

Performance assessment

Demonstrated skill assessment

An assessment that asks students to demonstrate what they can do through a task, rather than select answers on a standardized test. Examples include writing an essay, conducting a science investigation, or solving an applied mathematics problem. Tasks can provide richer evidence of learning and guide instruction, but they require well-designed rubrics, trained scorers, and procedures that make results comparable across students and schools.

Reciprocal accountability

Shared responsibility for success

An approach in which schools are accountable for their work while state and local authorities are also accountable for providing the resources and support schools need. It rejects a one-way system that judges schools by outcomes without examining the conditions governments create. Data are used to identify needs and direct assistance, alongside clear expectations for schools.

Approval zone

Community-defined target range

A benchmark range in the Somerville project representing performance that community stakeholders considered acceptable to ideal in a particular area of school quality. The team developed it through surveys and discussions with parents, teachers, principals, and administrators. It was designed to show progress toward shared expectations, not to certify that a school was perfect or to rank it against every other school.

About the Author

Jack Schneider is an education scholar and author known for his work on school evaluation and educational policy. His book "Beyond Test Scores" has been well-received by educators, parents, and policymakers for its critical examination of standardized testing and proposal of alternative assessment methods. Schneider's approach is described as evidence-based, humane, and politically progressive. He advocates for a more comprehensive evaluation of schools, considering factors such as teaching quality, school culture, resources, and academic learning. Schneider's work aims to provide a more nuanced understanding of school quality and student achievement, challenging the over-reliance on standardized test scores in educational policy and decision-making.

Download PDF

To save this Beyond Test Scores summary for later, download the free PDF. You can print it out, or read offline at your convenience.
Download PDF
File size: 0.31 MB     Pages: 15

Download EPUB

To read this Beyond Test Scores summary on your e-reader device or app, download the free EPUB. The .epub digital book format is ideal for reading ebooks on phones, tablets, and e-readers.
Download EPUB
File size: 1.37 MB     Pages: 19
Want to read the full book?
Follow
Listen1 mins
Home
Swipe
Library
Get App
Try Full Access for 3 Days
Listen, bookmark, and more
Compare Features Free Pro
📖 Read Summaries
Read unlimited summaries. Free users get 3 per month
🎧 Listen to Summaries
Listen to unlimited summaries in 40 languages
—
❤️ Unlimited Bookmarks
Free users are limited to 4
—
📜 Unlimited History
Free users are limited to 4
—
📥 Unlimited Downloads
Free users are limited to 1
—
Risk-Free Timeline
Today: Get Instant Access
Listen to full summaries of 26,000+ books. That's 12,000+ hours of audio!
Day 2: Trial Reminder
We'll send you a notification that your trial is ending soon.
Day 3: Your subscription begins
You'll be charged on Nov 25,
cancel anytime before.
Consume 2.8× More Books
2.8× more books Listening Reading
Our users love us
1M+ readers
Trustpilot Rating
TrustPilot
4.6 Excellent
This site is a total game-changer. I've been flying through book summaries like never before. Highly, highly recommend.
— Dave G
Worth my money and time, and really well made. I've never seen this quality of summaries on other websites. Very helpful!
— Em
Highly recommended!! Fantastic service. Perfect for those that want a little more than a teaser but not all the intricate details of a full audio book.
— Greg M
Save 62%
Yearly
$119.88 $44.99/year/yr
$3.75/mo
Monthly
$9.99/mo
Start a 3-Day Free Trial
3 days free, then $44.99/year. Cancel anytime.
Unlock a world of fiction & nonfiction books
26,000+ books for the price of 2 books
Read any book in 10 minutes
Discover new books like Tinder
Request any book if it's not summarized
Read more books than anyone you know
#1 app for book lovers
Lifelike & immersive summaries
30-day money-back guarantee
Download summaries in EPUBs or PDFs
Cancel anytime in a few clicks

Why one summary?

Scanner
Find a barcode to scan

⭐
⭐
⭐
We have a special gift for you
Open
38% off
DISCOUNT FOR YOU
⭐
⭐
⭐
$79.99
$49.99/year
Only $4.16 per month
Continue
2 taps to start, super easy to cancel
Settings
General
Widget
Loading...