The San Diego Union-Tribune, September 7, 2006, Thursday

Copyright 2006 The San Diego Union-Tribune
The San Diego Union-Tribune

September 7, 2006 Thursday

SECTION: NEWS; Pg. A-1


HEADLINE: How useful are annual college rankings?;
The business is growing, but many experts have doubts about objectivity

BYLINE: Eleanor Yang Su, STAFF WRITER

BODY:
Eva Ostrum has seen it several times: a father, eager to find the best college for his teenager, would arrive at a counseling appointment armed with spreadsheets filled with schools and their rankings.
Ostrum would gingerly tell him to put aside the rankings before attempting a discussion about his child's passions and preferences.
"Parents need to keep in mind that rankings systems are very subjective," said Ostrum, a former assistant admissions director at Yale University and the author of "The Thinking Parent's Guide to College Admissions."
"They are more art than science."
As fall approaches, the college application process kicks into high gear.
In the past few weeks, publications grading colleges have filled the magazine stands of bookstores. The offerings range from the granddaddy of all rankings, U.S. News & World Report, which attempts to rate academic quality, to other publications that list best party and jock schools. In the past decade, the market for college guidebooks has ballooned, egged on by the competition to get into the "best" schools.
The market now includes dozens of guide books and rankings, catering to an ever-growing audience. Last year, an estimated 2.3 million students considered applying to college, said Robert Franek, the author of Princeton Review's "The Best 361 Colleges."
So what's a student to do with this explosion of information?
Some experts urge students to avoid rankings altogether, disparaging as "pseudo-scientific" a system that tries to reduce the college experience to a number. Others say the lists at least give students more information on colleges. Some say the rankings can be used, selectively, to broaden the search.
How rankings work
For more than a century, people have tried to assess how the nation's colleges stack up. As early as 1870, the U.S. Bureau of Education ranked universities based on statistical information.
Rankings have grown increasingly popular in the past two decades, despite concern by academics that the assessments weigh the high school achievements of incoming freshmen instead of measuring what the college's graduates have learned.
U.S. News & World Report rankings give the greatest weight -- 25 percent -- to a school's reputation. The magazine sends surveys to 250 institutions, asking presidents, provosts or deans to rate their peers. The method has been widely criticized for giving so much clout to administrators who spend little, if any, time in the classroom.
Some have faulted the magazine for using criteria that they say favor wealthy private schools such as: faculty salaries (7 percent), incoming students' SAT or ACT scores (7.5 percent), alumni giving rate (5 percent), and the six-year graduation rate (16 percent).
"Each of the individual components of information provided is useful and people should consider them," said Ronald Ehrenberg, a Cornell University professor who has studied rankings for more than 10 years. "But the formulas and weights are arbitrary."
U.S. News' Robert Morse, who has been in charge of compiling the rankings since 1987, said the magazine carefully considers its methodology.
"The reputation of a school is important because it's something graduates carry with them their whole life," Morse said. "It's something that's of vital importance when they go to look for their first job, or when they apply to graduate schools, since graduate schools are very status-oriented and have their own rating of schools."
Another top-seller, Princeton Review, bases its rankings almost entirely on student surveys. Last month, Princeton Review publicized 62 rankings culled from more than 115,000 self-selected student surveys.
Students attending what Princeton Review deems the nation's top 361 colleges are asked to fill out online surveys on topics ranging from "Professors Get High Marks" and "Class Discussions Encouraged" to "Reefer Madness" and "Most Beautiful Campus."
Critics say these rankings lack scientific controls. For example, even if several hundred students from one school fill out the survey, and only a handful participate from another school, each result is weighted the same.
Other criticism is rooted in the belief that colleges manipulate data to make themselves look better, by, for example, reporting what percentage of their alumni association's membership makes donations, instead of basing the figure on total living graduates.
"Are data being manipulated? I suspect they are," said Don Hossler, a professor at Indiana University who has researched rankings for 20 years. He estimates that up to one-quarter of four-year colleges participating in the rankings massage their data to look better.
"There's an over-obsession with rankings," he said.
Publications hot sellers
Last year, U.S. News & World Report sold 45,000 newsstand copies of its "Best Colleges" edition, in addition to a paid subscriber list of 2 million. On top of that, it sold "several hundred thousand" copies of its 280-plus page "America's Best Colleges" newsstand guide, which includes a directory of 1,400 colleges.
The publications range in price from a $4 magazine to books and guides that sell for between $10 to $22. Limited rankings information is also available on publications' Web sites.
"College is growing more expensive, and the rankings give people some basis to judge whether they are making a good investment in themselves," said Marc Meredith, a Stanford University doctoral student who published a paper on the effects of rankings.
That said, academics estimate that less than 10 percent of students actually consider rankings in deciding what school to attend. Most students choose a school because it's close to home and affordable, said George Kuh, an Indiana University professor who directs the National Survey of Student Engagement.
Several local students echoed that point.
"I didn't think about rankings when I was deciding which school to attend," said Shiraney Sim, a junior at San Diego State University studying business. "I wanted to stay in San Diego. I like the people here and the teachers are easy."
Many students rely on their friends' experiences.
"I have a lot of friends who came to USD and now they have great jobs," said Patrick Mahoney, a University of San Diego law student who graduated from the undergraduate program in May. "What are the rankings based on anyway? It's much better to get an insider's perspective."
Rankings have the most significance, academics said, to affluent and status-minded students, alumni, faculty, administrators and recruiters.
Employers in some fields put a premium on recruiting from highly ranked schools: investment banking, management consulting, engineering and software development.
"It matters most for students straight out of college who have less work experience and less of a track record," said John Mestepey, a vice president at Edward W Kelley and Partners, an executive search firm that was formerly known as A.T. Kearney Executive Search. "The better-ranked schools become quality screens."
Mestepey described a college's reputation as equal in importance to a recent graduate's grades, extracurricular activities, summer work experience or job interview.
Some companies, such as Qualcomm, have created their own rankings based on factors such as past hires, college curriculum and diversity.
"UC San Diego is consistently ranked for engineering, but we find that SDSU is also a great source of talent," said Adam Ward, the manager of Qualcomm's campus recruiting. "You won't find them ranked as high, but it's a great school for us nonetheless."
TOP SCHOOLS
The best national universities, according to U.S. News & World Report:
1. Princeton University
2. Harvard University
3. Yale University
4. California Institute of Technology
Massachusetts Institute of Technology
Stanford University
7. University of Pennsylvania
8. Duke University
9. Columbia University
Dartmouth College
University of Chicago
How California schools rank
U.S. News & World Report's "America's Best Colleges" guide includes directory information on 1,400 public and private American colleges and universities, including 91 in California. Experts recommend considering multiple resources when picking a college, not just looking at a ranking. Stanford and the California Institute of Technology are ranked in the top 10 of the magazine's 248 best national universities. These schools in California are also ranked by number:
21. UC Berkeley
26. UC Los Angeles (UCLA)
27. University of Southern California (USC)
38. UC San Diego (UCSD)
44. UC Irvine
47. UC Davis
UC Santa Barbara
54. Pepperdine University
76. UC Santa Cruz
88. UC Riverside
98. University of the Pacific
105. University of San Diego
112. University of San Francisco
The third and fourth tiers of the list are organized alphabetically. The University of La Verne is in the third tier grouping of 62 schools. The fourth tier includes Alliant International University, Biola University and San Diego State University. SDSU was the only California State University campus that made the national rankings list.
SOURCE: U.S. News & World Report
ADVICE FROM THE EXPERTS
Instead of rankings, look for books and guides that provide qualitative information.
Use guidebooks to get a sense of schools that fit into your academic, geographic and price range.
Consider rankings when you are interested in studying a specialty program.
Rankings differ in criteria. Some focus on diversity. Some on the night scene. Look around.
Once you have your list, visit the campuses. Sit in on classes. Ask students what they like and don't like about their school.
If you can't afford to make visits, call the admissions office and ask if they can recommend students you could call for information.
Do as much research as possible. It's easier to apply to seven or eight well-matched schools than 15 or 20 that are across the board.
Sources: Stephen Pultz, director of admissions at University of San Diego; Eva Ostrum, former assistant admissions director at Yale; Laura Clark, a former admissions officer at Princeton.

GRAPHIC: 3 CHARTS; CAPTIONS: 1. TOP SCHOOLS 2. How California schools rank 3. ADVICE FROM THE EXPERTS; PHOTOBY: 1,2. SOURCE: U.S. News & World Report 3. Sources: Stephen Pultz, director of admissions at University of San Diego; Eva Ostrum, former assistant admissions director at Yale; Laura Clark, a former admissions officer at Princeton.