Slowly but surely the testing powers that be are realizing this problem.  The new AP Biology tests, for example, “reduce memorization and foster analytic thinking” (http://www.nytimes.com/2011/01/30/education/30advanced.html) 

infoneer-pulse:

The first-ever use of interactive computer tasks on a national science assessment suggests that most U.S. students struggle with the reasoning skills needed to investigate multiple variables, make strategic decisions, and explain experimental results.

Paper-and-pencil exams measure how well students can critique and analyze studies. But interactive tasks also require students to design investigations and test assumptions by conducting an experiment, analyzing results, and making tweaks for a new experiment. Those real-world skills were measured for the first time on the science component of the National Assessment of Educational Progress (NAEP) that was given in 2009 to a representative sample of students in grades four, eight, and 12.

“Before this, we’ve never been able to know if students really could do this or not,” says Alan Friedman, a member of National Assessment Governing Board, which sets policy for NAEP. The overall scores on the 2009 science test were released in January 2011, and today’s announcement focuses on the results from the portion of the test involving interactive computer tasks.

» via Science