Why Formative Assessment is Essential in Legal Education

As the ABA Council meets to consider and debate the proposed revisions to the Accreditation Standards found in section 3, The Program of Legal Education, I want to highlight a Forbes article by Michael Horn of the Clayton Christensen Institute.  Horn has been studying disruption in education for the last several years.  

If we take as a given that our goal in educating potential lawyers is for every single one of our graduates to have mastered the material before graduation, then a system that incorporates formative assessment and feedback is essential.  That’s because our current system of feedback and assessment does not ensure that students will be motivated to achieve mastery.  Why?  According to Horn, “the keys events embedded within curricula that could help students feel successful – examinations – occur [at the end of the semester].  Students generally don’t receive feedback on how they did for another couple weeks while the professor grades them.  And when the grades are handed out, the privilege of feeling successful is reserved only for the best students.  By design the rest experience failure.”  

But, according to the “Jobs To Be Done” theory that Clayton Christensen and Horn posit, law students hire law schools in part to make them feel successful and make meaningful progress.  How can our system of assessment be so out of line with what students hire us to do?

The article is definitely worth reading and explains why I envision blending online learning with active, problem-based, face-to-face instruction as a means to build motivation and thrive for mastery in learning for all our students.

What Do the Best Law Professors Do?

Kudos to fellow bloggers, Michael Hunter Schwartz, Gerry Hess and Sophie Sparrow for highlighting excellent pedagogy in their new book, What Do The Best Law Professors Do?

In the comments below, let’s share some more ideas.  What do you or your colleagues do that would make this book?

ABA FUTURE LEGAL ED TASKFORCE “WORKING PAPER” AVAILABLE: “a field manual for people of good faith.”

The ABA Taskforce on the Future of Legal Education today posted a thirty-four page “WORKING PAPER” in preparation for its next public hearing and meeting on August 10th in San Francisco see schedule. (Note: all  blue font below is my “emphasis added” in this blog post and not found in the original document).   After briefly summarizing challenges and obstacles, the Working Paper states,

The Task Force has resolved these challenges by structuring the Working Paper as a field manual for people of good faith who wish to improve legal education as a public and private good.

Early on, the  drafters alert the reader to  Section VII (“Themes Addressed to All Parties”) and call that section “the heart of the field manual.” In the Overview,  the drafters identify the following “Key themes:”

  1. “need for a systematic (rather than tactical) approach to the deficiencies of law school financing and pricing;”
  2. “greater heterogeneity in law schools and in programs of legal education;”
  3. “an increased focus on the delivery of value by law schools;”
  4. “a focus on the development of competences (sic) in graduates of legal education programs;”
  5. “the profound importance of cultural change, particularly on the part of law faculty;”
  6. “the need for changes in the regulation of legal services to support key changes in legal education;” and
  7. “the need for institutionalization of the process of assessment and improvement in legal education.”

In Section II,  the Taskforce identifies and addresses a tension in legal education (which IMHO is too often overlooked — at great risk to  American law and society). The drafters refer to it as “The Fundamental Tension.”  On the one hand, there is societal interest in the training of lawyers as a “public good” and the “centrality of lawyers in the effective  functioning of ordered society.” Requiring ethical training or encouraging faculty scholarship may be an important  “public benefit.” On the other hand, American legal education is also a “private good,” providing trained lawyers “with skills, knowledge and credentials which will enable them to earn a livelihood.” This private good aspect subjects legal education to consumer preferences and market forces. The Taskforce wisely  acknowledges that any “credible” set of recommendations will have to “carefully calibrate” the public and private concerns.

In Sections III to VI, the Report outlines guiding principles, intelligently discusses the forces and factors prompting need for action and aptly details what actions or initiatives can be realistically undertaken to effect change. The Taskforce comments that it  structured its proposed plan to:

(a) encourage and facilitate appropriate action by each actor in the legal education system; and

(b) to the extent possible coordinate those actions to achieve large-scale improvement.

In Section VII, the Working Paper lays out and develops key  themes mentioned above. In the eighth (VIII) and final section of the Working Paper, the drafters set out seven sets of specific recommendations addressed to particular “groups or actors in the system of legal education.” Some of those recommendations call for modification or elimination of current ABA standards which according to the drafters “Directly or Indirectly Raise the Cost of Delivering a J.D. Education Without Contributing Commensurately to the Goal of Ensuring that Law Schools Deliver a Quality Education.” Those include standards pertaining to tenure and security of position, faculty-student ratios, distance learning and adjunct faculty. Others call for revising, eliminating or adding standards to encourage innovation, including for programs of legal education that result in less than a J.D.  but which serves public needs for legal services:

Incentives, resources, and encouragement can be powerful supports for innovation, and these can come from many participants in the system (as well as participants outside the legal education system). The ABA Section of Legal Education can support innovation by modifying or eliminating Standards (including those governing variances) that constrain opportunities for experimentation and risk-taking. As noted above, experiments or successful risk-taking by one participant can influenceothers to go down a similar path. In addition, there exists a wealth of knowledge schools can draw, from organization theory and elsewhere,to facilitate their acting in ways that might lead to innovation.

In order to alert readers to the availability of the report as promptly as possible, I have posted immediately and have had only the briefest of opportunities to digest the Working Paper in its entirety.  So without addressing any specific recommendations, here are my thoughts as to what the Taskforce and Working Paper got right:

  • The Taskforce correctly focuses on the “Fundamental Tension” between public good and private livelihood demands.
  • The Taskforce highlights appropriately  the critical importance of providing real “value” to student-consumers (and the unfair consequences currently for need-based law students without the highest of LSAT scores).
  • The Taskforce underscores effectively the need for permanent institutionalization of ongoing assessment and improvement mechanisms for legal education.
  • The Working Paper accurately identifies  the need for correction and balance in faculty culture.
  • The Working Paper also accurately identifies the need for adjustment in curricular focus on student competencies and skills.
  • The Working Paper aptly emphasizes the need for innovation, experimentation and flexibility at this moment in legal education.

Although this “Working Paper” is a good start, the Taskforce still has more issues to include in its deliberations. I think these issues include:

  • How to continue to protect academic freedom as part of  law schools’ role in aiding the “public good.” The need to properly protect academic freedom is not a mere “hypothetical” issue as those professors and clinics who have experienced the backlash will tell you. (See also my discussion about it in an article on outcomes in the William Mitchell Law Review.)
  • How to reconnect law schools’ “public good” mission with governmental funding priorities; specifically, to revive or replace DOE funding for client-centered education, the elimination of which (20 years ago) has contributed to the current maldistribution of legal services and gaps in access to justice.
  • How to manage the risks that accompany deregulation, i.e. the potential for pragmatic market-oriented reforms to establish a de facto two-tiered system, which could exacerbate current inequities in quality of legal services and opportunities for advancement in the profession.

ABA Standards Review Committee votes for 6 credits of experiential learning

Karen Sloan at the National Law Journal reports that the ABA Standards Review Committee made some decisions during its recent meeting.  In addition to eliminating the faculty-student ratio, here are some other highlights from her article:

• The committee voted to require law students to complete at least six credit hours of experiential coursework—clinics, externships or simulation courses. That would be up from the existing one credit-hour requirement, but less than the 15 hours suggested by the Clinical Legal Education Association or the 15 hours being pursued by the State Bar of California.

• It adopted a new student-learning outcomes requirement. Law schools would have to establish a list of competencies that students must achieve and assess whether they are meeting those goals. This measure is intended to make schools look beyond bar-pass rates to determine whether they are meeting student needs. However, the recommended standard leaves law schools plenty of leeway in determining what the learning outcomes should be and how to assess them.

• The committee voted to increase the number of credits law students may receive from distance learning classes from 12 to 15 and eliminated the rule that students may take no more than four distance-learning credits per semester. Students could take a full semester of courses away from their home campus.

Read more: here.

NYT – The Unseen Costs of Cutting Law School Faculty

Take a look at this NYT’s article by University of San Diego Professor, Vic Fleischer, noting that “The law school at Seton Hall University has put its untenured faculty on legal notice that their contracts may not be renewed for the 2014-15 academic year.”  While disagreeing with the Seton Hall decision, Fleischer offers some suggestions of his own on how law schools could cut costs, “Post-tenure review (by faculty, not administrators) can ensure that faculty members remain productive. Libraries can be moved online. Clinics can be closed, and adjunct faculty can be better utilized to team-teach practical courses alongside research faculty. The size of the administrative staff can be pared down, especially those who manage programs that might be considered luxuries.”  

At a time when law schools are being criticized for paying insufficient attention to training in practical lawyering skills and professional values (not to mention, the advent of scalable online teaching technologies), I do not see how closing clinics is the answer.  I would prefer for the discussion to recognize that if we eliminate clinics altogether, then what remains to be taught in law schools could easily move online.  In an article I will be sending out next week, I go into this in a lot more depth. 

ABA Task Force on the Future of Legal Education

The Task Force on the Future of Legal Education held a mini-conference on Wednesday.  Karen Sloan wrote an overview of the conference, ABA Struggles for Answers on Law School Reform.  An overview of the Task Force’s discussion items (from its Dec meeting) is available here.  That document focuses a lot on innovation.  Here is an excerpt:

Law Schools and Others in Legal Education Should Promote Innovation in Pedagogy

1. Law schools and law faculties should make use of knowledge and experience from other disciplines to support innovation in teaching methodologies.

2. Law schools should make use of technology in to innovate and improve pedagogy.

3. Law schools and law faculties should collaborate to facilitate innovation and improvement of pedagogy.

4. Bar admission authorities should recognize law school courses taught by innovative pedagogy.

A (long) video of the mini-conference is available here.