AALS Conference ABA Accreditation Standards Panel – Requiring Law Schools to Measure Student Learning

Today at 4pm,  Standards Review Committee presented on the current draft  revisions to the ABA accreditation standards  and according to the conference materials on “this directional change in legal education. ”  I was delighted to hear Professor Margaret Martin Barry introduce  the panel presentation with a quote from Roy Stuckey urging the Committee to focus on the importance of reflection (which you can read about in the last post and which Roy posted on the ABA site).   Dean Steve Bahls, Chair of the Standards Review Committee, described the process which led to the current version of the proposal. He reminded the audience “that the train has not yet left the station” with respect to outcomes based accreditation and that the current draft of the proposed standards has not even reached the point to be published for comment. Instead, he insists that the “train” is still being built with respect to how to revise accreditation; he  invited written comments on the proposed standards by March 15th.  

Other panelists provided examples of the University of Dayton’s Law School’s outcomes and assessment process and of the finalized outcomes-based process used to accredit Pharmacy schools. Former AALS president Nancy Rogers expressed concern about the cost of requiring outcomes-based learning in this economic environment and queried about whether the “value added” was worth it. 

 The floor was then open for questions.  Questions ranged from “What’s the problem with the way things are?” to asking the review commission to focus on professional development of faculty as teachers.   Professor Elizabeth Schneider, chair of the the Curriculum Committee of the ABA,  expressed concern about the committee’s focus on ensuring summative assessment of outcomes as opposed to formative assessment which is the focus of much of the exciting work being done currently in legal education.  I expressed concern about the recent revision’s conflation of simulation courses and live-client clinics and encouraged the committee to review Roy’s comments on this issue. 

Bottom line – whether the train is in the station ready to leave or being assembled car by car – now is the time for all good folks to weigh in on standard revisions.

Stuckey Comments on Proposed Revisions to ABA Standards

As you know from earlier posts,  the ABA Standards Review Committee is having a meeting on its proposed revisions in January during the AALS conference. 

Best Practices author Roy Stuckey has submitted comments to the Committee (copied below).  What do you think of Roy’s comments? of the revisions? Should the Best Practices Implementation committee take a position? 

MEMORANDUM

TO:     Standards Review Committee, ABA Section of Legal Education and Admissions to the Bar

FROM:   Roy Stuckey, Professor Emeritus, Univ. of South Carolina School of Law 

DATE:  December 21, 2009 

RE:  Outcome Measures for U.S. Law Schools 

I offer these comments about the Student Leaning Outcomes Committee’s report for discussion at your January 8-9, 2010, meeting.  I am sorry that I will not be able to attend the meeting.  As explained in more detail below, my suggestions are:

1.         The Committee should either delete or substantially modify proposed S303(a)(4). 

2.         The proposed Standards should give more emphasis to the development of self-reflective skills. 

3.         The Committee should clarify the meaning of S302(b)(2)(iii).

4.         The Committee should reconsider the placement and description of skills in Alternative Two of proposed S302(b)(2)(iii).

My reasons for making these suggestions are explained in the following sections: 

1.         If adopted, the current language in proposed S303(a)(4) could be more harmful than helpful to legal education.  It says:  A law school shall offer a curriculum that requires every student to complete satisfactorily at least one appropriately supervised learning experience in either (i) a substantial simulated exercise that engages students in performances of professional skills involving a type of case or problem that practitioners encounter; or (ii) a live client clinic or field placement.

The potential harm here is in the implicit suggestion that ABA-mandated and school self-identified skills could be acquired in a single simulated exercise or a single clinical course.  Anyone who has tried to teach professional skills knows this is impossible.  Further, this language also suggests that simulated exercises, live client clinics, and field placement are equally effective and efficient at teaching the same lessons, including professional skills instruction.  This is a misconception.  Each method of instruction has unique strengths.  There is some overlap, but there are also significant differences, as my co-authors and I point out in Best Practices for Legal Education (2007) at pages 168-173, 180-184, 189-193, and 198-200. 

I submit that the accreditation Standards would be improved if this proposal is withdrawn.  Proposed S303(b)(1) (which is a modified version of existing S301(b)(1)) should be retained:  A law school shall provide substantial opportunities to students for (1) live-client clinics or other real-life experiences; . . . .

 I think we all know, as the Carnegie Report concluded, that law schools should provide multiple opportunities for students to engage in supervised law practice, but, unfortunately, we also know that most law schools would resist a mandate to do so from the ABA. 

I wish the committee would reconsider the recommendation of the Ad Hoc Working Group on Learning Outcomes to include a standard requiring law schools to offer a curriculum that requires all students to participate in multiple courses in which they perform well-supervised authentic legal work on realistic legal problems designed to encourage reflection by students on their professional experiences, the values and responsibilities of the legal profession, and the development of the ability to assess one’s own performances, levels of competence, and professional judgment.

 While not mandating any particular method for accomplishing the desired learning outcomes, this proposal makes it clear that students must participate in multiple courses in order to become adequately self-reflective about their professional development.  The importance of being self-reflective is discussed in the following section.

2.         An earlier version of the Learning Outcomes Committee’s report proposed adding the following language to S301, which describes the overall objectives of legal education:  S301(c) A law school shall strive to produce graduates who are reflective practitioners and who have the capacity and motivation to pursue expertise throughout their careers.

Language similar to this is in existing S302(b)(1): A law school shall offer substantial opportunities for live-client or other real-life practice experiences, appropriately supervised and designed to encourage reflection by students on their experiences and on the values and responsibilities of the legal profession, and the development of one’s ability to assess his or her performance and level of competence.

Of course, the development of self-reflective skills can be enhanced by educational experiences other than live-client or other real-life practice experiences, so I agreed with the initial decision to move the language into S301.  In the new draft, however, proposed S301(c) has disappeared, and Interpretation 303-3 was added on page 4:  I303-3.  A law school’s curriculum should encourage reflection by students on their values and experiences and on the values and responsibilities of the legal profession, as well as the development of one’s ability to assess his or her performance, professionalism and level of competence.

It is clear that the Committee wants law schools to produce reflective practitioners, as it should.  I do not understand the politics that resulted in the decision to move this language out of a Standard and into an Interpretation.  The skill of self-reflection should at least be on the list of mandated outcomes in S302(b)(2)(I), if not in S301. 

This is what the authors of the Carnegie Report said about the value of self-reflection:

Practical judgment depends on complex traditions of living, which can only come alive through apprenticeship experiences with exemplars of inherited judgment and skill.  Thus the apprenticeship of skill takes on critical aspects of the apprenticeship of professional identity and ethical meaning.

 For this reason, professional schools cannot directly teach students to be competent in any and all situations: rather the essential goal of professional schools must be to form practitioners who are aware of what it takes to become competent in their chosen domain and to equip them with the reflective capacity to pursue genuine expertise.  [Carnegie Report, p. 173]

Experience in the Daniel Webster Scholars’ Program in New Hampshire reinforces this point.  In that program, which allows graduates to be admitted to the New Hampshire bar without taking the bar examination, bar examiners, judges, and lawyers assess the portfolios of students enrolled in the Program to determine whether those students have the necessary knowledge, skills, and values to become competent lawyers.

The Director of the Program, John Garvey, reported at the Assessment Conference in September that the first thing those experts look at when assessing a student’s portfolio is the students’ self-critiques and self-reflections, because they recognize that a critical component of an effective and responsible lawyer is the ability to identify what one does not know and the ability and desire to achieve the necessary level of expertise.

If the development of self-reflective skills should indeed be the essential goal of legal education, it should be among the mandatory outcomes in S301 or S302, not just in an interpretation of S303.

3.         I am confused by the phrase “sufficient depth and breadth” in both alternatives to proposed S302(b)(2)(iii).                                  

S302(b)(2) requires “proficiency as an entry level practitioner,” thus, S302(b)(2)(iii) as proposed would read:  The learning outcomes shall be consistent with and support the stated mission and goals of the law school.  The learning outcomes shall include:  proficiency as an entry level practitioner in: [Alternative One]  a sufficient depth and breadth of other professional skills that the law school identifies as necessary for effective, responsible and ethical participation in the legal profession.

It does not seem to me that the phrase “sufficient depth and breadth” has any meaning.  If it does, please explain what it means.   If it does not, please remove it.

4.         I am also confused by the placement of the list of skills in Alternative Two to S302(b)(2)(iii).   . . . , which shall include trial and appellate advocacy, alternative methods of dispute resolution, counseling, interviewing, negotiating, factual investigation, organization and management of legal work, and drafting. 

If these skills are under consideration as mandatory outcomes, why put them here instead of as additional skills to consider adding to S302(b)(2)(I)? 

If the goal of the Committee is to produce a list of the basic skills that every lawyer should possess upon graduation from law school, I would note that very few lawyers practice in appellate courts, so appellate advocacy is a strange candidate for a mandatory list, as are trial advocacy skills. 

I encourage the committee to continue trying to come up with a list of skills that all law school graduates should have, but I would also point out that the MacCrate Report’s statement of skills and values does not recommend that law school graduates should possess entry level proficiency in lawyering skills.  Rather, the MacCrate Report uses language like, “a lawyer should be familiar with the skills and concepts involved in [a particular skill].”  Perhaps the committee should use similar language with regard to appellate advocacy, trial advocacy, and other skills in which entry level proficiency is not necessary. 

Thank you for considering my comments.  Good luck on your continuing work.

ABA Accreditation Standards Panel Discussion at AALS

Outcome Measures matters will be the subject of a panel on Friday afternoon put on by the AALS Executive Committee Forum with the ABA Section on Legal Education and Admission to the Bar, entitled Requiring Law Schools to Measure Student Learning: A Forum on ABA Accreditation Standards, 4:00 pm – 5:45 pm (general materials on Standards Review matters, including CLEA’s comments to date are available and others should be posted later) at http://www.abanet.org/legaled/committees/comstandards.html).

The Standards Review Committee will meet in conjunction with the AALS meeting, and as always their meetings are open.  They will be meeting on January 8, 2010 from 8:30 to 3 pm and on January 9, 2010 from 8:30 to noon in Studio 2 at the W New Orleans, 333 Poydras Street, New Orleans, LA 70130.  CLEA representatives will be present and would love the company for some or all of the time…when we have a final agenda we will share it.

[From CLEA President Kim Diana Connelly.]

Washington & Lee’s New 3rd Year Curriculum

Washington & Lee has implemented a new third year curriculum focused on experiential learning.   The Washington Post covered this story here.   But more interesting is the ongoing conversation had on the Wall Street Journal’s Law Blog on whether the 3rd year of law school is really necessary.  See “Is W&L Already providing the 3L Experience of the Future?” .

Golden Gate University’s New 1L Curriculum

The faculty at Golden Gate University School of Law unanimously approved changes to the first-year curriculum to go into effect with the class that matriculates in the fall of 2010.  They have decided to allocate a total of five credits to Legal Writing & Research for first year students (2 credits in the fall and 3 credits in the spring).  They believe that this will better prepare their students for legal work in the summer and for subsequent upper division writing courses.

In addition, they are very excited to create first-year electives that will have no more than 25 students and introduce students to a range of skills other than legal writing and research.  Students will be able to select these spring semester electives, some of which will focus on transactional skills, for example working with unmarried co-habitants who want to put their understanding in writing.  Other electives will focus more on litigation skills in the context of alleged employment discrimination on the basis of sexual orientation, or enforcing environmental laws through citizen lawsuits.  Golden Gate University will also offer one or two electives that focus on statutory interpretation and jurisprudence. 

Earlier this year the Golden Gate University School of Law faculty unanimously adopted the MacCrate skills and values as objectives of our JD program.  Creating these first-year electives will ensure that all students are not only introduced to skills such as client counseling and negotiation, but are also able to practice these during their first year and reinforce the analytical skills that they learn in the doctrinal courses.

GGU School of Law welcomes thoughts from others who are working on similar courses.  Please comment below.

How Far Will California-Irvine Go?

An article in the August, 2009, ABA Journal profiled the new law school at the University of California at Irvine which  was entering its first year.  The article reported some interesting things, including a claim that “it is designed to be among the most innovative law schools in the nation.”  Dean Erwin Chemerinsky was quoted as saying, “We have  the wonderful benefit of a blank slate and the chance to create the ideal law school for the 21st century.”  The article, however, was thin on details about plans for the curriculum.

The article reported that there will be a two semester “professionalism” course in the first year in which practictioners from many areas of practice will help students “gain a sense of the different kinds of work the profession does.”  First year students will also be required to conduct intake interviews for legal aid clients.  Two years from now, the school will require students to spend a semester in one of the eight planned in-house clinics.

So far, so good, but it is not clear how committed the school really is to innovative teaching or experiential learning.  There was no mention in the article or on the school’s website as to whether the school has clearly articulated its educational objectives or whether the program of instruction will progressively develop knowledge, skill, and values or integrate the teaching of theory, doctrine, and practice.

The Associate Dean of Clinical Education and Service Learning Programs, Carrie Hempel (formerly at Southern California) was quoted as saying that she gets the “chance to recruit a group of the finest clinicians in the country to come here and build their own dream clinical courses.”  Allowing people to come in and build their own courses does not sound like there will be a program of progressive learning into which these courses will fit.  Most unfortunately, the article makes it sound like there will be a group of people identified as “clinicians” rather than members of the faculty who happen to teach clinical courses.  I hope I am wrong.

It is not apparent that classroom instruction will be any more innovative or skilled than at traditional law schools.  The first members of the faculty were largely recruited from elite law schools, including Berkeley and Duke.  As a group, the faculty ranks 10th in the nation in ”scholarly impact,” and UC-Irvine intends to be considered an elite law school from the beginning.  All members of the faculty may be excellent teachers who are devoted to preparing students for practice, but there is no mention of this in the article or on the school’s website.

Will UC-Irvine’s law school really be an innovative place that can legitimately claim to be the ideal school for the 21st century?  I hope so, but it is too early to tell.  Meanwhile, if anyone has more details about the curriculum, please share it with us.

Roy

Clearer Goals For Legal Education: Coming Soon to A School Near You

The theme of the regional conference at Albany Law School last week was “Developing and Defining Measurable Goals for Teaching Law Students.”

On the Tuesday night before the conference, I received a copy of  proposed changes to ABA Accreditation Standards 301-305.  I will tell you a little about the new proposals, but you should read the entire document with some care.  If the proposal is adopted in anything resembling its current form, it will change legal education.  You can access the document on the website of the ABA Section of Legal Education and Admissions to the Bar at www.abanet.org/legaled/committees/comstandards.html.  Look in the section on “drafts for consideration at Standards Review Committee meetings.”  The document you are looking for is the “Learning Outcomes” draft that the committee will discuss in New Orleans on January 8-9, 2010 during the AALS meeting.

Here are two excerpts to get your attention: 

1.  “Standard 302, Learning Outcomes.  (a) A law school shall identify, define, and disseminate the learning outcomes it seeks for its graduating students and for its program of legal education to enable its students to participate effectively, responsibly and ethically in the legal profession.”

2.  “S302(b)(2) … The learning outcomes shall include . . . (2) proficiency as an entry level practitioner in:  (i) legal analysis and reasoning, legal research, problem solving, written and legal communication in a legal context;  (ii)  the ability to recognize and resolve ethical and other professional delimmas;” . . . . and more; . . . “(4) any other outcomes the school identifies as necessary or important to meet the needs of its students and to accomplish th school’s mission and goals.”

And don’t miss Standard 304, Assessment of Learning Outcomes and Institutional Effectiveness.

These proposals are not finalized, of course, but the ABA is quite serious about converting the accreditation Standards to an outcomes-focused approach rather than its current inputs-focused approach.  I support this new direction, even though I think the current proposal needs some work.

After you take a look at the proposal, share your reactions on this blog site. 

Enjoy, Roy

Call for Papers and Proposals for SALT Teaching Conference (in Hawai’i!)

Deadline for Panels and Papers–January 15, 2010

Teaching in a Transformative Era:

The Law School of the Future will examine the most pressing challenges law schools face in the 21st century.   In the midst of the nation’s worst economic crisis since the Great Depression, law schools must stay relevant and incorporate a curriculum that keeps pace with recent macroeconomic and social changes. Law professors must address a new phase of corporate and collective responsibility as well as the increasing need for social and economic justice in struggling communities nationwide and globally.

Law schools must improve the admission and graduation of lawyers from a broad range of racial and ethnic backgrounds who will be prepared to serve their communities in the wake of the current global economic crisis. They must also address rising student indebtedness without sacrificing quality.

Because the conference coincides with the American Bar Association’s review of law school accreditation standards, it provides an opportunity to examine structural issues such as erosion of tenure, evolution in status relationships among law faculty, and the broader tensions between accreditation standards and economic and social trends in America.

This conference provides an opportunity to engage in broad, supportive discussions about teaching. We are seeking ideas for a range of sessions including panels and workshops that fit within the conference themes, and we encourage proposals from small groups of three or four as well as from individuals. If you are proposing a panel discussion, please note whether you would be open to an additional speaker. We welcome a variety of session formats from formal papers to more informal discussion topics.

Please send your proposals to Ngai Pindell by January 15, 2010. We are currently seeking journal commitments for publication of conference papers.

Other members of the SALT Teaching Conference Committee include Raquel Aldana, Fabio Arcila, Elvia Arriola, Margaret Martin Barry, Patti Falk , Angela Onwuachi-Willig, and Aviam Soifer.

Please share information about the Teaching Conference with your colleagues, particularly new and junior faculty, who are not yet members of SALT.

Download 9-09SALT Call for Panels and Papers(2)

Educators Convene at Albany Law School to Discuss Outcomes & Objectives

On December 4, 2009, Albany Law School Dean Thomas Guernsey and keynote speaker Roy Stuckey headlined the 2009 Northeast Regional Conference “Developing and Defining Measurable Goals for Teaching Law Students.

Professor Stuckey, author of Best Practices for Legal Education and a Distinguished Professor Emeritus of Law at the University of South Carolina School of Law, spoke about “Setting Measureable Goals for Law Student Teaching,” calling out legal education for preparing students to think like appellate judges rather than lawyers.

The conference, hosted by Albany Law School, focused on the importance of setting measurable learning goals and implementing them in both the clinic and non-clinic classroom setting. Participants discussed both general trends in curriculum reform and specific ways to develop goals to measure student learning.

Professors from Syracuse University and The College of St. Rose discussed “Pedagogy and Course Goals.”

The conference was sponsored by the AALS Section on Legal Education, Albany Law School, Syracuse University College of Law, University at Buffalo Law School and Vermont Law School.

Audio of the conference’s presentations,  including Professor Stuckey’s Keynote address.

2009 Northeast Regional Conference at Albany Law School

Apprenticeships – a best practice?

I recently returned from Serbia and Macedonia on a Public Interest Law Institute trip to help assess which Balkan law schools should join PILI’s expanding legal education reform project. Some professors were surprised that US law schools are also wringing their collective hands about how to give ideally all law students more meaningful experiential learning opportunities. But what really surprised our counterparts is that US law graduates can sit for the bar and get a license whether or not they’ve had any practice experience. Indeed, according to The Equal Justice Works Guide to Law Schools, most schools don’t collect information about whether their students had any hands-on experience before getting a diploma. Continue reading

Another Interdisciplinary Collaboration—this time with a Professor of German!

The University of New Mexico International Studies Institute has a relationship with the German government in which the Institute runs a summer program at a castle near Dusseldorf known as Schloss-Dyck. In summer 2010, I am going to have the privilege of teaching in the program with a Jason Wilby, a UNM visiting Professor of German. We put a joint proposal together. He will teach about the culture, political environment and constitutional framework right after the Weimar Republic was created as a result of WWI. I will teach about the Nuremberg trials, with a particular focus on the trial of the prosecutors and judges. The courses will are open to undergraduates and graduate students (who will have to write a research paper in addition to meeting the requirements for the course). And, as always, I learn a great deal from my colleagues on main campus. They seem comfortable with outcome-based evaluation. Continue reading

Standards Review Committee

Anything new with the ABA Section of Legal Education & Admissions to the Bar’s Standards Review Committee?

Best Practices devotees know that  in Sept. 08 the committee began a comprehensive review of standards that includes considering the contents of  reports by two special subcommittees, on Outcome Measures and Security of Position and comments on the reports.

My sources describe the committee as “in a deregulatory mood”  and the current version of the Outcome Measures report as “surprisingly good”.   Not  yet having coalesced around a decision, at their October 9-10 meeting the committee did the usual for complex issues & referred the Outcome Measures report back to committee.

Next meeting: January 8 and 9, New Orleans at the AALS Convention.  Stop by!  (Don’t expect them to be taking comments at this meeting.)

Cost of Legal Education

A recent GAO report, HIGHER EDUCATION: Issues Related to Law School Cost and Access is garnering attention in the blogosphere ( clinicians -with-not-enough-to-do, poverty law) and more conventional media.

Responding to a GAO survey, law schools blamed  a move toward ” a more hands-on, resource-intensive approach to legal education” and competition for US News rankings for increases in tuition, not ABA accreditation standards. More resource intensive legal education included: clinical and skills courses; diversity of specialized course offerings; increased students support – academic, career services, admission .

The report made no attempt to evaluate the relative role of the three cited factors.  On the surface it seems intuitively obvious that clinical and skills courses would be more expensive than “podium” courses.  For better and worse many schools  rely heavily on grant and other outside funding, as well as low-cost adjunct faculty, for clinical and skills course, which would, of course, reduce the cost of such courses to the law schools.  So interesting question whether clinical and skills courses deserve their “star billing” on this list.

Note that many – but not all –  “best practices” are more resource intensive than dominant approaches to legal education.   “Best practices” and “more hands-on, resource- intensive”  overlap but are not identical.

Collaborative Externships Update

Almost seven  months ago I blogged about the the Laurel Rubin Rural Externship Advocacy Project sponsored by the Washington State Access to Justice and the Law School’s committee.   Externship Collaborations

In June the Project was formally launched Continue reading

Orientation Programs

A fun aspect of getting a few gray hairs: we might be around long enough to see our ideas come to fruition.   Some years ago I wrote about the important role of experiential learning in providing context for law students.  Passion, Context, and Lawyering Skills: Choosing Among Simulated and Real Clinical Experiences, 7 Clin. L. Rev. 123 (2000) and Infusing Passion and Context into the Traditional Curriculum Through Experiential Learning, 51 J. Legal Educ 51 (2001). Continue reading