An Overview of “A Study of the Relationship Between Law School Coursework and Bar Exam Outcomes”

Robert Kuehn, Professor of Law at Washington University School of Law in St. Louis, and David Moss, Associate Clinical Professor at Wayne State University Law School, recently conducted a large-scale study looking at the relationship between clinical/experiential or bar subject-matter courses and bar passage success in a paper entitled, “A Study of the Relationship Between Law School Coursework and Bar Exam Outcomes.” As a law student currently enrolled in a clinic, this study immediately piqued my interest.

This study was in response to fear that bar passage rates were down because of rising enrollment in “experiential courses” as opposed to “bar-subject courses.” Law schools began pushing students to enroll in more of these bar-subject courses to correct this so-called issue. However, Professor Kuehn and Professor Moss observed that there was no evidence to suggest that taking more bar-subject courses was appropriate advice for all students. Their study looked at this missing evidence between bar-subject courses and experiential learning and bar exam outcomes for ten years between two law schools: Washington University School of Law (WashU) and Wayne State University Law School (Wayne State). Both schools only require the designed first year courses and the upper-level writing courses mandated by ABA accreditation standards.

Previous studies performed in states like Texas, Colorado, and California looked at the effects of coursework and bar passage rates. These studies did not support the claim that taking more bar-tested law school course improve chances of passing on the first attempt. Notably, a study done in Indiana concluded, “simply forcing lower-performing students to take more upper division bar-subject courses will not solve the bar examination failure problem.”

The first goal of the present study was to determine whether a graduate’s enrollment in elective experiential courses was related to first-time bar passage success. Next, it was to assess whether enrollment in elective courses that cover bar subjects was related to bar success.

Data was collected from law school graduates from 2006-2015. The following table outlines the number of graduates with LSAT scores and bar passage rates between the two schools:

The next table looked at graduate characteristics such as undergraduate GPA, LSAT score, 1L GPA, and law GPA and their correlation with bar passage:

It wasn’t until 2005 that the ABA began requiring graduates to receive professional skills instruction with as little as one credit satisfying the requirement. In 2014, the ABA changed this to require six credits beginning with 2019 graduates. The study authors decided to track enrollment in skills courses versus bar passage over this time period.

The table above reveals a solid line depicting that average bar passage percentages were steady from 2006-2013 (this is when experiential course enrollment increased by over 50%). During the significant rise in experiential enrollment, bar passage percentages were largely steady. “Therefore, efforts to link declining nationwide bar passage rates to the rise in experiential course enrollment are not supported by national statistics.” A more likely contributing cause for bar passage declines since 2014 is weaker credentials of incoming 1Ls.

At WashU, it was found that while taking at least the average number of bar courses is associated with increased likelihood of passing the bar, there was no statistically significant increase in bar passage associated with bottom-quartile LGPA graduates who took more than the school’s average. This was similar with graduates in the bottom half of their class at Wayne State. Results for both schools indicate that graduates in bottom quartile who take fewer than the average number of bar courses at their school were associated with a significant increase in bar failure. Further, at both schools, students entering with scores lower than 150 were associated with pass rates significantly below the school’s average.

This study concluded that the claim that the dramatic decline in bar passage rates is due to law students taking more experiential courses or fewer bar-related courses is not supported. It characterized efforts to cap experiential credits in order to improve bar passages rates are “misguided,” warning that schools should not expect that “mere exposure” to more bar courses will significantly improve bar passage rates.

Also see “Legal Skills Prof Blog” and “TaxProf Blog” for more posts on this study

CLINICAL COSTS: SEPARATING FACT FROM OPINION

by Robert Kuehn,  Washington University School of Law

The late Senator Daniel Patrick Moynihan once observed, “Everyone is entitled to his own opinion, but not his own facts.” When it comes to expanding clinical legal education, the knee-jerk opinion is that it is too expensive for legal education to follow the lead of other professional schools and ensure that every student graduates with a clinical experience through a law clinic or externship. Even the richest law schools couldn’t resist playing the cost card to scare the ABA out of requiring additional professional skills training: “Requiring all law schools to provide 15 experiential credit hours to each student will impose large costs on law schools, costs that would have to be passed on to students. . . . Even a law school with significant financial resources could not afford such an undertaking.” 1

Yet, the facts show otherwise — every school, from the well-heeled to the impecunious, can provide a clinical experience to each student without increasing tuition. Indeed, an array of schools already require 15 credits of experiential coursework (simulations, law clinics & externships) and a clinical experience (a law clinic or externship) for all their J.D. students without noticeable impacts on tuition. At the City University of New York, students must take a twelve- to sixteen-credit law clinic or externship prior to graduation, and at only $15,000 in resident tuition ($24,000 non-resident). Students at the University of the District of Columbia similarly must enroll in a seven-credit law clinic in their second year and a second seven-credit clinic in their third year, paying $11,500 in resident tuition ($22,500 non-resident). Starting with the 2013 entering class, Washington and Lee University requires twenty academic credits in simulated or real-practice experiences that include at least one law clinic or externship. The professor overseeing the program explained that a review of the first few years of the new curriculum showed it is “slightly less expensive than our former, traditional third-year curriculum. And . . . than our current first and second years.”2  Most recently, Pepperdine announced that beginning with next year’s class, students must graduate with at least 15 credits of experiential course work, yet the school increased tuition for 2015 by less than its average increase for the prior three years.

These examples are consistent with studies showing that every school can afford to require a clinical experience for every J.D. student. Continue reading

New York Proposes “Experiential Learning Requirements” as Condition of Licensure: CLEA and NYS Bar Committee Respond

Readers of this blog and followers of the NCBE’s expansion remember  that this past Spring New York became the 16th state  to  adopt the Uniform Bar Examination (UBE), changing  its longstanding bar admission requirements.  Many voices opposed adoption including the New York State Bar Association (NYSBA) (see Committee on Legal Education and Admission to the Bar (CLEAB) report 10-29-2014  and vote of House of Delegates), the Clinical Legal Education Association (CLEA) and the Society for American Law Teachers (SALT).  Despite these and other  opposition voices, the proposal was adopted with the new changes going into effect for the July 2016 bar examination.

During discussion of the adoption of the UBE, the Court was encouraged  to include clinical or experiential  requirements for licensing so that lawyers admitted to the New York Bar would be ahead of the curve — a position I firmly support.   On the opposite coast, California had been engaged in a multi-year process examining licensure and profession readiness which resulted in a proposal requiring 15 credits of experiential learning before admission.  In response to the movement to incorporate experiential learning in bar admission,  the New York State Court of Appeals formed a Task Force on Experiential Learning and Admission to the Bar.  Just last month, that Taskforce requested comments on its proposal that

New York adopt a new mechanism for ensuring that all applicants for admission to the bar possess the requisite skills and are familiar with the professional values for effective, ethical and responsible practice. In light of New York’s diverse applicant pool, and in an effort to accommodate the varying educational backgrounds of applicants, the Task Force suggests five separate paths by which applicants for admission can demonstrate that they have satisfied the skills competency requirement.

The New York Law Journal examined the proposal in an article found here.   In addition, the Honorable Judge Jenny Rivera, chair of the Taskforce attended a meeting of NYSBA’s Committee on Legal Education and Admission to the Bar (CLEAB) to explain the proposal and answer questions.

It is heartening that the Court is concerned about and wants to  require the development of essential lawyering skills and professional values acquisition. However, without more, Pathway 1 of the current proposal will not actually ensure  that applicants to the bar experience the kind of skill development and value formation that the Taskforce desires.  Pathway 1, referencing new ABA standards,  requires schools to confirm that they have published  their “plan for incorporating into their curriculum the skills and professional values that,  in the school’s judgment,  are required for its graduates’ basic competence and ethical participation in the legal profession.” It also requires law schools to certify  that law graduate applicants for admission “have sufficient competency in those skills and sufficient familiarity with those values” which are publicly available on the law school’s website.  Although Judge Rivera believes that the certification process described in Pathway 1 can have some real bite, as pointed out in comments submitted by the Clinical Legal Education Association (11.9. 15 CLEA SUBMISSION ON EXPERIENTIAL REQUIREMENT ), Pathway 1 simply mirrors the experiential training requirements already mandated by the American Bar Association.     

New York’s  law school deans, not unexpectedly,  submitted comments supporting the “flexibility” of Pathway 1.  The  CLEAB report to the Experiential Taskforce expressed concern that without additional content to Pathway 1 “little will be accomplished” by the proposal.   And as one member of the NYS bar committee  argued, “what law school is going to admit that one of its graduates did not acquire the skills or  values promised on its website?”

In my opinion, the most important concern is whether applicants to the bar have ever represented or interacted with a client, or operated as a lawyer, in a live setting under guided, experienced supervision before admission.  In its comment to the Taskforce, CLEA urges that a “three- credit clinical training requirement” be added for all J. D. applicants to the New York Bar.  This makes sense.  Law school clinics and faculty-supervised externships are designed to create the very kind of skill development and value acquisition with which the Court is concerned.  And clinical faculty have developed the formative assessment tools to maximize skill and professional identity formation.

I am hopeful that, in its next iteration of the proposal, the Taskforce will heed CLEA and CLEAB’s comments and come back with recommendations that will ensure applicants for the bar are ready to engage in competent, ethical and professional representation of New York’s citizenry, corporations, and notforprofits.

 

 

 

 

Building on Best Practices now available as eBook

Are you trying to:

  • Develop a meaningful law school mission statement?
  • Understand new accreditation requirements, learning goals, and outcomes assessment?
  •  Expand your experiential offerings?  Decide whether to use modules or courses?  An on-site clinic, an externship, or community partnership?
  •  Teach ALL of your students in the most effective ways, using a full range of teaching methods?
  • Add to your curriculum more of the professional identity, leadership, intercultural, inter-professional and other knowledge, skills, and values sought by 21st century legal employers?
  • Lead thoughtfully in the face of the challenges facing legal education today?

These and other topics are addressed in Building on Best Practices:  Transforming Legal Education in a Changing World,  now available in ebook format from LexisNexis at no charge.

The print version is not yet out.  LEXIS-NEXIS is taking advance orders for $50, plus shipping.  BUT we understand that they will make one copy available to every US legal educator for free upon on request.  Details on this and international availability still to come.

Thanks, and congratulations, to book project sponsor Clinical Legal Education Association (CLEA), the more than fifty legal educators who participated as authors, and the countless others who assisted as readers and in numerous other ways.

And, a huge shout-out to my wonderful and talented co-editors, Lisa Radke Bliss, Carrie Wilkes Kaas, and Antoinette Sedillo Lopez.

LexternWeb By: Sandy Ogilvy

If you are new to externships or returning to them after being away, I would like to invite you to check out the website created for faculty and administrators of externship programs, LexternWeb.  Visit http://lexternweb.law.edu/  for links to all law school externship webpages, materials, and more.  Note that the site can always use new, updated, or corrected content.  Please send me materials or links for posting.  Also, you can subscribe to the Lextern listserv from the site and join 547 other teachers and administrators of legal externship programs in sustained dialogue about externships.  For more information, please contact me:

J.P. “Sandy” Ogilvy
Ordinary Professor of Law and
Director-CUA Innocence Project Clinic & Clemency Project,
Director-Law & Social Justice Initiatives,
Director-National Archive for Clinical Legal Education
Columbus School of Law
The Catholic University of America
Washington, DC 20064
Tel: 202-319-6195
Fax: 202-319-4459

http://www.law.edu/faculty/ogilvy/

http://lib.law.cua.edu/nacle/

http://lsji.law.edu/

http://www.law.edu/clinics/cle/InnocenceProj.cfm

Public Interest Blog: http://jogilvy.wordpress.com/

Twitter @SandyOgilvy

SSRN: http://ssrn.com/author=363920

Using Portfolios for Assessment

A few years ago I started to use student portfolios as part of the end-of-semester evaluation of my students. I have found that portfolios can be an excellent vehicle both for the student’s own self-reflection and for providing summative feedback.

Here is how I use them. At the end of the semester, I ask each student to prepare a portfolio of the written work the student did over the course of the semester. In doing so, each student is asked to read the first and final version of the principal documents that the student drafted during the semester (in the context of my cases, these include the client’s affidavit, any witness affidavits and a brief).

I also ask them to bring the drafts and final versions to the meeting. During the meeting, each student is expected to have reflected on his/her writing, considered how his/her writing progressed over the semester, and point out 2-3 improvements that he or she made. They are also expected to use the drafts to illustrate the progress.

My students find that the act of assembling the portfolio and rereading their own written work serves as a reminder of how far the student has come in crafting a legal theory or developing a factual account of the relevant events or even about some of the obstacles that he or she encountered along the way and how he or she managed to overcome them. I like this method of assessment because it is mainly about self-reflection. Each student in learning from his or her own work. The portfolio is simply a vehicle to make that learning tangible. It is a wonderfully, tangible way to show someone how much he or she has improved over the course of a semester.

I was recently speaking with Larry Farmer from Brigham Young University School of Law. He mentioned that he uses portfolios too. But in his case, they are videos. At the beginning of his course on Interviewing, before any class has been conducted, he asks each student to conduct a mock interview, which is videotaped. The students then spend the semester learning about, practicing, and refining their interviewing techniques.

Then, at the end of the semester, they are asked to review that first interview and to reflect upon their own improvement over the semester. Like the written portfolio that I use, this one also uses a student’s own work to demonstrate learning and progress. I plan to try it next semester.

Are there other ideas out there? Do you use portfolios? If so, how? How can I improve my process? I’d love to hear your thoughts in the comment section below.

Call for Talks – Igniting Law Teaching 2015

LAW PROFESSORS: Are you doing innovative things in the classroom? I would love to showcase your ideas at Igniting Law Teaching, a TEDx-styled conference on law school innovations.

The Call for Talks for Igniting Law Teaching 2015 is out, http://legaledweb.com/ilt-2015-call-for-talks. We’ll be reviewing proposals on a rolling basis, until January 15th.

The conference is March 19-20, 2015 (stay tuned for registration information) in Washington DC at American University Washington College of Law.

Last year’s conference brought together more than 40 law school academics in a TEDx-styled conference to share ideas on law school innovations. LegalED’s Teaching Pedagogy video collection includes many of the talks from last year’s conference (others are being produced and will be available soon).

The topics we addressed last year are: Flipping A Law School Course, Using the Classroom for Active Learning, Simulations, Feedback and Assessment, The Craft of Law Teaching, Applying Learning Theory to Legal Education, Beyond Traditional Law Subjects, and Teaching for the 21st Century.

We would love to hear more on these topics and also expand the horizons a bit. We designed the conference to create a forum for professors like you who are experimenting with cutting edge technologies and techniques in law teaching with the goal of spreading your ideas to the broader community. We see the conference as a way to showcase you as a leader in teaching innovation and to inspire innovation by others as well.

The Igniting Law Teaching conference is unlike other gatherings of law professors. Here, talks will be styled as TEDx Talks, with each speaker on stage alone, giving a well scripted and performed talk about an aspect of law school pedagogy. In the end, we will create a collection of short videos on law school-related pedagogy that will inspire innovation and experimentation by law professors around the country, and the world, to bring more active learning and practical skills training into the law school curriculum. The videos will be available for viewing by the larger academic community on LegalED, a website developed by a community of law professors interested in using online technologies to facilitate more active, problem-based learning in the classroom, in addition to more assessment and feedback.

This is a great opportunity to showcase your innovations to the legal academy. Consider joining us for Igniting Law Teaching 2015!

Cross-posted on the LegalTech Blog

%d bloggers like this: