Implementation of the ABA’s New Experiential Training Requirement: More Whimper Than Bang

Posted on April 28, 2021 by rkuehnblog

By: Robert Kuehn, Washington University School of Law

When the ABA adopted a new experiential training requirement in 2014, there was hope it would spur law schools to significantly change the way they prepared students for legal practice. The new six-credit requirement in ABA Standard 303(a)(3) was less than the fifteen credits proposed by some educators and did not include a mandate for a law clinic or externship experience. Nonetheless, the six credits were an improvement over the ABA’s previous “substantial instruction” in professional skills requirement.[1] But data from the initial implementation of the new experiential requirement suggest its effect has been more of a whimper than the bang some hoped for, with little evidence it has spurred legal education to enhance the ability of students to get hands-on training in professional skills.

            Law schools are required to report annually to the ABA on the number of seats simply “available” to students in law clinic and simulation courses and the number of field placement/externship positions actually “filled.”[2] Data from the first two years of the new six-credit requirement in 2019 and 2020 show no increase in the positions available to students in clinics or simulations and even a decrease in actual enrollment in field placement courses, when normalized to address fluctuations in nationwide law school enrollment. While some law schools have made important changes to their curriculum, the graph below indicates that, on average, schools have not reported positive changes in law clinic, field placement, or simulation data since the ABA’s adoption of the new experiential standard in 2014. The number of clinic seats available per J.D. student in 2014 was 0.27 and still only 0.28 in 2020; field placements decreased from 0.26 in 2014 to 0.24 in 2020; and seats available in simulations likewise decreased over the six-year period from 1.22 to 1.12 per student.


  Source: ABA 509 Required Disclosures at http://www.abarequireddisclosures.org/Disclosure509.aspx

            The New York Court of Appeals followed the ABA in 2015 with its own new skills competency standard for bar candidates, proclaiming that “the goal of ensuring effective, ethical and responsible legal services in New York requires more than what the new ABA Standards provide.”[3] Commentators on the proposed New York standard argued it simply mirrored the ABA’s requirement, with some additional paperwork, and would not improve the skills training of students. The graph below shows that the New York competency standard, indeed, does not appear to have spurred New York’s law schools to noticeably enhance their professional skills training of students or to provide more training than schools in states following only the ABA requirement. Although students at New York schools were offered more opportunities to enroll in simulation courses lacking the supervised experience of handling the complexities of real-life clients, opportunities to participate in a law clinic were unchanged and field placements decreased.


Source: ABA 509 Required Disclosures for 15 New York law schools

            Data from the recent Center for the Study of Applied Legal Education (CSALE) 2019-20 Survey of Applied Legal Education of 95% of law schools also show little measurable effect from the new experiential training standard.[4] Schools reported no increase in the median number of law clinic courses offered to their students since the prior 2016-17 survey and no increase in the percentage of students that graduate with a law clinic experience. Similarly, there was no reported increase in the percentage of students that graduate with an externship experience, with student demand for externship courses in 2019-20 up slightly from the last survey yet significantly less than externship demand in 2014 when the new standard was adopted. And, the percentage of schools requiring each J.D. student to participate in a law clinic or externship course as a condition of graduation only increased marginally from 20% in 2016-17 to 23% in the 2019-20 survey.

            Two thirds of schools in the CSALE survey did report making some changes to their curriculum in response to the ABA’s new experiential requirement, with almost half reporting the addition of a new law clinic, field placement, or simulation course(s), and one quarter of schools reporting increased slots available in an existing experiential course(s). A 2018 survey by Allison Korn and Laila Hlass also found that about two thirds of schools reported an expansion or enhancement of their course offerings in light of the ABA’s new experiential course requirement.[5]

            In both surveys, however, significant numbers of schools simply restructured existing courses to meet the experiential training definition, including merely relabeling parts of the first-year required legal writing course as “experiential” or offering a one-credit simulation component to a doctrinal course. Because the survey questions did not ask separately about law clinic and externship courses but grouped them with non-clinical simulation courses, the data do not reveal if legal education has increased live-client clinic or externship opportunities for students or simply adjusted to the new requirement in other ways. In the 2019-20 CSALE survey, there was a slight increase of approximately 5% in the reported percentage of students that participated in a law clinic or externship prior to graduation. But fewer than 20% of schools attributed any increase in clinic or externship demand to the new ABA requirement.

            To the extent the ABA’s new six-credit experiential requirement was intended to provide law students with more meaningful hands-on training in important professional skills, its own data do not show that intended result. In addition, surveys of schools on their implementation of the new training requirement do not show significant gains in skills training as a result of the new accreditation standard.

            It is time for the ABA to address these deficiencies by at a minimum requiring schools to report actual enrollments in law clinic and simulation courses so that the ABA can truly judge the effect of its requirement and prospective applicants to law schools will not continue to be potentially deceived by reports of ethereal “available” law clinic opportunities.[6]

            Yet students, and the clients they will soon represent in practice, deserve more than just enhanced reporting requirements. The ABA’s six-credit experiential requirement remains far below the skills training other professional schools require of their students.[7] Two recent studies on legal education have highlighted the need for greatly enhanced skills training, including mandatory clinical training prior to bar licensing.[8] The ABA should heed these calls for reform and revisit the proposals for fifteen-credits of experiential coursework and a mandatory, live-client clinical experience for all J.D. students.

[1] An ABA memorandum explained that “substantial instruction” equaled only one credit of lawyering skills instruction, which could be in a simulation course. Peter A. Joy, The Uneasy History of Experiential Education in U.S. Law Schools, 122 Dick. L. Rev. 551, 574 (2018), available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3129111.

[2] Prior to 2017, the ABA also required schools to report the actual number of students enrolled in law clinic and simulation courses, not just seats available. However, the ABA determined that asking schools to report actual enrollment, when the accreditation standard only requires “substantial opportunities,” was unnecessarily burdensome and now only requires schools to report the number of clinic and simulation opportunities that are potentially available to students.

[3] New York Court of Appeals, New Skills Competency Requirement for Admission to the Bar (Dec. 16, 2015), at

http://www.courts.state.ny.us/ctapps/news/nottobar/nottobar121615.pdf; Task Force on Experiential Learning and Admission to the Bar: Report to Chief Judge Lippman and the New York Court of Appeals 3 (Nov. 2015), at http://ww2.nycourts.gov/sites/default/files/document/files/2018-05/Experiential-Learning-Admiss2Bar-Report122015.pdf.

[4] Center for the Study of Applied Legal Education, 2019-20 Survey of Applied Legal Education (2020), available at https://www.csale.org/#results.

[5] Allison Korn & Laila L. Hlass, Assessing the Experiential (R)Evolution, 65 Villanova L. Rev. 713, 731-33 (2020), available at https://digitalcommons.law.villanova.edu/vlr/vol65/iss4/1/.

[6] One school with enrollments of approximately 300 students per class claimed in its 2018 509 Required Disclosure to prospective applicants over 1,500 seats available to students in its law clinics. Another school with a class of 100 reported over 300 clinic positions available, yet only 50 students actually enrolled in those purported available positions.

[7] See Robert R. Kuehn, Pricing Clinical Legal Education, 92 Denv. U. L. Rev. 1, App.. A (2014) (documenting one-quarter to one-third required credits in skills training for other professional schools), available at. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2318042.

[8] Deborah Jones Merritt & Logan Cornett, Building a Better Bar 75-76 (2020), available at  https://iaals.du.edu/sites/default/files/documents/publications/building_a_better_bar.pdf; Joan W. Howarth & Judith Welch Wegner, Ringing Changes: Systems Thinking About Legal Licensing, 13 Fla. Int’l L. Rev. 383, 430-31 (2019), available at https://scholars.law.unlv.edu/cgi/viewcontent.cgi?article=2220&context=facpub.

Filed under: Best Practices, Best Practices & Externships, Best Practices & Setting Goals, Best Practices and ABA Standards, Best Practices and Clinics, Clinical Scholarship | Tagged: , , , , | 3 Comments »

Dean Darby Dickerson — on Equity, Security, and Status

Posted on December 2, 2020 by davidafinger

Many of us were inspired to hear AALS President Darby Dickerson, Dean, UIC John Marshall Law School speak about “caste”, “candor”, and “change” during her address at the January 2020 Annual Meeting.

In this new article, first posted in the AALS Newsletter, she follows up with some worrisome data from the 2019-2020 CSALE study, works through potential harms to schools and students, and issues a call to action to address issues of pay equity, security, and status.

We value the conversations and discussions that often happen live and informally at in-person conferences as we share our progress (or lack thereof). So, dear readers, please let us know in the comments about any promising practices or initiatives at your schools. How are leaders addressing pay equity, security, and status in an era of hiring freezes and financial insecurity? What changes are you working toward?

Warmly,

Davida and Melanie

Filed under: Best Practices, Best Practices and Clinics, Best Practices for Institutional Effectiveness, Best Practices, Diversity & Social Justice, Best Practices, Outcomes & Assessment Techniques, Uncategorized | Tagged: , , , , | Comments Off on Dean Darby Dickerson — on Equity, Security, and Status

Refuting the False Trope on Clinical Courses and Bar Passage

Posted on January 8, 2020 by rkuehnblog

Robert Kuehn, Washington University School of Law

It has been observed that “the fewer the facts, the stronger the opinion.” Until recently, this could be said about the possible influence of enrollment in clinical courses on a student’s likelihood of passing the bar examination. While there was a shortage of empirical studies on any possible relationship, there have been plenty of opinions on how taking those courses might be harmful, opinions often reflected in graduation restrictions on clinical courses and requirements for bar subject-matter courses.

But, there are now significantly more facts to refute those opinions. Two recent, large-scale studies have both found no relationship between the number of law clinic or externship courses or credits a law graduate took and her likelihood of passing the bar exam.

In a forthcoming article in the Journal of Legal Education, academic records of ten years of law school graduates of Washington University in St. Louis and Wayne State University were reviewed for any relationship between the number of law clinic, externship, or, more generally, experiential courses or credits and bar passage. After first accounting for the possible influence of law school grades on bar passage (the most significant predictor of bar success), the study found no correlation at either school between law clinic or externship enrollment and bar passage — no relationship between participation in a law clinic or externship and passage, none between the number of clinical courses and passage, none between the number of clinical credits and passage, and no evidence that students graduating with lower GPAs were disproportionately enrolling in those courses as a way to avoid doctrinal courses (another not uncommon trope). This lack of any relationship was in spite of increased enrollment in experiential courses at both schools over the ten-year period and decreased enrollment in courses teaching material tested on the bar (referred to as bar subject-matter courses).

The article notes that nationwide data on experiential course enrollment and bar passage also belie any claim the two are related. That data indicate that as enrollment in experiential courses was increasing from 2006-2016, bar passage percentages were fairly steady and that the recent decline in passage coincided with decreased, not increased, enrollment in those courses.

A recent study commissioned by the California State Bar found a similar lack of relationship between law clinic and externship courses and bar exam performance. The study reviewed law school coursework and performance on three July exams for over 7,500 bar applicants from eleven California schools. It found no relationship between the number of academic credits from law clinic courses and exam performance, either across all schools or even when reviewing schools separately. Similarly, there was no relationship between the number of externship or internship credits and performance, again when examined across all schools or within schools. The broad range of entering credentials at the eleven schools, and lack of a relationship even within those schools, indicates that the results should be applicable to most law schools, including those with lower LSATs and undergraduate GPAs for entering students.

The study results from Washington University/Wayne State and the California State Bar are similar to smaller studies at Texas Tech and the University of Denver that also reported no statistically significant relationship between enrollment in a law clinic or externship course and bar passage.

The Washington University/Wayne State and California State Bar studies further revealed that opinions about the value of bar subject-matter courses should be moderated. There were small correlations at both schools between the number of bar subject courses and bar passage. But this result (explaining less than 5% of the variability in bar outcomes) was only for low performing students and additional courses showed no marginal benefit once students took the school’s average number of bar courses.

The California State Bar study focused on whether taking a specific course was related to performance on the bar exam topic taught in those courses. It found that neither attendance nor performance in courses covering any of the 13 bar-related topics was related to performance on the corresponding California bar exam or Multistate Bar Exam content covering that subject.

Studies at other schools also indicate that enrollment in bar subject-related courses do not support broad claims about the benefit of taking those courses.

It is time to put away the misinformed trope of participation in law clinic and externship courses harming a student’s chances of passing the bar exam and let the facts do the talking. Law schools should recognize and students should be told they can obtain valuable preparation for the practice of law by enrolling in clinical courses without affecting their likelihood of passing the bar exam.

Filed under: Uncategorized | Tagged: , , , , , , , , , , , , , | Comments Off on Refuting the False Trope on Clinical Courses and Bar Passage

%d bloggers like this: