Implementation of the ABA’s New Experiential Training Requirement: More Whimper Than Bang

By: Robert Kuehn, Washington University School of Law


When the ABA adopted a new experiential training requirement in 2014, there was hope it would spur law schools to significantly change the way they prepared students for legal practice. The new six-credit requirement in ABA Standard 303(a)(3) was less than the fifteen credits proposed by some educators and did not include a mandate for a law clinic or externship experience. Nonetheless, the six credits were an improvement over the ABA’s previous “substantial instruction” in professional skills requirement.[1] But data from the initial implementation of the new experiential requirement suggest its effect has been more of a whimper than the bang some hoped for, with little evidence it has spurred legal education to enhance the ability of students to get hands-on training in professional skills.

            Law schools are required to report annually to the ABA on the number of seats simply “available” to students in law clinic and simulation courses and the number of field placement/externship positions actually “filled.”[2] Data from the first two years of the new six-credit requirement in 2019 and 2020 show no increase in the positions available to students in clinics or simulations and even a decrease in actual enrollment in field placement courses, when normalized to address fluctuations in nationwide law school enrollment. While some law schools have made important changes to their curriculum, the graph below indicates that, on average, schools have not reported positive changes in law clinic, field placement, or simulation data since the ABA’s adoption of the new experiential standard in 2014. The number of clinic seats available per J.D. student in 2014 was 0.27 and still only 0.28 in 2020; field placements decreased from 0.26 in 2014 to 0.24 in 2020; and seats available in simulations likewise decreased over the six-year period from 1.22 to 1.12 per student.


  Source: ABA 509 Required Disclosures at http://www.abarequireddisclosures.org/Disclosure509.aspx

            The New York Court of Appeals followed the ABA in 2015 with its own new skills competency standard for bar candidates, proclaiming that “the goal of ensuring effective, ethical and responsible legal services in New York requires more than what the new ABA Standards provide.”[3] Commentators on the proposed New York standard argued it simply mirrored the ABA’s requirement, with some additional paperwork, and would not improve the skills training of students. The graph below shows that the New York competency standard, indeed, does not appear to have spurred New York’s law schools to noticeably enhance their professional skills training of students or to provide more training than schools in states following only the ABA requirement. Although students at New York schools were offered more opportunities to enroll in simulation courses lacking the supervised experience of handling the complexities of real-life clients, opportunities to participate in a law clinic were unchanged and field placements decreased.


Source: ABA 509 Required Disclosures for 15 New York law schools

            Data from the recent Center for the Study of Applied Legal Education (CSALE) 2019-20 Survey of Applied Legal Education of 95% of law schools also show little measurable effect from the new experiential training standard.[4] Schools reported no increase in the median number of law clinic courses offered to their students since the prior 2016-17 survey and no increase in the percentage of students that graduate with a law clinic experience. Similarly, there was no reported increase in the percentage of students that graduate with an externship experience, with student demand for externship courses in 2019-20 up slightly from the last survey yet significantly less than externship demand in 2014 when the new standard was adopted. And, the percentage of schools requiring each J.D. student to participate in a law clinic or externship course as a condition of graduation only increased marginally from 20% in 2016-17 to 23% in the 2019-20 survey.

            Two thirds of schools in the CSALE survey did report making some changes to their curriculum in response to the ABA’s new experiential requirement, with almost half reporting the addition of a new law clinic, field placement, or simulation course(s), and one quarter of schools reporting increased slots available in an existing experiential course(s). A 2018 survey by Allison Korn and Laila Hlass also found that about two thirds of schools reported an expansion or enhancement of their course offerings in light of the ABA’s new experiential course requirement.[5]

            In both surveys, however, significant numbers of schools simply restructured existing courses to meet the experiential training definition, including merely relabeling parts of the first-year required legal writing course as “experiential” or offering a one-credit simulation component to a doctrinal course. Because the survey questions did not ask separately about law clinic and externship courses but grouped them with non-clinical simulation courses, the data do not reveal if legal education has increased live-client clinic or externship opportunities for students or simply adjusted to the new requirement in other ways. In the 2019-20 CSALE survey, there was a slight increase of approximately 5% in the reported percentage of students that participated in a law clinic or externship prior to graduation. But fewer than 20% of schools attributed any increase in clinic or externship demand to the new ABA requirement.

            To the extent the ABA’s new six-credit experiential requirement was intended to provide law students with more meaningful hands-on training in important professional skills, its own data do not show that intended result. In addition, surveys of schools on their implementation of the new training requirement do not show significant gains in skills training as a result of the new accreditation standard.

            It is time for the ABA to address these deficiencies by at a minimum requiring schools to report actual enrollments in law clinic and simulation courses so that the ABA can truly judge the effect of its requirement and prospective applicants to law schools will not continue to be potentially deceived by reports of ethereal “available” law clinic opportunities.[6]

            Yet students, and the clients they will soon represent in practice, deserve more than just enhanced reporting requirements. The ABA’s six-credit experiential requirement remains far below the skills training other professional schools require of their students.[7] Two recent studies on legal education have highlighted the need for greatly enhanced skills training, including mandatory clinical training prior to bar licensing.[8] The ABA should heed these calls for reform and revisit the proposals for fifteen-credits of experiential coursework and a mandatory, live-client clinical experience for all J.D. students.


[1] An ABA memorandum explained that “substantial instruction” equaled only one credit of lawyering skills instruction, which could be in a simulation course. Peter A. Joy, The Uneasy History of Experiential Education in U.S. Law Schools, 122 Dick. L. Rev. 551, 574 (2018), available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3129111.

[2] Prior to 2017, the ABA also required schools to report the actual number of students enrolled in law clinic and simulation courses, not just seats available. However, the ABA determined that asking schools to report actual enrollment, when the accreditation standard only requires “substantial opportunities,” was unnecessarily burdensome and now only requires schools to report the number of clinic and simulation opportunities that are potentially available to students.

[3] New York Court of Appeals, New Skills Competency Requirement for Admission to the Bar (Dec. 16, 2015), at

http://www.courts.state.ny.us/ctapps/news/nottobar/nottobar121615.pdf; Task Force on Experiential Learning and Admission to the Bar: Report to Chief Judge Lippman and the New York Court of Appeals 3 (Nov. 2015), at http://ww2.nycourts.gov/sites/default/files/document/files/2018-05/Experiential-Learning-Admiss2Bar-Report122015.pdf.

[4] Center for the Study of Applied Legal Education, 2019-20 Survey of Applied Legal Education (2020), available at https://www.csale.org/#results.

[5] Allison Korn & Laila L. Hlass, Assessing the Experiential (R)Evolution, 65 Villanova L. Rev. 713, 731-33 (2020), available at https://digitalcommons.law.villanova.edu/vlr/vol65/iss4/1/.

[6] One school with enrollments of approximately 300 students per class claimed in its 2018 509 Required Disclosure to prospective applicants over 1,500 seats available to students in its law clinics. Another school with a class of 100 reported over 300 clinic positions available, yet only 50 students actually enrolled in those purported available positions.

[7] See Robert R. Kuehn, Pricing Clinical Legal Education, 92 Denv. U. L. Rev. 1, App.. A (2014) (documenting one-quarter to one-third required credits in skills training for other professional schools), available at. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2318042.

[8] Deborah Jones Merritt & Logan Cornett, Building a Better Bar 75-76 (2020), available at  https://iaals.du.edu/sites/default/files/documents/publications/building_a_better_bar.pdf; Joan W. Howarth & Judith Welch Wegner, Ringing Changes: Systems Thinking About Legal Licensing, 13 Fla. Int’l L. Rev. 383, 430-31 (2019), available at https://scholars.law.unlv.edu/cgi/viewcontent.cgi?article=2220&context=facpub.


Top 5 Tips for Teaching Law Online

The COVID-19 pandemic has transformed legal education.  As law professors, we find ourselves in a new era of online teaching that is fraught with uncertainties and new challenges.  We face the task of redesigning our courses while continuing to teach effectively and struggle to figure out how to design an online law course that is both effective and engaging.

As a longtime proponent of online educational programs,  I surveyed the legal academic community to identify the five most common “pain points” experienced over the last several months.  The data informed a webinar I conducted last month for the AALS Section on Technology, Law and Legal Education (click here to watch it), which I recently developed into a 3-day Bootcamp on Designing Your Online Law Course.  In this post, I address each pain point in turn, with the aim to provide strategies and highlight some advantages of online education.

Making the Experience Like a Classroom

Colleagues ask how they can replicate the traditional classroom experience.  They want to maintain lively class discussions on Zoom, but find it difficult to engage students and encourage participation.  Many struggle with multitasking between controlling the class narrative, presenting their slides, and monitoring the chat function.  So, the first pain point is how to I replicate the classroom experience using online modalities?

The answer is simple: you can’t.  Online learning is different than traditional classroom teaching.  When teaching online, we need to adopt a new mindset.  In my view, the first step in adopting a new mindset is to appreciate that “teaching” and “learning” are two different verbs performed by two distinct groups of actors.  For years, I assumed that if I taught a topic, my students learned it.  Not, I realize the mistake in that way of thinking and have started to think about teaching and learning from my students’ perspectives.  By unbundling the teaching and learning processes, we can be more deliberate about how students learn best.  I think that is the first step in building an effective online course.

 Engaging Students

Being cognizant of the learning side of the process will also guide us in engaging students.  The second “pain point” articulated has to do with student engagement; “how to I engage my students online?” The solution is to shift to a student-centered design approach.  Student-centered design is a concept I borrowed from user-centered design, a design-thinking approach that has been successfully employed by start-ups and other new ventures.

User-centered design, or design thinking, teaches us to start by gaining a deep understanding and empathizing with our end users—in this case, our students.  What do we know about our students?  We know that they are learning at home; at home they likely face many distractions, have a shorter attention span, and might be dealing with familial obligations.  If we acknowledge these realities as we develop our syllabus and engage in course design, we know that we will want to chunk up the learning into smaller pieces to keep students engaged.

Student-centered design will also guide our course design by getting us to clearly articulate the learning goals for our courses and for each unit (class, week, section).  The guiding questions here are: what do we want our students to know, be able to do, and value when they finish the course/unit?

Next, plan the assignments and readings your students can complete on their own time (cases, statutes, regulations, articles, treatises), as well as the active learning activities (chunked videos, narrated slides, podcasts, exercises, role plays, discussion boards, reflections, breakout rooms, Socratic dialogue, etc).  Lastly, give students formative assessments such as quizzes, and provide ample feedback on discussion boards and written drafts/exercises.  This may entail more planning, grading, and monitoring than in-person classes.

Assessing Learning and Providing Feedback

The third “pain point” centers around gauging student learning.  For that, online education offers a lot of options to gather feedback about and assess student learning.   You can use online tools to assess if students are moving toward the learning goals.  Indeed, online learning makes it easy to insert periodic formative assessments—either graded or ungraded – throughout the course.  In law school we are used to summative assessments.  Summative assessments, while the cornerstone of gauging law school performance, do not give students feedback as they are in the process of learning.  Learning theory tells us that students learn best when they get immediate feedback.  It also keeps them engaged in the learning process.  Moreover, the results will show you how effective your own course is—allowing for better course design, iteration and corrections, as needed.  Formative assessments come in many forms, from multiple choice quizzes to demonstrate basic remembering and understanding, to problems that ask students to apply facts to the law or analyze case holdings.  When inserted into your learning management system, you can also provide an answer key and pre-written explanations, so that the students get feedback close in time to taking the assessment.

Maximizing Your Impact

Another question that I am asked a lot by law professors relates to using our time most efficiently.  Online education certainly requires a more steady upfront investment of time.  I think that to maximize our impact as professors, we should think about how to use space and time differently.  By that I mean, we should consider what aspects of our syllabi need to be done in person, and what parts can be performed by students on their own time or in small groups.  I think that as you start to consider this question and become more comfortable with the affordances made possible through online technologies, you will find that there are lots of asynchronous ways to engage students in learning.  For example, rather than leading an entire several-hour class online, consider asking students to work independently or in small groups on problems or projects and then reconvene and debrief.  On Zoom, you can drop in intermittently into break out rooms to check on student progress.  Rather than devoting the entire class period to lecturing, consider adding active learning exercises such as working through problems, role plays, or simply answering their questions.

Working with Technology

Finally, the pain points of many professors center around using new technologies.  That is totally understandable.  Utilizing current technology can be overwhelming, especially for supporting active learning in a completely synchronous context.  The key is to start slowly by learning a few tools at a time.  Try not to overwhelm yourself or your students with lots of new technologies at once.  Use existing resources from your campus, or collaborate with colleagues to share the burden by sharing resources or using existing resources, such as those found on LegalED, Quimbee, BarBri, and CALI.  As you shift your mindset to online learning, remember that it is okay to make mistakes.  Students appreciate that you are learning as you go—just like them.

I really enjoy teaching online and hope you will, too.  If you are experiencing pain points that I missed here, please share them in the comments below.  As always, I’d love your feedback.

 

Addressing Structural Racism in Law School: CUNY Law Faculty Issues Statement and Demand for Action

At law schools across the country, we are grappling with how to respond to internal and external conversations about the role of the legal profession in addressing structural racism, white supremacy, and racist policing. At CUNY Law School, Black faculty and non-Black faculty of color recently drafted and published a Statement and Demand for Action that was endorsed by the full faculty. The impressive and comprehensive statement outlines action steps, policy demands, and faculty dynamics that must change, addresses CUNY’s problematic relationship with the NYPD, and pushes for specific action to create an anti-racist campus.

As we collectively consider the path forward, what steps in CUNY’s plan resonate? What similar discussions are taking place at other law schools, and what is changing? Let us know in the comments.

 

Full text of the statement appears below this line: 

Statement and Demand for Action to Create an Anti-Racist Campus

By Black Faculty and Faculty of Color at CUNY Law

June 30, 2020

Black Faculty and Faculty of Color of CUNY School of Law issue the following statement, endorsed by the full faculty. We believe unequivocally that Black Lives Matter. We grieve with the families of Ahmaud Aubery, Rayshard Brooks, George Floyd, Tony McDade, Breonna Taylor, and every victim of anti-Black violence. We stand in solidarity with those who are demanding justice for their deaths, and who are fighting to dismantle white supremacy in all its forms, and specifically, systemic anti-Black racism. We join in solidarity with those in New York City and around the country who are challenging not only structural racism and racist policing, but anti-Blackness and racism in all of our institutions. The legal academy, including CUNY School of Law, are not exempt from these legacies of slavery and subjugation.

Statement and Demand for Action to Create an Anti-Racist Campus

As Black and non-Black faculty of color, we support the Movement for Black Lives Policy Platforms and stand in solidarity with the movement to defund and abolish police and redefine public safety and accountability through non-carceral investments in Black communities. Accordingly, we reject reforms that preserve the status quo.  As lawyers and educators, we acknowledge our profession’s history of upholding white supremacy and thwarting these demands. However, we are also uniquely situated to further them. Below are preliminary areas in which the law school must work in furtherance of these goals:

Our role in the legal profession: We heartily embrace the dual mission of our law school — to facilitate access to underrepresented communities historically excluded from the profession by white supremacy, and particularly anti-Blackness, and to act as an entrée into providing legal support to communities fighting against systems entrenched in white supremacy. Our view of social justice calls for a complete reimagining of the state and society. Accordingly, we seek to serve those students who will genuinely and fearlessly pursue transformative racial and economic justice.

We uplift and honor the legacy of W. Haywood Burns, the first Black law school dean in New York State, who was also the second dean of CUNY School of Law and tirelessly fought for Black liberation in and outside of the walls of CUNY Law. We are cognizant that among the central tools of oppression under white supremacy is the law, particularly as meted out by police, military and prosecutors of all stripes — be they police who criminalize or cage, police who alienize or deport, or purportedly protective agencies who demonize or separate families.

As Black and non-Black faculty of color, we are committed to dismantling these tools of oppression through a pedagogical approach that deploys critical and radical analyses to challenge our students and by offering a robust and humble praxis in service of movements that seek transformative and restorative justice.  We further reiterate the importance of affirming CUNY Law’s dual mission, from admission to graduation and beyond, through a commitment of  institutional self-reflection that is unflinching, inclusive, and continual.

Curriculum: Black students routinely call on the CUNY Law faculty to recognize and confront the negative impact that the traditional legal curriculum has had on Black students. We call on faculty to acknowledge the concerns of students of color and incorporate the feedback into their teaching.

To work towards becoming an anti-racist campus, we demand that, starting in Fall 2020, faculty mobilize pre-existing resources like the Race, Privilege, and Diversity and Professional Development committees toward educating ourselves across the administration and faculty — including adjuncts, visitors, tenure-track, and tenured faculty — on anti-Blackness, racial capitalism, state overreach into communities of color and abolition movements, particularly by engaging with work authored by Black people, incorporating critical frameworks like critical race feminism and queer theory, disability justice, abolition, and decoloniality, among others, throughout every course, and centering intersectional Black perspectives in the classroom.

To achieve these goals, we demand that CUNY Law provide the material resources so that all faculty may take the time necessary to engage in this learning and unlearning. To ensure accountability and transparency, we demand that these committees and others apprise the full faculty in writing each semester on their progress and any challenges encountered in this process.

Non-Curricular Policy Points

  • The various departments that constitute the law school make powerful choices that should be calibrated to center and uplift anti-racist objectives. We demand increased outreach to Black and non-Black students of color in admissions by the career planning office and heightened engagement with Black and non-Black alumni of color. Understanding that internships and initial jobs are key to a student’s ability to practice law over the long-term and practice in the frontlines of social justice movements, we also demand that the career planning office provide increased support to Black and non-Black students of color, particularly first-generation higher education students, whose resumes and cover letters can and should reflect the valuable perspectives and skills that each of our students has to offer the legal profession. We call on the relevant committees to report back on these developments to the full faculty in Fall 2020.
  • For too long we have participated in maintaining barriers to the legal profession even as we seek to break those down. Accordingly, we demand that, starting Fall 2020, the minimum LSAT requirement for all scholarships, including the Graduate Fellowship, be abolished and that the law school keep records of and make public the distribution of scholarship and summer fellowship funds by race. Similarly, we demand that admissions data collection be expanded beyond the required ABA categories to include more detailed, granular, and less reductive categories to better account for the multiple and diverse identities our students bring to the school. We call on the Admissions committee to report back on these developments to the full faculty on a bi-semesterly basis.
  • CUNY Law offers the services of a Nurse Practitioner and Mental Health Counselor on the premises, but otherwise, students are not offered health insurance and are instead invited to enroll in Medicaid programs during open enrollment each period. The limited resources made available are not sufficient for CUNY’s student body. Particularly given the dynamics described above, we call on the law school to consider allocation of funds to mental health services and other medical insurance.
  • Some of our academic standing policies — such as the threshold for academic probation — have a disparate impact on Black and non-Black students of color. We demand that those policies be immediately reconsidered and amended. We call on the Academic Standing committee to report back to the full faculty on these developments on a bi-semesterly basis.
  • We reiterate the importance of the role of Black and non-Black faculty of color on the faculty appointments committee. We call on the Committee on Committees to report back to the full faculty on developments to this end in Fall 2020.
  • Like many law schools, CUNY Law relies on faculty with non-secure positions for critical teaching positions. Our adjunct, visitor, instructor, and other non-tenure track faculty contribute immensely to our institution yet lack job security, opportunities for training and development, and other benefits that permanent faculty enjoy. We demand meaningful job security for our colleagues in these positions, especially Black and non-Black faculty of color. We call on all relevant committees to report back to the full faculty on progress to this end in Fall 2020.

Faculty Dynamics

  • Invisible institutional service and labor of Black and non-Black faculty of color: In 2019, 88% of lawyers were white and in 2018, 8 out of 10 law professors were white. CUNY School of Law boasts a more racially diverse faculty. We especially acknowledge the school’s laudable efforts to bring ten faculty of color, including 4 black faculty, onto the tenure track in the past 3 years alone. Nonetheless, we must do more to dismantle anti-Blackness in our governance. Black and non-Black faculty and staff of color, both at CUNY Law and throughout the U.S., routinely perform unrecognized labor beyond their job descriptions and in the service of their institutions, to confront anti-Blackness and other forms of racism. A wealth of research shows these contributions both sustain diversity and inclusion efforts in the academy and create additional demands that detract from the time required for fulfilling traditional expectations of all faculty.

Faculty of color devote significant time to mentoring and supporting Black and non-Black students of color, ensuring that our institution can retain the most marginalized students after they matriculate.  We advocate explicitly and in more personalized ways for Black and non-Black students of color, who suffer regular indignities, while we also abide microaggressions from colleagues, the profession, and indignities from broader society ourselves. We disproportionately bear the burden of ensuring equitable distribution of labor among faculty and scholarship and fellowship awards among students.

We highlight the lack of recognition (both in salary/pay and formal acknowledgement through evaluation, tenure, and promotion standards) of the amount of invisible institutional service and labor that Black and non-Black faculty and staff of color contribute to the law school.  We demand that similar to our institution’s commitment to recognizing advocacy work product as scholarship, CUNY Law change provisions in promotion, hiring, assignment to and distribution of labor on committees, and tenure policies to honestly and explicitly reflect the now hidden workload of Black and non-Black faculty and staff of color.  For example, we need more conscientious reappointment and annual review reporting policies and re-conceptualized categories of “teaching, scholarship, and service” across the faculty.  We call on all relevant committees to report back to the full faculty on progress to these ends in Fall 2020.

  • Recognition of privilege and power: We note the complex conditions inherent in participating in governance discussions. We demand that faculty be mindful of their privilege and hierarchies of power and reflect on the ways in which they participate in committees, faculty meetings, and other spaces — stepping back where appropriate.

Policing: Generations of faculty, students, and staff of color have repeatedly expressed concerns about the relationship between CUNY Law’s public safety and the New York City Police Department (NYPD). We demand that any memoranda of understanding governing the role or presence of CUNY Public Safety, of the NYPD, or of any other law enforcement agency on the CUNY School of Law campus be shared immediately with the full faculty, staff, and student body of the law school. In keeping with the demands and concerns of generations of students, faculty, and staff, we’re calling on CUNY Law School to discontinue any formal or informal relationship with NYPD and reimagine campus security by supporting the safety and well-being of the people on campus through divestment from punitive policing systems and investment in alternatives, including de-escalation, conflict resolution, and transformative and restorative justice training for all faculty, staff, and designated student representatives. The Public Safety committee was explicitly tasked with addressing these issues in the Fall of 2019. We call on that committee to report back to the full Faculty by October 2020 on progress to these ends.

Finally, we stand by Brooklyn College’s Black Faculty and Staff (BFS), Faculty of Color (FOC) Group, Latino Faculty and Staff (LFSO), and other caucus groups in the CUNY system, and we adopt our Brooklyn colleagues’ statement, slightly adapted to the law school’s context, as follows: This moment in our country is the culmination of systemic denial of dignity that typifies antiblackness. As lawyers fighting for racial and economic justice, we know that structural inequality cannot be addressed through empty statements of standing in solidarity and promoting “diversity.”

We advocate a transformational solidarity with an ethos of social justice that is action- oriented. Transformational solidarity means that the systemic racism, surveillance, and austerity that have become a normal feature of society is aggressively challenged on campus. Transformative solidarity understands that struggles against domination are shared and that anti-Blackness and austerity work in tandem and must be fought hand-in-hand. This is a fight that involves Albany and state politics but it begins with us on campus. We demand a shift in the current institutional logic of the administration that urges faculty and staff to do more for our students with less. By embracing this moment of profound possibility in response to this crisis, we hope to imagine and create a life-affirming campus we do not have, but require.

  • Chris Adams
  • Beena Ahmad
  • Naz Ahmad
  • Saba N. Ahmed
  • Bahar Ansari
  • Nermeen Arastu
  • Ann Cammett
  • Eduardo R.C. Capulong
  • Janet Calvo
  • Asima Chaudhary
  • Natalie M. Chin
  • Frank Deale
  • Farah Diaz-Tello
  • Pamela Edwards
  • Golnaz Fakhimi
  • Raquel Gabriel
  • Mary Godfrey-Rickards
  • Natalie Gomez-Velez
  • Victor Goode
  • Fareed Hayat
  • Julia Hernandez
  • Carmen Huertas-Noble
  • Chaumtoli Huq
  • Tarek Z. Ismail
  • Ramzi Kassem
  • Donna Lee
  • Degna Levister
  • Julie Lim
  • Gregory Louis
  • Lynn Lu
  • Shirley Lung
  • Princess Masilungan
  • Michelle Pinzon
  • Missy Risser-Lovings
  • Jeena Shah
  • Charisa Kiyô Smith
  • Nicole Smith
  • Yasmin Sokkar Harker
  • Cynthia Soohoo
  • Rafael Varela
  • Shomari Ward

 

We call on all of our faculty colleagues to endorse this statement, mindful that such an endorsement carries with it the responsibility of ensuring the statement’s implementation.

 

Endorsed by:

  • Mary Lu Bilek
  • Beryl Blaustone
  • Rebecca Bratspies
  • Sue Bryant
  • Janet Calvo
  • Nina Chernoff
  • Douglas Cox
  • Lisa Davis
  • Ryan Dooley
  • Dave Fields
  • Laura Gentile
  • Julie Goldscheid
  • Florence Kerner
  • JM Kirby
  • Jeffrey L. Kirchmeier
  • Sarah Lamdan
  • Stephen Loffredo
  • Matthew Main
  • Camille Massey
  • Andrea McArdale
  • Haley Meade
  • Laura Mott
  • David Nadvorney
  • Jason Parkin
  • Talia Peleg
  • Allie Robbins
  • Ruthann Robson
  • Joe Rosenberg
  • Merrick T. Rossein
  • Jonathan Saxon
  • Franklin Siegel
  • Richard Storrow
  • Erin Tomlinson
  • Sarah Valentine
  • Kara Wallis
  • Alan White
  • John Whitlow
  • Sofia Yakren
  • Deborah Zalesne
  • Steven Zeidman
  • Jean Zorn

“Take-Aways” from Day 1 of Drexel Conference

Over 1,000 legal educators are taking part in a two day conference “Leaning into Uncertainty: Ensuring Quality Legal Education During Coronavirus,”  hosted by Drexel Law School and University.  Brief opening plenary remarks were made by Northwestern Law Professor Daniel Rodriguez who cautioned against “virtue signaling” noting that today on May 26th, we don’t know the choices students, faculty and others will make in August.   He called for legal educators to work across law schools to engage in “Collaboration on Steroids!”

After very brief “framing” discussions of questions, participants were assigned into scores of breakout groups.  Today’s Roundtable topics included:

Roundtable 1: Beyond Zoom! Moving from Emergency Virtual Classrooms to a Rigorous, Engaging Online Experience

Roundtable 2: Designing Curriculum and Programs in a World of Social Distancing: Sections, Schedules and Changing Circumstances

Roundtable 3: Maintaining High Quality Experiential Learning Opportunities from a Distance

Each breakout group recorder took notes which will be compiled into a report.  The hope is to make the lessons from the conference useful this summer as legal educators re-imagine law school operations and adapt our teaching methods and designs to meet student and public health needs.

I was able to participate in Roundtable 1 and 3 and found the discussions useful in thinking about my summer course redesign, the needs of our Justice Center, and the different way different schools can adapt and innovate. I jotted down a few “take-aways:”

General 

  • Time and Space are no longer the same as they were pre-pandemic.
  • To be a good teacher virtually, just like teaching in residence,  you have to be YOU!
  • What parts of your teaching are MOST important to be Synchronous? and how do we move other parts to be asynchronous?
  • Who could we record now (besides ourselves!) that we can use for asynchronous learning this FALL .. For e.g., share a hypo with other faculty in your department, or other subject matter experts from other law schools, or practitioner experts and record their reaction to a hypothetical that you can assign students to review after having discussed the hypo in breakout groups and  reported back.
  • If we are socially distanced with masks, and spread apart in the classroom, and we are teaching both virtually (through the class streaming or recording) and in residence at the same time, what works for that kind of socially distanced teaching? Might Zoom sometimes work better?

Community Building Ideas

  • ESPECIALLY for 1L’s in building community – Use Zoom questions for registering to ask students community building questions regarding hobbies
  • Start now to create break out rooms for 1Ls pre-assigning over the summer with asking of human questions.
  • Opening up Zoom 10 minutes ahead as if you are standing by podium and can be asked questions
  • Reframe the week – conversation starts on chat or CANVAS before class and continue  into and after class. 
  • Offer off class opportunities for virtual tea, coffee, happy hours to discuss what’s happening with students generally or what’s happening in the world

Experiential

  • Take Advantage of this moment.  Clinics and experiential courses could serve as important front line workers for the unprecedented need for legal services.
  • How do we overcome barriers to actually get to the people in need and to get them what they need?
  • How do we teach students to be community and client-centered if we are not in the community but physically or socially distanced?
  • How do we prepare students and ourselves to perform competently in the world of virtual courts and lawyering when the rules, protocols and comfort level with the virtual differ across kind of state and federal courts and among different judges?
  • How do we build the people-centered core of clinical work that helps students develop skills, values and networks in interpersonal relationships?
  • How do we resource our students and clients for virtual legal practice?

Lots to chew on and looking forward to hearing more tomorrow!

Is Mandatory P/F An Opportunity to More Accurately Assess Competency to Practice Law and For Bar Admission?

As our knowledge of COVID19 and its impact becomes more extensive each day, each workplace, profession and community is facing some common and some unique questions. Those working on the front lines in hospitals – such as several of  my relatives in NYC and NJ – are experiencing the kind of trauma, shortages, emotional overload and duress that is usually experienced in wartime. It can only be weakly imagined by the rest of us.   For those of us not experiencing  people suffering and dying in front of us on a daily basis, some less horrific choices are before us:  How do we modify “business as usual”?  How do we evolve and adapt with each days new tsunmai of information and data?  How do we support our best selves and our core values in this historically momentous time on our shared planet? 

Before turning to the topic of grading and assessment, I want to pause to give a shout-out to my home institution. Our multi-talented leader Dean Alicia Ouellette has been holding  community town halls every day since Friday March 20th. (BTW Dean Ouellette  just shared on Facebook  that she had been suffering from “presumptive COVID 19” fever and symptoms but thankfully is now symptom free). During our daily town halls, my faculty colleagues and I have expressed our wonder and gratitude for the  character, resilience and grit of our law students who are balancing so much right now, and facing so many financial, tech-related, health and extended family burdens. Our students’ engaged and forgiving response to “tech-curious but not necessarily tech-savvy” teachers and their community-minded empathy for those hardest hit keeps the faculty motivated and inspired.

One of the COVID19 decisions for legal educators involves whether and how we assess and sort — which in reductive  vernacular means “grade and rank.”  Maintaining appropriate expectations, options, rigor and excellence in law teaching  may assume primacy for those  who have been long focused on ensuring that law students receive real value for the time, talent and treasure they expend on law school.   For others focused on fairness in law placement,  transparent employer signals about how they will view Spring 2020 legal education may be most influential.  For those concerned about our profession’s  reputation for lack of wellness and lack of diversity, those concerns are elevated at this moment when those least advantaged are most hard pressed.  For those struggling with equity, there are so many permutations and consequences of COVID19 – whichever choice a school makes – that voting faculty could become as immobilized as Chidi Anagonye on THE GOOD PLACE. (BTW Good idea for escape television for those who love philosophy or Kristen Bell).

On the other hand, might this be a moment to look for the opportunities for reform and improvement that only come when the status quo is disturbed and rocked to its foundations as is happening now.  Here is what I am thinking:

Might Mandatory P/F force educators and employers to admit that traditional law school grading and ranking is a misleading and reductive proxy for measuring potential success as a lawyer?

Could it force employers to use other ways to learn about the WHOLE STUDENT with all her strengths, gaps, and individual aptitudes including the situation she faced during law school?

Might it accelerate a move to a more qualitative than quantitative assessment of each law student? Or, at least might it prioritize learning which enables a school to assemble a portfolio of student recommendations ( demonstration of knowledge, skills, aptitudes, and professionalism)?

Foundational resources include of course Educating Lawyers, Best Practices in Legal Education, and Building on Best Practices: Transforming Legal Education in a Changing World, which also provide helpful wisdom points. In addition, looking back through the dozen or so years of this blog’s existence, there are lessons from which we can pull core knowledge and core values to assist in our continued educational deliberations at this turbulent time. 

CORE KNOWLEDGE AND REFLECTIONS

Valuing Legal Education over Sorting – For example, focus on the difference between assessment and grading.  Educating Tomorrow’s Lawyers conferences have brought employers, law schools, and legal education stakeholders together to tackle the disconnect between our current sorting systems (primarily used to help elite employers looking for a simple and reductive initial screening system) and the needs of society and most employers for competent new attorneys and the needs of students and the profession for fairness.

Focus instead on formative and evaluative assessment of law students and graduates

Focus on growth mindset, on reflection and learning from mistakes or experience

Recognize the limits and problems with GPA’s or LSAT scores to create a more competent profession with more able and diverse learners.

Acknowledge that the media and the academy is still stuck in a mindset that focuses on sorting methods rather than on better preparation and assessment of law students to serve clients and society.

Class rank does not predict who will become a competent, healthy and ethical lawyer

Effective Education includes

CORE LEARNING VALUES

Growth Mindset 

Inclusion and Diversity

Student-centered Learning  and the Introduction to the original Best Practices – “One of our basic tenets is that law schools should become more student-centered”

Wellness  

Collaboration and Innovation

Integrity 

Character 

Justice

Situational Excellence

There is a common theme here: P/F with alternative assessment information and measures should be seen not as temporary emergency expedients to “sort and rank”, but rather as long overdue components of a better educational program and more nuanced assessment paradigm.

I would love to hear your thoughts in the comments below.  I wish all our readers and citizens of our little blue planet moments of peace, love, safety, and compassion. May someone be kind to you today and let’s pay it forward.

 

 

 

On the Value of Gap Years and Non-Legal Experience to Legal Employers (and Law Schools)

Reviewing the results of the Foundations for Practice survey conducted by the Institute for the Advancement of the American Legal System (IAALS), I cannot help but note how the 24,000 responding attorneys ranked the helpfulness of various criteria for hiring beginning lawyers. (See here.) Just under 80 percent (78.3%, to be exact) identified “life experience between college and law school” as either a very helpful or somewhat helpful hiring criterion. Moreover, while “legal employment” (88.4% ranking as very or somewhat helpful) and “legal externship” (81.5%) unsurprisingly sat near the top of the list, “other experiential education” — meaning non-legal — was very close behind at 79.4%.

The responding attorneys, from a wide variety of practice areas and from throughout the country, ranked these two non-legal experience criteria — “life experience between college and law school” and “other experiential education” — as slightly more helpful than certain types of legal experience, including federal court clerkships, state court clerkships, and participation in law school clinics. The starker divide, however, came when considering traditional hiring criteria related to law school performance. While well over three quarters of respondents classified both personal and professional experience of a non-legal nature as helpful hiring criteria, only 62.5% said the same about law school class rank. Similarly, only 61.1% said so about law school attended, and merely 51.2% said so about law review experience.

One narrative coming out of the survey could indeed be that practical experience matters more than academic experience, and that seems to be what IAALS is highlighting. But, consistent with the results discussed above, I would suggest another as well: Non-legal experience — both personal and professional — matters almost as much, if not just as much, as legal experience.

The survey was just the first phrase of IAALS’s broader project, entitled Foundations for Practice, and the second phrase, which is being implemented now, directly implicates law schools. IAALS is working with four law schools to “translate the survey results into actionable learning outcomes and hiring rubrics.”

The current phrase focusing on law school outcomes turns my mind to the “incoming” side of law school admissions. The results of the survey suggest to me that law schools should more explicitly prioritize admission of students with meaningful life experience or non-legal professional experience. In addition, if it is not already, LSAC ought to be gathering and reporting to law schools pertinent data as to what percentage of law school applicants are undergraduate students who would be going directly to law school. And, as to those who are not, what are the percentages one year out from the undergraduate degree, two years, three or more, etc.? Just as law schools view national statistics on other important admissions criteria (GPA, LSAT, ethnic diversity, to mention a few) as important benchmarks, they ought to be in a position to do the same for number of years since undergraduate degree.

Having a significant percentage of students with meaningful life experience outside of the law is indisputably of great benefit to the law school learning environment. I see it every year in my classroom. More to the point of the IAALS survey results, by bringing in a significant number of students with such experience, law schools will be contributing to better outcomes — learning outcomes and employment outcomes. In a typical incoming J.D. class at my home school, the University of Pittsburgh School of Law, 20% to 30% of the students are three or more years removed from their undergraduate degree. We do not have a part-time or night program, and certainly those schools that do will have higher percentages of that demographic.

At least one-third and in some years close to one-half of the students in our typical incoming class are coming straight out of their undergraduate studies without even one gap year. This demographic exists at nearly every law school in the country (in varying percentages). Given what we know about the next generation of law students, and given the importance of life experience and non-legal experience as hiring criteria to today’s legal employers, these students would seem to face a more challenging path. What do law schools need to do, if anything? Offer or enhance existing professional development programming or curricula? Offer or enhance existing experiential opportunities that are not exclusively legal in nature and that expose students to non-lawyers and other disciplines and experiences? (Just two examples: teaching or working with high school students, or working with entrepreneurs at a tech startup. Law schools affiliated with a university can offer assorted interdisciplinary educational opportunities as well.)  I will be interested to see if the second phrase of the IAALS project emphasizes ideas like these or others that respond to the demonstrated need for lawyers with life experience and non-legal professional experience.

New Research on Law-Student Resiliency

Student resiliency and well-being are on-going concerns to the legal education community. Counselling, academic support, and activities like yoga have been introduced in law schools to address these concerns. Although these strategies are undoubtedly beneficial, a recent research paper suggests that legal educators may have an additional, all-encompassing solution under their noses – the cultural mindset we create in our classrooms.

In the paper The Jury Is In: Law Schools Foster Students’ Fixed Mindsets, Susan Shapcott, Sarah Davis, and Lane Hanson suggest that the law school experience promotes fixed mindsets in law students. Many educators are familiar with Carol Dweck’s work and the concept of mindsets; when students perceive intelligence as an innate trait that one either has or doesn’t have, this is a referred to as a fixed mindset. At the other end of the spectrum, perceiving intelligence as something that develops with effort, strategy and time is referred to as a growth mindset.

The authors reported that third year law students’ mindsets were significantly more fixed than first year students’ mindsets. How does this relate to resiliency and well-being? Quite simply, mindsets are predictive of students’ goals and resiliency to challenges (an inherent part of law school). As students’ mindsets become more fixed, they are more likely to adopt goals intended to demonstrate how smart they are. Consequently, they are less likely to ask for help when they most need it, they will perceive professors’ feedback as judgement, and they may interpret mistakes as evidence that they just don’t have what it takes to succeed. Not only are these behaviors motivationally problematic, they are problematic for mental well-being.

Across a range of fields, growth mindsets are associated with adaptive learning strategies and mentally healthy behaviors that promote well-being and resiliency. So arguably, this is the culture that we should be focused on developing in law schools. However, as Shapcott, et al., report, the opposite may be happening. The longer students are exposed to law-school culture, the more fixed their mindsets become. Therefore, it is time to recognize that there is something adrift in our culture. Furthermore, we cannot simply focus on students’ mindsets without reflecting on the role we as educators play in influencing them.

Students’ well-being won’t change much until law schools work to change the culture from within. Law school classrooms that help students develop growth, not fixed mindsets will do more for students’ resiliency and long-term growth. This starts with faculty members reframing how intelligence and lawyering skills are described (they are learned skills, not innate gifts). When faculty share their own vulnerabilities and struggles to grasp concepts, they create a classroom culture where students are less afraid to ask for help. And when professors give accurate feedback intended to teach students how and what is required for them to improve, rather than simply judging their intelligence, they will help create a growth-mindset culture that reduces students’ stress and increases their strategies for manage their learning experience.

AALS Video Series on Law Teaching

Recently, a fellow blogger sent us a very helpful tool, that we wanted to share with our readers.  Last year, during the 2015 AALS Clinical Conference, a series of informative videos was created for law professors about the complications associated with law teaching.  The entire series is about an hour long, with each individual video being only about 5 minutes long.  These videos address some of the important pedagogical issues that law professors are currently grappling with, such as assessment, adding experiential learning to doctrinal courses, reflection, and technology.

This in the link to the entire series:

Teaching Tips to Think about Early in the New Semester- By Steven Friedland

With the beginning of a new semester upon us, these thoughts and tips are a great thing to keep in the back of everyone’s mind whether you are a student or a professor.  This great post was done by Steven Friedland.

Flexibility and Mobility in Law School Learning

As a professor who has been teaching for more than two decades, it is easy to feel like a dinosaur in classes populated by students mostly in their 20s.  But within that notion lies the fact that not only do ages change, but cultures as well.  It is evident that within the born-digital generation, cultural understandings, particularly involving learning, are different than mine.

While I think cross-cultural competency is more important than ever in this global era, it also applies to us teaching dinosaurs.  I learned in law school in a linear and fixed fashion – go to class, take notes, go to the library, study and prepare for the next class.  Based on studies and my own anecdotal evidence, there is an increasing preference for mobility and flexibility in learning.  I am becoming a believer in both — using Web platforms like TWEN, Blackboard or Moodle as integral parts of a course, and allowing students to have flexibility in where and when they learn.

I am now experimenting in doctrinal courses to include several flex classes — audiotaped, with an option to take each over a 24 hour period in a self-paced fashion.  These self-paced classes are combined with deliverables — writing an answer to a problem based on the class material and then posting it on the Web platform, or doing some other relevant task based on the material to ensure that some form of learning has occurred.  So far, these classes have been well-received; to my surprise, students like the flexibility about when they take class as much as the remote opportunity. I am enjoying shaking it up in this way.  What is the saying?  Even an old dinosaur can learn….

 

Note-Taking Breaks

In a law school class, there are a variety of note-takers.  Some are the “court reporters,” taking down every word.  Some take far fewer notes, within their own organizational schemes. Many students are using computers, with note-taking programs. I also have had some “deep observers,” who appear to take no notes at all.

But all students seem to rely on the notes they take in putting a course together for deep understanding, especially in the first year of school.  Interestingly, teachers do not generally know how students are taking notes and whether those notes taken are even accurate.  This is why I have started using a colleague’s technique (yes, I like borrowing good ideas from others, no hiding there), of taking “note breaks” in the middle of a doctrinal class — allowing students to check their notes with other students, particularly about important rules, principles or insights. I usually prompt the break by asking, “What were the most important points in class so far?”  This has several effects.  Everyone perks up and the students appear present and engaged.  Students also are more likely to ask questions about what has occurred thus far.  I get useful feedback on what I have communicated well and what I have done poorly.  So all the way around, I find it to be a helpful technique. When students walk out of class, they should be able to rely on and have ready access to useful notes.

 

Retention and Retrieval

Lots of studies have been done that show experts learn differently than novices.  In any educational process, the goal is to move up the scale, from unconscious incompetence, to conscious incompetence, to conscious competence, to the highest level, unconscious competence.  I know about the lowest level, having been there in law school and many other contexts (just thinking back on the longest years of my life taking piano lessons).  The highest level of competence is epitomized by Captain Sully, the U.S. Air pilot who landed his commercial plane without engines in the Hudson River.

So what learning features are associated with experts? Experts recognize patterns of information, have deep understanding of material within a domain, organize their information well for ready access, and constantly self-monitor.  We can learn from these characteristics in law school.  It is traditional for law school professors to evaluate student performance through a single final examination, (although sometimes mid-terms are also offered).  The traditional summative evaluation framework promotes a particular type of studying.  Students study like crazy just before an exam, and then dump all of their knowledge on the test. (This approach was a familiar one for me when I was in school.) To help students progress from novice to expert, though, we should teach for long-term retention and retrieval.  This can occur through the use of numerous problems and opportunities throughout a course by which to practice organizing and storing material before a final exam, the use of structures or outlines by which to approach topics, and a greater emphasis on mnemonics, anchor words and other learning devices.   Sometimes, in our desire to cover great swaths of material, we don’t drill as deeply as we could or should.

Ten Questions to Ask Yourself Before Volunteering

As a follow-up to my previous post on “-crastination”, Creativity and the Importance of Downtime, I’m sharing a copy of my favorite handout for helping all of us, students and faculty alike, learn to engage in discernment around saying no, and yes.

TEN QUESTIONS
Ask yourself these questions

Before volunteering your time, skills & energy to ANYTHING!

  • Is there a chance I will find myself changed by this work?
  • Does this work express my values, the things I say are important to me?
  • Will this put me with people I want to know better?
  • Will doing this help me know myself better?
  • Do I enjoy thinking of myself as a person who would do this?
  • Do I have a special gift to share?
  • When I look back in a year or ten years, will I remember doing this?
  • Will this make me feel more connected or more disjointed?
  • What will I need to say NO to in order to say YES to this?
  • Will it be FUN!

 

Thanks for Maylin Harndon for sharing her version of this with me.

 

 

 

Teaching Legal Reasoning More Efficiently?

Teaching the traditional analytical skills more efficiently and effectively could provide a much needed opening for broadening the range of skills taught to all law students. In the legal academy’s version of the “socratic method”, law teachers historically taught the analytical skills” implicitly”. They demonstrated legal reasoning by pushing students away from their raw intuitions of fairness and justice to articulate rules and exceptions, while attending carefully to the inevitable ambiguities of language.

Some law teachers suggest that the process of learning to “think like a lawyer” fundamentally requires time and practice and therefore cannot be significantly speeded up.

Yet the implicit approach has been repeatedly challenged by scholars seeking to teach legal reasoning more explicitly, by naming and explaining how it works.*  (An obsession with the goal of teaching legal reasoning more efficiently was a major thread in two phases of my own legal career when I taught first year civil procedure. I struggled both to teach skills more explicitly and to provide students with opportunities to practice them.)

A recent contribution to this quest by my colleague Jane Winn grows out of her experiment teaching common law legal reasoning to undergraduates. Students were randomly assigned to use either a well-regarded study aid, or Winn’s own materials. The materials were also leavened by her own and colleagues’ experiences teaching foreign LL.M. and J.D. students coming from legal systems growing out of the European continental legal tradition.

Winn’s effort, aimed at law students, is notable in three respects. First, at twenty-nine pages it fills an intermediate-length niche: longer than a typical class “handout’, but shorter than the various book length alternatives. Second, it covers case briefing, outlining and exam questions, demonstrating how the three are related. Third, it grew out of an attempt to test her teaching method empirically using random assignment to a control group. Both law students and legal educators should find it a useful contribution.

The 2015 ABA accreditation standards may provide a laboratory in which to test efforts such as Winn’s. Standard 302 now requires law schools to adopt learning outcomes that, under subsection (b), must include legal analysis and reading; Standard 314 requires law schools to provide students with both formative assessment (feedback) and summative assessments (final “grades”); under Standard 315 law schools must engage in “ongoing evaluation of the program of education, learning outcomes, and assessment methods”. At its best this combination of more intentionally articulated outcomes, feedback to students, and program evaluation could prompt law schools to evaluate the potential for greater efficiency and effectiveness in teaching legal reasoning. I remain hopeful that enough schools will approach this task rigorously and in good faith that at least some progress can be made.

*Winn’s illustrious predecessors include:

  • Leading Legal Realist Karl Llewelyn, whose The Bramble Bush: Classic Lectures on Law and Law School have been assigned to generations of law students;
  • University of Chicago Professor and President and U.S. Attorney General Edward H. Levi, author of An Introduction to Legal Reasoning, originally published in the University of Chicago Law Review and then in book form;
  • Critical Theorist and Harvard Professor Duncan Kennedy, who took the decidedly un-Harvard step of visiting at New England School of Law in his attempt to reach beyond elite students and sharpen his skill at teaching students about the “gaps, conflicts and ambiguities” that underlie the development of the common law. He shared his insights widely with former students moving into teaching careers. produced a short volume
  • My former colleagues Pierre Schlag and David Skover, who produced a short volume early in their careers that catalogued the Tactics of Legal Reasoning (1985).
  • Richard Michael Fischl and Jeremy Paul, Getting to Maybe: How to Excel on Law School Exams (1999)
  • Leading clinical teachers Albert J. Moore and David Binder, Demystifying The First Year of Law School: A Guide to the 1L Experience (2009)

In recent decades much of the heavy lifting in legal reasoning has devolved upon teachers of legal analysis, research and writing. Among the results is a burgeoning literature proposing variations on the syllogistic Issue-Rule-Analysis (or Application)-Conclusion approach to analyzing and writing about legal problems, as well as a variety of textbooks.

.

Unmasking Assumptions about Employment Outcomes and Legal Education

In an upcoming Wisconsin Law Review article, Robert Kuehn, Associate Dean for Clinical Education and Professor of Law at the Washington University Law School, presents a cogent, well-supported and thoughtful article describing the limitations of and lessons we can learn from the existing empirical analysis correlating student enrollment in clinical education and employment outcomes.  Kuehn’s article, entitled Measuring Legal Education’s Employment Outcomes is particularly powerful because it provides a thorough empirical rejection of the claim that clinical coursework might actually harm employment outcomes, as asserted by Professor Jason Yackee and which attracted some sound-bite attention earlier this year. In what is, perhaps,  an unexpected twist, Kuehn demonstrates that using Yackee’s statistical assumptions and methodology also would produce negative correlations for those students who participate on law journals or in moot court competitions.  Kuehn argues that one can’t draw any reliable conclusion from Yackee’s 2013 model, and perhaps not from any nationwide statistical model – as opposed to a particularized analysis of one school –  on the likely effect of clinical courses (or other activities like law journal or moot court) on employment, and surely not the negative effect Yackee posits. Kuehn points out that as to clinical coursework, the available evidence (through surveys) indicates that such experiences do aid some students in securing employment.

If you, like me, still become a bit nervous about how much you actually remember from undergraduate statistics courses, do not be alarmed by this post!  You will find Kuehn’s article accessible and a quick good read, even when he is using words like “regression analysis,” “granular data” and “variable choices.”   Here are the points made in Measuring Legal Education’s Employment Outcomes which I found most helpful:

  1. Kuehn’s reminder that when one confuses correlationwith causation one is bound to come up with a “misdiagnosis.” One problem with Yackee’s analysis is the lack of granular data to calculate the true employment rate for those who took a clinic (or who did not).  In fact, the data is so poor that “the results never account for more than half of the variability in employment across schools.”
  2. Kuehn’s explanation of the “confounding effect of prestige” and bar passage on employment outcomes.
  3. The problems of validity and reliability raised by analyses which employ information from ABA questionnaires, particularly those self-reports submitted prior to 2014.
  4. The fact that “13% of law schools” provide 80% of the school-funded jobs to law graduates. Not surprisingly, Kuehn found this factor biases many results if you examine nationwide statistics. And when Kuehn removes those jobs from the statistical analysis, Yackee’s correlation with clinical education falls apart even using his own assumptions and methodology.
  5. Yackee’s model yields completely different results if one uses the US News Lawyers/judges data versus academic peer data to control for the possible influence of perceived prestige.
  6. Application of Yackee’s model to “Law Journals” and “Skills Competition” and S. Newssub-groups also show no relationship to employment outcomes!
  7. In Yackee’s model, a better ranking is “strongly associated with improved employment outcomes.” However, Kuehn points out that a “closer examination of the relationship between rank and employment indicates that this positive association, although statistically significant when applied across the entire range of top 100 schools, does not hold true for schools ranked 51 through 100 (emphasis added).” 
  8. Kuehn’s documentation of employers who require, “strongly prefer” or identify law clinic experience as a positive factor in hiring such as The U.S. Department of Homeland, legal services and  legal aid offices, district attorney, public defender, fellowships and private law firms.
  9. Kuehn’s description of National Association of Law Placement (NALP) existing information: such as the  2011 survey of lawyers with non-profit and government offices;  the NALP survey of lawyers in firms of predominantly more than 100 attorneys; the NALP survey of public interest legal employers;  and the NALP 2013 presentation on the employment market reporting that ” law firms say they want new graduates to have ‘more experiential learning, client-based and simulation.”
  10. Kuehn provision of good information on other employer information such as the Lexis-Nexis WHITE PAPER: HIRING PARTNERS REVEAL NEW ATTORNEY READINESS FOR REAL WORLD PRACTICEProfessor Neil Hamilton’s employer survey to determine the relative importance of twenty-one different competencies in employer hiring decisions, and Professor Susan Wawrose’s legal employer focus groups which found employers prefer new hires with ” well developed professional or ‘soft skills” along with “strong fundamental practice skills.”

Professor Kuehn concludes by recommending that studies could best be done on a school-by-school basis by “surveying likely employers to find out what educational experiences of students are most valued.”  Professor Kuehn also recommends that schools could also “retrospectively look at various employment outcomes for graduates and any relationship” to students’ experiences while in school.

I agree with Professor Kuehn and am happy to report that  Albany Law School,  through its faculty Assessment committee and Admissions office,  is currently engaged in conducting employer focus groups and analyzing what best helps our students obtain employment in their desired career paths.  Until good data and information suggests otherwise, Professor Neil  Hamilton’s advice to law students,which Professor Kuehn quotes in his “must read” article, bears repeating:

In this challenging market for employment, a law student can differentiate herself from other graduates by demonstrating to legal employers that the student both understands the core competencies that legal employers and clients want and is implementing a plan to develop these competencies, including an ability to demonstrate that the student has experience with these competencies.

What’s going on in California? “TFARR- recommended” 15 credits of competency training

For those who did not closely follow the California State Bar debate on the requirement of 15 credits of competency training for bar admission (the work of the Task Force on Admissions Regulation Reform, or “TFARR”), I summarize the current status.  (Although I am currently co-prez of the Clinical Legal Education Association, known as CLEA, this post is not written with that hat on.)  This is my own thinking, albeit, informed by the excellent work of the CLEA Advocacy committee.

The TFARR process was two-staged, over a three year period, with opportunities for public comment throughout. CLEA  participated in that process and submitted five separate comments on the proposals that are available at http://www.cleaweb.org/advocacy under “Briefs and Other Advocacy” (documents 4-8).

In the end, TFARR recommended 15 credits of competency training which can be achieved in a variety of ways (in addition to how experiential credits can be earned under the new ABA regulations), and which include six credits of summer work. You can read the TFARR Phase II Final Report  at: http://www.calbar.ca.gov/AboutUs/PublicComment/Archives/2014PublicComment/201411.aspx

The process was complete in November, 2014, with final TFARR recommendations to the State Bar Board of Trustees (that responded to public comments) and unanimous adoption by the Board: http://board.calbar.ca.gov/Agenda.aspx?id=10891&tid=0&show=100008800&s=true#10013881 (agenda item 113). The TFARR Phase II FInal Report represents a compromise based on extensive input.

Lately, some confusion has arisen because of a letter posted to the AALS website authored by a non-standing committee of Deans.  The confusion arises because:

  1. Neither AALS nor this special Dean’s committee ever participated in the two stage TFARR process and so appear to be sort of “johnny come latelys, ” and
  2. The letter mistakenly focuses on an earlier draft of the final proposal failing to recognize the compromises already reached in the final proposal.

I understand that there are efforts underway to correct the confusion which makes me happy since the Deans’ letter is signed by two people whom I have long admired in a variety of contexts.

Other blogs are already exploring the 15 credit  proposal and its interesting and creative approach. For example,   “Kudos to California”  What do our readers think?

What Makes Your Subject Distinctive?

As law schools continue to develop their learning outcomes, an important question we all should consider is, “what makes my course distinctive?”  For example, in my research on assessment in legal research courses, I was struck by how much the analytical and problem solving skills developed by legal research instruction are the same as those developed by many other courses in the law school curriculum.  That led me to ask, “what makes legal research instruction distinctive?”  The answer was not simply, as an outsider might suggest, that legal research classes teach tools for finding law (digests, Westlaw, etc.).  Rather, I was struck that legal research instruction is distinctive in the extent to which an effective legal researcher must have an appreciation for the power of taxonomies, must exercise imagination in the context of realistic boundaries of time, cost, and purpose, must be able to ask for help, and must develop strong metacognitive practices (to continually question “is this process working?”).  The difference is of degree rather than kind of course, but it is a distinctive difference nonetheless.

Given the narrow focus of legal education, it seems that this question of distinctiveness or “value added” is the most critical question I can ask in planning my courses.  Not that the distinctive outcomes of my courses should be the sole, or even dominant outcomes.  Legal education outcomes require an iterative process and cross-curricular experiences for students to become competent and to enable transfer of learning to new settings.  Yet, understanding what makes my outcomes distinctive forces me to justify my outcomes and consider their connections with other law school outcomes.

So what makes my outcomes in Professional Responsibility distinctive?  Certainly the identity of the anticipated uses of the doctrine we are learning leads me to choose to emphasize professional identity formation outcomes as important if not distinctive.  In most law school courses, students are learning the law to serve others and are encouraged to use, interpret, and advocate about the law to achieve a client’s objectives.  In Professional Responsibility, the students will be using the law to advise themselves.  My outcomes include expecting that students will be able to clarify their observational standpoint when considering issues of professional ethics; recognize that self interest clouds judgment and ways to gain more objectivity; and differentiate the approaches to interpretation of law that one might use to advocate for a client regarding past conduct from approaches that are wise, ethical, and effective when interpreting the law to guide our own future conduct.  Finding effective methods to assess students development of these perspective is a challenge but I have found that simply asking students to read cases of attorney discipline and ask, “what went wrong with the attorney’s thinking?” is a good place to start.

What makes your course outcomes distinctive?  How has that led to distinctive assessment practices?

Building on Best Practices now available as eBook

Are you trying to:

  • Develop a meaningful law school mission statement?
  • Understand new accreditation requirements, learning goals, and outcomes assessment?
  •  Expand your experiential offerings?  Decide whether to use modules or courses?  An on-site clinic, an externship, or community partnership?
  •  Teach ALL of your students in the most effective ways, using a full range of teaching methods?
  • Add to your curriculum more of the professional identity, leadership, intercultural, inter-professional and other knowledge, skills, and values sought by 21st century legal employers?
  • Lead thoughtfully in the face of the challenges facing legal education today?

These and other topics are addressed in Building on Best Practices:  Transforming Legal Education in a Changing World,  now available in ebook format from LexisNexis at no charge.

The print version is not yet out.  LEXIS-NEXIS is taking advance orders for $50, plus shipping.  BUT we understand that they will make one copy available to every US legal educator for free upon on request.  Details on this and international availability still to come.

Thanks, and congratulations, to book project sponsor Clinical Legal Education Association (CLEA), the more than fifty legal educators who participated as authors, and the countless others who assisted as readers and in numerous other ways.

And, a huge shout-out to my wonderful and talented co-editors, Lisa Radke Bliss, Carrie Wilkes Kaas, and Antoinette Sedillo Lopez.