Best Practice Contributors Highlighted in Best Articles of 2019

A big congratulations to our very own bloggers, Jennifer Bard and Benjamin Madison, for being featured on the TaxProf Blog!

Jennifer Bard’s article, “Are the Students Failing the Bar Exam Today Canaries in the Coal Mine warning us of a More General Need to Change Legal Education?” and Benjamin Madison’s article, “New Rubrics Available to Help Law Schools that Have Adopted Learning Outcomes Related to Professional Identity Formation” were both listed as TaxProf Blog’s “Best Legal Education Articles of 2019.”

Refuting the False Trope on Clinical Courses and Bar Passage

Robert Kuehn, Washington University School of Law

It has been observed that “the fewer the facts, the stronger the opinion.” Until recently, this could be said about the possible influence of enrollment in clinical courses on a student’s likelihood of passing the bar examination. While there was a shortage of empirical studies on any possible relationship, there have been plenty of opinions on how taking those courses might be harmful, opinions often reflected in graduation restrictions on clinical courses and requirements for bar subject-matter courses.

But, there are now significantly more facts to refute those opinions. Two recent, large-scale studies have both found no relationship between the number of law clinic or externship courses or credits a law graduate took and her likelihood of passing the bar exam.

In a forthcoming article in the Journal of Legal Education, academic records of ten years of law school graduates of Washington University in St. Louis and Wayne State University were reviewed for any relationship between the number of law clinic, externship, or, more generally, experiential courses or credits and bar passage. After first accounting for the possible influence of law school grades on bar passage (the most significant predictor of bar success), the study found no correlation at either school between law clinic or externship enrollment and bar passage — no relationship between participation in a law clinic or externship and passage, none between the number of clinical courses and passage, none between the number of clinical credits and passage, and no evidence that students graduating with lower GPAs were disproportionately enrolling in those courses as a way to avoid doctrinal courses (another not uncommon trope). This lack of any relationship was in spite of increased enrollment in experiential courses at both schools over the ten-year period and decreased enrollment in courses teaching material tested on the bar (referred to as bar subject-matter courses).

The article notes that nationwide data on experiential course enrollment and bar passage also belie any claim the two are related. That data indicate that as enrollment in experiential courses was increasing from 2006-2016, bar passage percentages were fairly steady and that the recent decline in passage coincided with decreased, not increased, enrollment in those courses.

A recent study commissioned by the California State Bar found a similar lack of relationship between law clinic and externship courses and bar exam performance. The study reviewed law school coursework and performance on three July exams for over 7,500 bar applicants from eleven California schools. It found no relationship between the number of academic credits from law clinic courses and exam performance, either across all schools or even when reviewing schools separately. Similarly, there was no relationship between the number of externship or internship credits and performance, again when examined across all schools or within schools. The broad range of entering credentials at the eleven schools, and lack of a relationship even within those schools, indicates that the results should be applicable to most law schools, including those with lower LSATs and undergraduate GPAs for entering students.

The study results from Washington University/Wayne State and the California State Bar are similar to smaller studies at Texas Tech and the University of Denver that also reported no statistically significant relationship between enrollment in a law clinic or externship course and bar passage.

The Washington University/Wayne State and California State Bar studies further revealed that opinions about the value of bar subject-matter courses should be moderated. There were small correlations at both schools between the number of bar subject courses and bar passage. But this result (explaining less than 5% of the variability in bar outcomes) was only for low performing students and additional courses showed no marginal benefit once students took the school’s average number of bar courses.

The California State Bar study focused on whether taking a specific course was related to performance on the bar exam topic taught in those courses. It found that neither attendance nor performance in courses covering any of the 13 bar-related topics was related to performance on the corresponding California bar exam or Multistate Bar Exam content covering that subject.

Studies at other schools also indicate that enrollment in bar subject-related courses do not support broad claims about the benefit of taking those courses.

It is time to put away the misinformed trope of participation in law clinic and externship courses harming a student’s chances of passing the bar exam and let the facts do the talking. Law schools should recognize and students should be told they can obtain valuable preparation for the practice of law by enrolling in clinical courses without affecting their likelihood of passing the bar exam.

Active Retrieval Practice: Known to Improve Learning but Underappreciated?

Exam time has arrived in law schools.  Students who want to excel on exams (and later, as attorneys) would do well to try out active retrieval practice.  To understand the value of retrieval practice, some brief discussion of well-established cognitive science is necessary.  Learning involves (1) taking knowledge into short-term working memory, and then (2) moving it from working memory to long-term memory by actively using the knowledge.[1]  In their excellent book, Teaching Law by Design, Dean Michael Hunter Schwartz, Professor Sophie Sparrow, and Professor Gerald Hess explain this process of storing learning in cognitive schema.[2]  They liken schemata to a “folder system[] provided for users of computer operating systems.”[3]  As they observe, however, storing knowledge “isn’t enough.  To analyze a problem, students must recall (“retrieve”) what they have learned and use that learning . . . .”[4] 

Research on cognition demonstrates that meaningful learning in any discipline requires the learner to perform some form of active retrieval exercises to be able to use the knowledge in analyzing and solving problems.   Active retrieval methods are ways in which the learner recalls knowledge and uses the recalled knowledge to solve problems or answer questions.[5]  Recalling for mere “knowledge checks,” sometimes called rote learning, is not effective.[6]   In the law school arena, a student can recite a memorized rule but not be able to apply it to fact patterns in a way that shows understanding.   Effective retrieval-based learning activities require the student to solve problems or to answer questions.  By doing so, the learner strengthens her understanding  of, and ability to recall, the knowledge.[7]  In law school, mid-term exams require students to recall information at least in mid-semester.  The problem there is that neuroscience shows a marked forgetting curve: if learning is not retrieved within a few days of its being stored, the knowledge is lost and must be relearned.[8]  Indeed, retrieving and using the knowledge are the critical parts of developing meaningful learning. 

               Spurred by the adoption of ABA Standard 314, my colleagues and I have been giving mid-term exams and using a variety of interim assessments designed to have students to recall information from previous classes. I regularly have a mid-term that includes multiple-choice, essays, or both.  The exams are graded and students receive a model answer. I discuss with students the answers to the assessments and common mistakes (e.g., failing to state rules accurately, insufficient application of facts in supporting one’s analysis).   The exam and follow-up discussions achieve the goal of providing the “meaningful feedback” that ABA Standard 314 seeks.   The mid-term is also summative. My experience is that many students do not take a practice, ungraded mid-term seriously. Having the exam count, but not so much as to prevent a student from recovering from a poor exam, helps to ensure that students prepare for and spend time on the mid-term.

               Another way that I have incorporated active recall practice is by using multiple-choice polling questions.  In the first class after we finish a course segment, we begin the class with multiple-choice questions that students answer by polling.    I ensure participation by recording the polling, by student, and including their responses (or lack thereof) as a class-participation part of the grade.  In answering the questions through polling, students must recall knowledge to analyze the question and reach a conclusion.   For example, after completing the study of removal jurisdiction and procedures, I use a series of multiple-choice polling questions that explore the many nuances of removal.   These sessions provide “meaningful feedback” to both students and to me.   If everyone misses a question, you can be sure I go back to discuss the area.  I also encourage anyone who missed a question in these polling sessions to meet with me after reviewing the topic addressed by the question.

               I urge students not to rely solely on the mid-term and the polling sessions as a means of ensuring they have learned material well.  Instead, I highly recommend preparing answers to essays under timed conditions.  At times I provide a model answer after they practice an essay. I also invite students to meet with me to go over their answers.   In these discussions, I almost always find some area in which a student has a mistaken understanding of a rule or concept.  If we did not uncover that misunderstanding, a student could repeatedly recall a flawed rule or approach.  Hence, I appreciate more than ever the wisdom of Standard 314’s emphasis on formative assessment.   After resolving any misunderstandings, I encourage a student to rewrite an answer.  That allows the student to revisit the topic and solidify her understanding.  Indeed, the act of writing itself helps students to embed the rules and concepts more firmly in their memory.[9] 

               What is true for law school is also true for the Bar Exam.   Last summer Sara Berman and I created a podcast for the ABA on practicing tests (essays, Multistate Performance Tests [MPTs], etc.) as some of the most effective ways to prepare for a state’s Bar Exam.[10]  Ideally, a student learns everything she needs to know in law school Bar review is just that–review.  More often, Bar applicants have a vague recollection of rules and concepts from their time in law school.  In other words, Bar applicants often find themselves relearning rules and concepts.  In so doing, they will learn more effectively by practicing an essay or MPT answer and by submitting these answers for grading to their Bar Preparation company and the faculty at their law school who help Bar applicants.  In doing these exercises, they benefit for at least two reasons.  First, it will identify areas in which the applicant’s knowledge of rules and concepts is so weak that she cannot answer a question.   Knowing that, the applicant can review that area and know that she needs to do so.  Second, exercises such as practice essay answers will require applicants to recall the rules they do know and apply them.  The more they do so, the more likely they are to remember them on the Bar. 

               Repeated, active retrieval practice is one of the best ways to learn to perform on exams or in law practice.  Yet, despite the data showing its effectiveness, such practices are not the norm in higher education.[11]  The practice is likely not the norm in law schools.   Standard 314 ought to help to some extent increase active retrieval before the end of the law school semester.  Yet, at present students are not spending their time as wisely as they could. Instead of preparing detailed outlines, and memorizing rules or flash cards, they would learn more from methods that require them to recall and apply legal rules and analysis.   Indeed, one might say this fact is one of the best kept secrets in law school. Perhaps it is time to let this secret out.


[1] Michael Hunter Schwartz, Sophie Sparrow & Gerald Hess, Teaching Law by Design 4­–7 (Carolina Academic Press 2009).

[2] Id.

[3] Id. at 5–6.

[4] Id. at 6.

[5] Jeffrey D. Karpicke, A Powerful Way to Improve Learning and Memory: Practicing Retrieval Enhances Long-Term, Meaningful Learning, American Psychological Association (2016), available at https://www.apa.org/science/about/psa/2016/06/learning-memory (last checked Dec. 6, 2019).

[6] Id.

[7] Id.

[8] Louis N. Schulze, Jr., Using Science to Build Better Learners: One School’s Successful Efforts to Raise its Bar Passage Rates in an Era of Decline, 68 J. Legal Educ. 230, 245 (Winter 2019).

[9] Bryan Goodwyn, The Magic of Writing Stuff Down, 75 Educational Leadership 78–79 (April 2019).

[10] Sara Berman and Ben Madison, Practice Makes Passing, Episode 6 of American Bar Associations Path to Law Student Well-Being Podcast series, available at  https://www.spreaker.com/show/path-to-law-student-well-being  (June 22, 2019).

[11] According to Dr. Karpicke, college students likewise use rote learning methods more than they use active retrieval exercises.  See Karpicke, supra note 5.

Guiding Students From Law School Into the World

It seems that one of the things we law professors can do to help our students develop their identities as professionals and their obligations to the greater society is to incorporate into the law school events that plug students into what’s going on in the “real world.“ I did just this in a small way this week by offering all the students the opportunity to attend and participate in a talk/discussion about the Supreme Court arguments that were heard last week in the DACA case.

The students were invited to attend a portion of my immigration clinic class. Food and pro bono credit hours helped, I’m sure, but the event brought a plentiful group of students I had not interacted with before, who were both knowledgeable about and interested in the issue of the day.  The event lasted only about 45 minutes, but that was long enough to produce a lively and I think informative conversation about oral arguments, professionalism, case theory, the role of policy, administrative law, and of course the specific legal issues raised by the case.

With so much of the law school endeavor focused on exam taking and other tasks that force students into a single-focused, competitive role, bringing them into a discussion about key issues at stake in our country in the moment could likely enhance their connections to their future and help them envision some individual goals they can aim for once out in that “real world.”

Best Practices on Halloween Must Include the Notorious RBG

By Jessica N. Haller, Blog Assistant of “Best Practices for Legal Education” Blog

Last week, Albany Law Students gave back to our host community, enjoyed the mental health break of seeing children in costumes enjoy Halloween, and collaborated with each other in meaningful ways.

Every year, Albany Law School opens wide its doors and creates a safe place for local children to trick or treat on Halloween right in the school’s gymnasium. There are families who now come year after year and who now see the law school as a place their children might one day attend. Most of the student organizations participate, setting up tables, handing out candy to the children or face painting. Many groups often have an activity or game or other treat for the costumed kids. For example, the Student Bar Association had a “Connect Four” game and the Black Law Student Association made “worms in dirt” dessert (chocolate ice cream, Oreos, and gummy worms, yum!).

I am currently on the e-board for the Albany Law School Women’s Law Caucus and this year, we decided to combine fun with a chance to teach children about our favorite U.S. Supreme Court Justice: Ruth Bader Ginsburg (RBG). We created a game called, “Pin the Dissent Collar on RBG.” We knew that many of the children coming to this event might not know who RBG is and we hoepd it might spark some conversation. We printed a large poster of RBG’s iconic Supreme Court photo and purchased three different kinds of black ribbon. The first little girl to participate was very enthusiastic about playing the game and asked about this mysterious “RBG.” You can see her playing the game in the photo below:

Ruth Bader Ginsburg is a feminine icon for women, especially for those of us in law school and in the legal academy. Despite the unending obstacles, she persevered. She was turned away from jobs despite being at the top of her class, and when she was able to get a job, she was paid considerably less than her male counterparts. She argued several cases, making it clear in each that gender equality is a constitutional right. For more information on RBG’s life and career, see her bio on Oyez (I also highly recommend a great documentary called “RBG” found here).

(Author and Blog Assistant, Jessica N. Haller, dressed as Agent “Peggy” Carter)

“Being Human To My Students And Letting Them Know I Care”

This is a wonderful blog post I found on the Institute for Law Learning and Teaching by Jane Korn, Professor of Law at Gonzaga University School of Law. As a current law student, I think that this practice should be implemented in all law schools for first year law students. I had a professor during 1L who did something similar. He would start the class every week with, “so how is 1L going?” and we could spend 10 minutes discussing general concerns about 1L and papers or exams we had coming up. Not only did it ease some of the anxiety, it also showed that the professor really cared about the students. It was like they were saying, “I’ve been there too and I’m here to support you.” Kudos to Professor Korn for setting aside some time in her class to do this!

“I have taught first year law students for a long time.  Please do not ask how long!  But years ago, I became worried about the mental health and stress levels of my first semester, first year students. I teach a four credit, one semester course in Civil Procedure during the first semester of law school.   On the last day of the week that I teach in Civ Pro, I take a few minutes out of class time and ask my students to tell me how they are doing.

The first time I do this, usually at the end of the first week of law school,  I tell my students that it is my custom, from time to time, to take time out from Civ Pro, and talk about anything they would like (with some limits).  In some years, it takes weeks for them to take me up on this offer.  Other years, they start right in.  They ask questions like the following:

  1. When should I start outlining?
  2. How much time should I spend studying every night?
  3. How important is getting involved in extracurricular activities?
  4. What if I don’t know what kind of law I want to practice?
  5. Do professors care about grammar and organization on a final exam? (I only answer what I expect and do not answer for other faculty)

I think that much of the time, they do not get a chance to ask a law professor these kinds of questions, and can usually only ask upper class students.  While we have faculty advisors, students may or may not feel comfortable asking them questions like the above.  They eventually do (and sometimes quickly) feel comfortable asking me a wide variety of questions.  They sometimes ask personal questions and, within reason, I answer them because it makes them feel more comfortable with me.  Questions on gossipy matters about other faculty are off limits. If for example, they complain about another professor,  I handle this question with a smile and say something like – you should ask that professor about this issue.

I set aside class time for several reasons. First, while I do worry about giving up valuable teaching time, lessening the stress of my students may make them more able to learn.  Second, students often feel like they are the only one with a particular concern during this first semester, and they often do not have the ability to know that others have the same concerns or questions.  In the first year, many of our students are not from this area and are far away from support systems, at least at first until they can make friends at law school.  The ability to know that other students have the same problems they do can lessen the feeling of isolation.  Using class time to answer questions to the entire group may help them with this sense of isolation and being the only one who doesn’t know something.  It also lets them see that their concerns are important and credible.

Every year my teaching evaluations reflect this process positively.  Students feel like I care (which I do).  However, the reason I do it is to increase their comfort during those first few exciting, confusing, and terrifying months of law school.”

 

Building an Ethos of Self-Directedness Among First-Year Law Students

By: Mary Walsh Fitzpatrick, Assistant Dean for the Career and Professional Development Center at Albany Law School

Background

I attended a workshop on professional identity formation sponsored by the Holloran Center for Ethical Leadership in the Professions last June. In preparation for the workshop, I read a number of articles on professional identity formation, including “Self-Directedness and Professional Formation: Connecting Two Critical Concepts in Legal Education.” The article posits “[f]or law students to move towards real professional identity formation in their career, they must be self-directed.” Self-directedness, some of the hallmarks of which are self-reflection, goal setting, seeking and receiving feedback, and using sound judgment, is integral to finding meaningful employment and career satisfaction. I know from first-hand experience working within law school career development for the past 13 years, students who are most successful in gaining meaningful employment take ownership of their experiences and make intentional choices early in law school. I believe self-directedness more than any other factor, including grades, leads to meaningful careers for law school graduates. The challenge is to cultivate self-directedness in all law students by creating an ethos of self-directedness with regard to career development beginning in the first year.     

While at the Holloran Center workshop, I devised a career development program to introduce first-year students to professional identity formation with emphasis on self-directedness. I subsequently shared the proposed program with my team at the Albany Law School Career and Professional Development Center and we collaborated on the program presentation and exercises. At Albany Law School, students are assigned an individual career counselor with whom they work one-on-one over the entire course of law school. Thus, in planning and implementing the program my colleagues and I chose to each lead the program for our sections separately, beginning individual relationships with our students and setting expectations.     

We decided upon a method of teaching that would allow students to practice self-reflection, seeking and receiving feedback, and using good judgment in the context of career development. The overarching goal of the program was to help students recognize self-directedness as a key component for successful professional identity formation leading to meaningful careers.

The Program – Setting the Stage

We communicated the program as a mandatory one-hour program and emailed to first-year students several weeks before the program the Individual Career Plan (ICP), a self-assessment tool we created several years ago, and our handbook for developing a legal resume. The students were asked to complete their ICPs and draft their legal resumes in preparation for the program. 

  • Reflection

We began the program by introducing professional identity formation and self-directed learning, emphasizing curiosity, initiative, feedback, self-reflection, resilience, judgment and ethics. We provided students with the Holloran Competency Milestones Assessment of Student’s Ownership of Continuous Professional Development (Self-Directedness) and asked them to take a moment to reflect upon and identify their current stage of development on the continuum. Recognizing each student comes to law school at a different stage of self-directedness we did not ask students to share their findings with the group, rather we called attention to law school providing students with the opportunity to move along the continuum with the goal of graduating competent learners who take full ownership over their careers by setting goals and seeking resources to meet those goals.

Next, we asked students to form small groups and to reflect upon and share with each other why they chose to attend law school, skills they hope to build, and experiences they hope to gain during law school. After this breakout session we asked one student from each group to report back some of the group’s findings. Two distinct motivations for attending law school emerged from this exercise, students: wanting to utilize existing strengths they identify as befitting a legal career; and wanting to acquire the skills necessary to be catalysts for change. Notably, both motivations evidence students’ strong desire to align their skills and values with meaningful employment.

  • Seeking and Receiving Feedback

In the second portion of the program we focused on seeking and receiving feedback in the context of career development. We began by educating students on critical thinking skills sought by legal employers, such as analyzing, evaluating, reasoning, and problem solving. We then asked students to provide peer-to-peer feedback on their resumes utilizing the resume handbook we provided before the program and tools we discussed during the program. Students worked in couples or groups of three to seek and provide each other with constructive feedback on how to better formulate existing resume descriptions for a legal audience. After the exercise we asked students to contribute one piece of valuable feedback they received.    

  • Judgment

In the final portion of the program students were divided into groups and provided three different hypotheticals related to career development decisions. Each group was asked to analyze the issues and report back how they would address the situation presented. The hypotheticals included issues of reneging on a job offer, misrepresenting grade point average on a resume, and failing to follow up with a professional connection. Through dialogue following the exercise we emphasized the importance of reputation, impact of reputational damage, building professional relationships, and the imperative of follow-through.  Many students acknowledged although no single hypothetical scenario would necessarily determine success in finding meaningful employment, the decisions made with regard to these issues could impact one’s professional reputation and future opportunities.   

Conclusion

We hope to have initiated student appreciation for the impact of self-directedness on professional identity formation that is integral to beginning meaningful careers after law school. The next step is for each student to take the initiative to complete an online strengths assessment, the VIA Character Strengths Survey, make a first career counseling appointment where they will receive individualized feedback on the ICP and legal resume and identify next steps in planning their careers.  

Save the Date!

Emory’s Center for Transactional Law and Practice is excited to announce the date for its seventh biennial conference on the teaching of transactional law and skills.  The conference will be held at Emory Law, on Friday, June 5, 2020, and Saturday, June 6, 2020.

More information will be forthcoming on the Call for Proposals, the Call for Nominations for the Tina L. Stark Award for Excellence in the Teaching of Transactional Law and Skills, open registration, and travel accommodations.  We are looking forward to seeing all of you on June 5 and 6, 2020!

Thank you to the Conference Coordinator, Kelli Pittman, for sending us this information!

The Legal Interviewing and Language Access Film Project (LILA)

By: Laila L. Hlass and Lindsay M. Harris

Teaching effective interviewing skills is a perennial problem. Although there are excellent texts on the subject, few examples of real or model interviews exist, particularly ones which incorporate collaboration issues between student partners, language access issues with the client, and how to address issues of bias when they arise in the interview.

In 2018, we designed, screen-wrote, produced and released The Legal Interviewing and Language Access Film Project (LILA), two instructional videos and a teaching guide featuring a law student clinic pair representing two different immigrant clients, in two different introductory meetings, one of which is conducted with interpretation.

Our goal was to better teach interviewing in our own experiential courses, but we also hoped to share this resource with our colleagues. Since the videos were launched, law school clinics and experiential learning programs across the country have adopted the use of the videos. At the time of writing, more than 100 educators at nearly 75 law schools have requested use of the teacher’s guide for these videos. This includes more than 30 immigration clinics, but also educators teaching in a variety of other clinics, purely doctrinal courses, as well as courses focused on client counseling and interviewing skills.

The videos raise a multitude of issues within interviewing including client-centered lawyering, collaboration, interpretation, and addressing bias. Our films enliven and deepen the learning environment by utilizing modeling, as well as stimulating classroom discussion, reflection and role play. 

In Interviewing Victor: The Initial Meeting, two law students Lisa and Max interview a teenage asylum-seeker in removal proceedings, Victor, raising a number of issues relating to initial client interviewing, including: Road mapping and organization of the interview; Building rapport; Confidentiality; Role description, including representation at later stages, and explaining the arc of case; Verbal and nonverbal cues; Tone; Answering client questions or ethical issues that are difficult and unexpected; Recording the interview and seeking permission; Taking notes; Form of questions; Word choice; Approaches to sensitive topics and response to client’s distress; Client-centered lawyering; and Working with a co-interviewer.

In Josefina: Using an Interpreter, two law students Lisa and Max working with interpreters to interview a monolingual Spanish-speaking client seeking a U visa as a victim of a crime in the United States. This video raises questions regarding: Using third person; Pacing of speech; Summarization and  expansion of interpretation; Challenges when one student speaks the client’s language but partner does not; Confidentiality; Use of interested parties, such as family members; Approaches to changing interpreters; and Use of common language words where the interpreter doesn’t know the intended meaning.

For faculty who hope to adopt the videos in a course, pro bono orientation or other training, please email either Laila Hlass lhlass@tulane.edu or Lindsay Harris Lindsay.harris@udc.edu for the teacher’s guide, indicating in which course(s) you are considering using the films.

An Overview of “A Study of the Relationship Between Law School Coursework and Bar Exam Outcomes”

Robert Kuehn, Professor of Law at Washington University School of Law in St. Louis, and David Moss, Associate Clinical Professor at Wayne State University Law School, recently conducted a large-scale study looking at the relationship between clinical/experiential or bar subject-matter courses and bar passage success in a paper entitled, “A Study of the Relationship Between Law School Coursework and Bar Exam Outcomes.” As a law student currently enrolled in a clinic, this study immediately piqued my interest.

This study was in response to fear that bar passage rates were down because of rising enrollment in “experiential courses” as opposed to “bar-subject courses.” Law schools began pushing students to enroll in more of these bar-subject courses to correct this so-called issue. However, Professor Kuehn and Professor Moss observed that there was no evidence to suggest that taking more bar-subject courses was appropriate advice for all students. Their study looked at this missing evidence between bar-subject courses and experiential learning and bar exam outcomes for ten years between two law schools: Washington University School of Law (WashU) and Wayne State University Law School (Wayne State). Both schools only require the designed first year courses and the upper-level writing courses mandated by ABA accreditation standards.

Previous studies performed in states like Texas, Colorado, and California looked at the effects of coursework and bar passage rates. These studies did not support the claim that taking more bar-tested law school course improve chances of passing on the first attempt. Notably, a study done in Indiana concluded, “simply forcing lower-performing students to take more upper division bar-subject courses will not solve the bar examination failure problem.”

The first goal of the present study was to determine whether a graduate’s enrollment in elective experiential courses was related to first-time bar passage success. Next, it was to assess whether enrollment in elective courses that cover bar subjects was related to bar success.

Data was collected from law school graduates from 2006-2015. The following table outlines the number of graduates with LSAT scores and bar passage rates between the two schools:

The next table looked at graduate characteristics such as undergraduate GPA, LSAT score, 1L GPA, and law GPA and their correlation with bar passage:

It wasn’t until 2005 that the ABA began requiring graduates to receive professional skills instruction with as little as one credit satisfying the requirement. In 2014, the ABA changed this to require six credits beginning with 2019 graduates. The study authors decided to track enrollment in skills courses versus bar passage over this time period.

The table above reveals a solid line depicting that average bar passage percentages were steady from 2006-2013 (this is when experiential course enrollment increased by over 50%). During the significant rise in experiential enrollment, bar passage percentages were largely steady. “Therefore, efforts to link declining nationwide bar passage rates to the rise in experiential course enrollment are not supported by national statistics.” A more likely contributing cause for bar passage declines since 2014 is weaker credentials of incoming 1Ls.

At WashU, it was found that while taking at least the average number of bar courses is associated with increased likelihood of passing the bar, there was no statistically significant increase in bar passage associated with bottom-quartile LGPA graduates who took more than the school’s average. This was similar with graduates in the bottom half of their class at Wayne State. Results for both schools indicate that graduates in bottom quartile who take fewer than the average number of bar courses at their school were associated with a significant increase in bar failure. Further, at both schools, students entering with scores lower than 150 were associated with pass rates significantly below the school’s average.

This study concluded that the claim that the dramatic decline in bar passage rates is due to law students taking more experiential courses or fewer bar-related courses is not supported. It characterized efforts to cap experiential credits in order to improve bar passages rates are “misguided,” warning that schools should not expect that “mere exposure” to more bar courses will significantly improve bar passage rates.

Also see “Legal Skills Prof Blog” and “TaxProf Blog” for more posts on this study

Building A Solid Foundation Before Week 1

By Louis Jim, Assistant Professor, Albany Law School

One year ago, I began teaching Introduction to Lawyering, which is the required 1L course on legal analysis, communication, and research at Albany Law School. The textbook I used, like many “legal writing” textbooks, provided information about the types of legal authorities (primary or secondary) and weight of those authorities (mandatory or persuasive). And any textbook about legal authorities would, of course, also provide information about this nation’s three-tiered court structure. In class, I discussed those concepts, showed flow charts illustrating the structure, and distributed a map of the circuit courts of appeals. But I failed to assess whether my students truly understood the significance of the three-tiered structure and how that significance related to their other first-year classes.

This past summer, I attended the AALS New Law Teachers Workshop, where a number of presenters inspired me to think about new methods to assess whether my students understand the foundational needed to succeed in the first year and beyond. In response, I made two significant changes to my course design this semester. First, I required my students to complete weekly reflections in the last ten minutes of our Friday class.[1] The students must tell me two things they learned in my class and two things they want to learn more about in class. Students may then leave comments or ask questions on any topic even if the comments or questions are not related to law school.

Second, rather than simply discussing court structure with them, I created an in-class activity to assess whether students understood the significance of that structure. The students completed this activity at our first Friday session, which was the last day of their first week of law school. I rewrote a hypothetical that was originally written by my colleague at Albany Law School, David Walker, Assistant Professor and Director of the Schaffer Law Library, for a quiz in his advanced legal research class. A copy of the hypothetical can be found here:

The students spent the first ten to fifteen minutes of class reading the hypothetical. I then asked a series of multiple choice and short answer questions using Poll Everywhere based off the hypothetical. A copy of those questions can be found here:

I provided a link to the webpage where students would respond the poll’s questions, and students answered the questions using their laptops. Their anonymous responses were displayed on the large monitors at the front of the classroom. As we worked through the questions and hypothetical, I defined common terms that students would encounter in the cases they read for their doctrinal classes (e.g., motion, ruling, opinion, holding, judgment, etc.). I also distributed an outline that allowed the students to write the definitions and take other notes. A copy of that outline can be found here:

I hid the responses until at least three-quarters of the class had responded as I did not want a student’s response to be influenced by their classmates’ responses. By displaying their answers anonymously, every student could participate without fear of embarrassment, a fear prevalent in the first few weeks of law school. By using Poll Everywhere, the students who did not choose the right answer also saw that they were not alone. For each question, we also discussed each of the answer choices and why a particular choice was correct and the other ones were incorrect. Because everyone had to answer the questions, everyone—and not just the victim of the cold call—stayed engaged.

Because we completed this activity on the first Friday that we met, the students also completed their first reflection on that day. One student had commented in her reflection that she wished that we had completed that activity before the first week of classes began because it gave her a better understanding of the assigned case law in her doctrinal classes. I met with this student that following Monday, and she said she had a better understanding of her Week 2 reading assignments in her doctrinal classes after having completed the activity. Another student added that the activity filled many gaps in his understanding of the material in his doctrinal classes. Later that week, another student told me in person that she also wished we had completed the activity before the first week of classes.

As attorneys and/or professors, we often take for granted our understanding of the hierarchy of authority of the court system and our understanding of the terminology common in case law. Those just starting law school, however, may have never read a case before. But more often than not, the new law students’ first law school assignment requires them to read a case (likely more than one) and be prepared to discuss the case (or cases) on the first day of class. Those readings contain terms and concepts that new law students may have heard on television or read in a newspaper, but most new law students lack an understanding of how those terms and those concepts relate to the substantive law. Students may then feel discouraged in the first week because they don’t understand the concepts that seasoned attorneys take for granted. Although law students should and must develop skills in synthesizing rules and applying them, as educators, we must provide a solid foundation so that students can start developing those skills. With that in mind, next year, I hope to complete this activity even earlier so that students begin Week 1 with a solid foundation.


[1] This semester, I teach two sections of Lawyering, and each section meets once on Wednesday and once on Friday. On weeks in which we don’t have time to complete the weekly reflection in class, the reflection becomes an optional assignment that students can email to me. Much to my surprise and delight, some students completed the optional reflections too.

Getting to Know Your Students

By Sandra Simpson, Gonzaga University School of Law

This post can be found on the “Law Teaching” section of the Institute for Law Teaching and Learning website.

“I had some time today to post a blog post with a teaching idea on getting to know your students and starting to build a learning community in your classroom.  At the beginning of the semester, I sent my students a “Getting to Know You” form which contained the following questions:

  1. Tell me anything you would like me to know about you.
  2. How comfortable are you with writing and research? Please give me as much information as you can so I can gauge your experience.
  3. Why did you decide to go to law school?
  4. Why did you choose Gonzaga?
  5. What study methods work best for you?
  6. How do you learn best in the classroom?
  7. Think of your favorite teacher; what qualities made that teacher your favorite?
  8. Think of your least favorite teacher; what qualities made that teacher your least favorite?

These simple questions gave me insights into who is sitting in front of me.  I stapled a picture to each of their information sheets so that I could put a face to the information.  I am only one week into the semester but the information has already helped me.  For instance, when I am forming working groups for the day, I was able to pair students who are comfortable with writing and research with students who are less sure.  Also, knowing what study methods work for the students in front of me, helps me shape how I teach each group of students.  Because each group of students is so different, it is good to have information about those students rather than creating lesson plans without that information.”

Thank you to Sandra Simpson for allowing us to re-blog this!

Fostering Student Success: Part I Challenges Posed by Changing Times and Changing Culture

The opinions expressed within this article are the personal opinions of the author.

By Sara J. Berman, Director of Academic and Bar Success Programs at the AccessLex Institute’s Center for Legal Education Excellence; SSRN author page https://ssrn.com/author=2846291

Law school culture is shifting; the days of the hundred percent final exam are giving way to a culture that emphasizes routine midterms, quizzes, polling, and other formative assessment.  This is in part because of ABA requirements under Standard 314[1] and in part because of the now ample evidence that wise feedback helps law students succeed.[2], [3], [4]  

The shift toward integration of more thoughtful feedback into the curriculum dovetails with a movement of many of today’s leading legal educators to encourage growth mindsets.[5] But voices urging adoption of such positive mindsets ring hollow when set into a greater legal education backdrop that still too often fosters a fixed mindset.  Students who “get it” right away are handsomely rewarded, with the most prestigious jobs,[6] law review, and other opportunities. Those who persevere and overcome struggles are barely acknowledged or, more often, stigmatized because of their early low performance –some never regaining full confidence, even if they later dramatically improve. 

Empirical studies confirm that 1L GPA often correlates with bar passage.[7] Acknowledging high performers is appropriate, even laudable; but should we continue to perpetuate a zero-sum environment where initially-lower performers are not encouraged to improve in consistent and meaningful ways? Are we even aware of the extent to which our system expressly and impliedly communicates to certain students that they are “fated” to fail?  Let’s become collectively more aware and pilot studies to determine whether different faculty and institutional responses to 1L grades might alter what appears to be a “failure trajectory” for lower-performing students. Let’s find ways to truly encourage grit, rather than just giving it lip service all the while rewarding only those who catch on most quickly.  Let’s create a system that “normalizes struggle,” as Professor Christopher argues,[8] and celebrates learning from early mistakes. 

Much learning occurs after 1L. We must study how much more learning might take place if we rewarded, valued, and encouraged law students who engage in continuous improvement and, by graduation, become far more skilled, experienced, and knowledgeable than their first-year grades would indicate. This is not to suggest an “A for effort” or “everyone gets a trophy.” Rather, this is a call for pilot programs and careful study of how initially-lower-performing law students would fare (on the bar exam and in practice) if given true and un-stigmatized opportunities to improve, and be rewarded for improving, during law school.  Such opportunities may come in the form of the suggestions noted in Part II of this post, and by seeding the law school curriculum with formative assessment and thoughtful feedback.

Employers will surely still find ways to determine which graduates are the best fits for which jobs. In the meantime, we are wasting precious resources trying to get lower-performing students to thrive in cultures that do not encourage them to do the extra work required to outperform their early indicators.  Let’s at least study how bar passage (not to mention, job satisfaction and dedicated commitment to using the rule of law to make the world a better place) might improve if law school culture stressed deep, slow, and steady learning, and truly rewarded persistence, resilience, and continuous improvement.

Part II of this post explores some of the many possibilities for “simple” changes that might help advance the ongoing culture shift toward a true growth mindset.  Stay tuned!


[1] Section of Legal Educ. and Admissions to the Bar, Am. Bar Ass’n, ABA Standards and Rules of Procedure for Approval of Law Schools § 314 (2019),https://www.americanbar.org/content/dam/aba/publications/misc/legal_education/Standards/2017-2018ABAStandardsforApprovalofLawSchools/2017_2018_standards_chapter3.authcheckdam.pdf.

[2] Paula J. Manning, Understanding the Impact of Inadequate Feedback: A Means to Reduce Law Student Psychological Distress, Increase Motivation, and Improve Learning Outcomes, 43 Cumb. L. Rev. 225 (2012).

[3] Daniel Schwarcz & Dion Farganis, The Impact of Individualized Feedback on Law Student Performance, 67 J. Legal Educ. 139 (2017).

[4] Carol Springer Sargent & Andrea A. Curcio, Empirical Evidence That Formative Assessments Improve Final Exams, 61 J. Legal Educ. 379, 405 (2012).

[5] The concept of a growth mindset was developed by psychologist Carol Dweck and popularized in her book, Mindset: The New Psychology of Success (2006); see also Sarah J. Adams-Schoen, Of Old Dogs and New Tricks—Can Law Schools Really Fix Students’ Fixed Mindsets?, 19 Legal Writing: J. Legal Writing Inst. 3, 48 (2014); Kaci Bishop, Framing Failure in the Legal Classroom: Techniques for Encouraging Growth and Resilience, 70 Ark. L. Rev. 959, 1006 (2018); Eduardo Briceño & Dawn Young, A Growth Mindset for Law School Success Before the Bar Blog (September 12, 2017); Olympia Duhart, Growing Grit in the LRW Classroom: Practices that Promote Passion and Perseverance (2019) (on file with the author).

[6] See Roger C. Cramton, The Current State of the Law Curriculum, 32 J. Legal Educ. 321, 335 (1982) (arguing that “[f]irst-year grades control the distribution of goodies: honors, law review, job placement, and, because of the importance placed on these matters by the law school culture, even the student’s sense of personal worth.”)

[7] Amy Farley et al., Law Student Success and Supports: Examining Bar Passage and Factors That Contribute to Student Performance (2018) (on file with the author).

[8] Catherine Martin Christopher’s recent article, Normalizing Struggle, Ark. L. Rev. (forthcoming 2019) provides many possibilities for precisely these different sorts of responses and actions.

Teaching What You Don’t Know—Wonderful Book with a NSFW Title

Teaching What You Don’t Know by Dr. Therese Huston is the most helpful teaching book I’ve ever come across.  It combines theory, practical advice, and reassurance in short and helpful chapters.  It has something for everyone who teaches law school at any level.  While the title might be off-putting to those being taught (maybe keep it home), as she explains it, “Teaching what you don’t know is an increasingly common reality for a majority of academics.”  To paraphrase, the only people who don’t teach what they don’t know are adjuncts hired for single classes and very senior research professors who buy out their teaching time.  The rest of us, very much including law professors who she acknowledges throughout, are essentially teaching survey courses in which it would be impossible to claim expertise for every point and chapter.

All that said, this book is truly a life-saver for the times when we truly, really are teaching what we don’t know either because we have taken on someone else’s class in an emergency or more naturally, when starting out when we are asked to teach a class for the first time. “Knowing” an area of law and “knowing how” to teach it are two very different things.  It’s also helpful when you are new at an institution and the students don’t know you.

In a few very short chapters, Dr. Huston provides practical advice for every challenge—very much including how to prepare and how to present yourself and your state of expertise in the class.  The section on “Establishing Credibility” is a must for anyone teaching something or somewhere new.  It can also help navigate the very choppy waters of teaching evaluations—which as we are all now aware reflect first impressions and often dovetail societal biases.

It’s worth some quotes— “Your knowledge of the field may be the primary way that you earn credibility from your colleagues, but you have a different relationship with students and you establish credibility, respect, and trust in different ways.  Research shows that instructors tend to lose credibility with their students when they:

  • “Show up late for class
  • Lack familiarity with the text
  • Cannot explain difficult concepts
  • Rarely ask if students understand their explanations
  • Does not make any attempt to answer students’ questions
  • Fail to follow course policies”

And even more helpful “there are several things you can do to create the kind of credibility that matters to students”

  • Show up on time for class, preferably early, so you have a chance to connect with students and find out if they have any questions
  • Periodically ask students if they understand the material

That first suggestion is gold.  I urge it on everyone.  It can work like magic.  And make your class more welcoming and inclusive. Research suggests that students care that you care—and the simple act of arriving early (even if the classroom isn’t available, you can mingle) allows you to interact informally with students who might never rush the podium after class or certainly not make the pilgrimage to office hours.

It’s also great for those who want to adopt new teaching methods.  There are a lot of teaching books—all with value.  But sometimes reading about 150 techniques for active learning is overwhelming.  Dr. Huston’s advice is highly curated, clearly explained, and very doable. I’ve given this book away several times since discovering it in the education section of a London bookstore and can’t count how many times I’ve read it and recommended it to others.  I don’t know why it isn’t better known.  Despite its title and its value to beginners and those who find themselves teaching something truly new, what the book really provides is sound, research based advice of value to everyone interested in teaching excellence-—even when teaching things you really know quite well. 

Jennifer S. Bard,J.D., M.P.H., Ph.D.,Visiting Professor at the University of Florida’s Levin College of Law

A Few Practical Classroom Resources For The Weeks Ahead: Accessibility, Clarity, And Inclusivity

By this point in August, all faculty, no matter how long you’ve teaching, come to the realization that your class is probably as ready as it is ever going to be.  For those of us particularly interested in teaching law students, it’s also the time to get realistic about the extent to which we can incorporate all the best practices that we know should be in our classes to provide the best possible experiences for our students.  So, what are some practical things you can do right now?  This helpful information from WVU for faculty teaching for the first time can be a helpful checklist.

These are a few high yield resources that I find particularly helpful for turning these intentions into action.

  1. Accessibility

One of the most basic issues we all face is whether the material we provide our students is accessible to them.  Fortunately, there are excellent resources to help use principles of universal design—and not only is it a good idea to follow these principles, it’s actually the law. 

For that reason, it’s likely that your own university already has materials but here are some examples to get you started.  An overview from Cornell,  WVU advice specific to PowerPoints, a comprehensive resource from Colorado and some more pointers about PowerPoint from Blackboard.    Often forgotten is the accessibility of video material—here’s some good advice.

Finally, here is a barebones checklist for documents from the U.S. Govt that could be helpful as a last step before releasing a more substantial document to the class.

  • Clarity of Content

We all want to be clear—and it turns out there are some best practices for doing that.  Here’s one to get started with. (more later)

  • Inclusivity—a few thoughts on names

We all want our classrooms to be a welcoming learning environment for all of our students.  A first step to doing that is just to remember that we all see the world through our own experiences and it’s likely that other people will see it differently.  And luckily there are experts both within the field of legal education, law, and more generally higher education who can help us achieve that goal.   My first advice is to seek out experts starting on your own campus.  Beyond that—are a few resources and a warm invitation to include more in the comments.   

The American Association of Colleges and Universities, a compendium of resources specific to GLBTQ inclusivity, and some information from the ABA

Much is written regarding best practices in calling students by whatever name they choose—and maybe more on how to make that happen later.  

But here’s something less discussed– the names we use for the many hypotheticals we end up writing.   While it seems fun at the beginning to write the “stories” on which subsequent legal analysis is based, it turns out that naming our characters can be something of a minefield.   It’s never a good idea to use the names of the student themselves or people they know—for one thing it can be distracting at best and depending on the hypothetical, perhaps even distressing. 

Beyond that, Names are very powerful, and by choosing to name our plaintiffs, defendants, judges, and witnesses, we are sending messages about how we see the world and our students’ place in it.  At this point, we are all conscious of avoiding offense by not making all the crime and accident victims women and all the judges men, let alone engage in racial, ethnic, sexist, abelist, sanist (please avoid the word “crazy” as hard as that is), homophobic or regional stereotyping [even when it’s in the context of ribbing sports rivals].

But there’s a next step beyond avoiding offense—and that’s truly inviting the larger world into our classroom by drawing names from a variety of cultures and regions.  Where do we find these names?  Baby naming sites! Here are two of my favorites baby name wizard and nameberry.   You probably have your own to add in the comments.

Both of these sites have lists of contemporary popular names in different regions.  At bare minimum, it opens up your fund of knowledge and allows for variety.   But even better, it can help your classroom better reflect the diversity of our country. 

To make it onto a top ten list, these are names that have probably been circulating for a while. Students may well have a cousin or a nephew with one of these names.

 And as a side benefit for pure learning theory, having access to so many names avoid the inherent confusion of a hypo involve Paul, Peter, and Polly.

They can also help you avoid falling into gender traps—here are 150 gender neutral English language names.   Caution.  After doing this, it is essential to proof-read yourself so that you have not fallen into the trap such as making all the defendants Swedish and all the crime victims Norwegian.  Caution 2: If you use these resources enough you may get a lot of diaper ads.

Recap—this post has a deliberately spare list of resources to help make your classroom more accessible and inclusive.

Have a great first week of class–

Jennifer S. Bard, J.D., M.P.H., Ph.D., Visiting Professor at the University of Florida’s Levin College of Law

%d bloggers like this: