The Inclusion List was determined through a process of assigning points for films that met inclusion metrics. A total of 20 points could be earned– 10 for on screen inclusion and 10 for behind the camera inclusion.

To determine on screen inclusion scores, two distinct processes were used, one for leads/co leads and the other for all speaking characters. A film could earn up to 10 points for on screen inclusion based on the 5 inclusion indicators (gender, race/ethnicity, LGBTQ+, disability, age) across leads/co leads (up to 5 points) and all speaking characters (up to 5 points). In the table below, each cell represents the potential to earn at least one point if the metric was achieved.

For films with ensemble leads (n=22), or those with three or more leading characters, a decision to award points was based on whether the constellation of leading characters achieved the benchmarks required for speaking characters across each inclusion indicator. Thus, if a film had 4 leading characters, to earn a point for the gender metric, at least 2 leading characters must be girls/women. For LGBTQ+, at least one character must be LGBTQ+.

In addition to leads/co leads, the percentage of all speaking characters who achieved a given metric was used to determine whether the film earned a point. Thus, if 33% of all speaking characters were underrepresented, the film would earn a point for that indicator.

Behind the camera, it was possible for a film to earn up to 1 point for each behind the camera position evaluated– 10 in total. The positions were: Director, Writer, Producer, Cinematographer, Editor, Composer, Production Designer, Costume Designer, Casting Director, and First Assistant Director.

Up to 1 point was allocated if a woman or person of color was credited in a specific position. So, a film with a woman director earned 1 point. For positions in which multiple individuals were credited, a fraction of a point was allocated for every woman and/or person of color in the role. If two writers were credited and one was a person of color, the film earned 0.5 points for that position. Additionally, a bonus point was awarded to any film that had a woman of color director.

There were two exceptions. For casting directors and costume designers, the historically gendered nature of the role required a different approach. For these positions, if the credited individual was a person of color, the film received a point.

Points were totaled across all available metrics on screen and behind the camera, and films were ranked according to their full point total. The Inclusion List is comprised of films that earned between 6 and 14 points across all inclusion metrics.

After selecting the time frame of interest, we selected a set of film distributors based on the number of films released each year (2019-2022) that were among the 100 top-grossing each year. Distributors with 3 or more films were included. Then, every film released by those distributors was included in the sample, with four exceptions: films that grossed less than $1 million (USD) in domestic revenue, re-releases, documentaries, and animated films were excluded. This resulted in a final sample of 376 films.

A sample of 376 films released from 2019 to 2022 was selected, excluding re-releases, documentaries, and animated films. We chose this sample time frame to incorporate movies released prior to the coronavirus pandemic (2019), as well as those distributed during the pandemic (2020-21), and finally, following the theatrical rebound that occurred in 2022. This time period also allowed us to capture films made and released following the industry upheaval brought on by the Time’s Up and #MeToo movements.

Lead/co lead judgments were made in two ways. Films were viewed by members of the Annenberg Inclusion Initiative staff team to identify the protagonist, or the character driving the action in the story. When a film could not be viewed by staff members, judgments made by research assistants were used and online evidence was sought to corroborate information.

Data regarding on-screen characters and leads/co leads were collected by the Annenberg Inclusion Initiative team. At least two research assistants viewed each film in the sample to identify every speaking or named character that appeared on screen. A total of 14,161 speaking characters were evaluated across all the films in the sample. Once a speaking character was identified, additional information about the character’s gender (male, female, non-binary); race/ethnicity (White/Caucasian, Hispanic/Latino, Black/African American, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Asian, Middle Eastern/North African, Multiracial/Multiethnic); age (child, teen, young adult, middle aged, elderly); LGBTQ+ identity (lesbian, gay, bisexual, transgender, not lesbian, gay, bisexual or transgender); and disability (present, absent). At the analysis level, race/ethnicity was collapsed to reflect a measure of underrepresented (Hispanic/Latino, Black/African American, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Asian, Middle Eastern/North African, Multiracial/Multiethnic) vs. not underrepresented for each character. Reliability of coder judgments was assessed and disagreements were adjudicated by a member of the Annenberg Inclusion Initiative staff to arrive at a final answer.

A total of 10 behind-the-scenes roles were analyzed: Director, Writer, Producer, Cinematographer, Editor, Composer, Production Designer, Costume Designer, Casting Director, and First Assistant Director.

The data collection process involved identifying all individuals who worked in these roles for each film in the sample using IMDbPro. Across the sample, there were 5,576 crew roles evaluated. When the position was not listed on IMDbPro, information was sought from other databases or from film credits.

Across positions, specific credits were included for each role. In general, location-based or unit-based credits were excluded from analysis. Writers included those earning “written by,” “story by,” or “screenplay by” credit and excluded writers responsible only for source material. Only Producers receiving “Produced by” credit were included. When no Costume Designer was listed but a Costume Supervisor was credited, that title was used. Individuals who were credited as “First Assistant Director” were included, and only when no First Assistant Director was credited on a movie was the individual(s) earning “Assistant Director” with no additional modifier included in the sample. Casting Directors were those responsible for overall casting, and location-based casting directors were included in two specific instances. The first was when there was no overall casting director listed and filming took place in only one location. The second was when the overall casting directors both had location based information (e.g., U.S., U.K.) and the film was not shot in those locations. Those casting directors were presumed to be responsible for casting the full production.

Gender and race/ethnicity information was then obtained for each nominee using online sources, such as Studio System by Gracenote, IMDbPro, U.S. Census records, interviews, and social media posts. Gender was categorized as male, female, or non-binary, and race/ethnicity categorized as white or underrepresented (including Black/African American, Hispanic/Latino, Asian, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Middle Eastern/North African, and Multiracial/Multiethnic).

When no information on race/ethnicity could be found, a photograph of the individual was obtained, and senior research team members rendered a judgment on the individual’s race/ethnicity and/or gender. In the past, this process has been used to determine gender and race/ethnicity of series regulars, and there was a .90 correlation between independent judgments made by the research team and documented information on racial/ethnic identity across 2,175 series regulars appearing in episodic content from the 2014-15 season.

There are limitations to this methodology, including the potential for incomplete or inaccurate information available online and the use of limited information to make judgments on race/ethnicity for individuals where no information could be found. However, efforts were made to obtain as much information as possible to ensure the accuracy of the analysis.

• Across the site, descriptions for films, producers, and distributors were generated by ChatGPT and then edited by the Annenberg Inclusion Initiative. Some biographical information was provided by individuals who appear on the list.
  
• Film posters were sourced from IMDb, and company logos from various online sources. Photo credits are provided for each individual.
• Worldwide Box Office totals were sourced from Box Office Mojo as of May 15, 2023. Metacritic scores were obtained from https://www.metacritic.com/.
• Additional details regarding methodology can be provided upon request from aii@usc.edu.

This project was led by Samuel Wheeler (Data Management Coordinator) and Brooke Kong (User Experience Designer). Authorship should be cited as: Wheeler, S., Kong, B., Pieper, K., & Smith, S.L. (2023). The Inclusion List.® Annenberg Inclusion Initiative. Los Angeles, CA.

We would like to express our gratitude to the individuals and organizations who have assisted and supported us, in addition to our outstanding team. Amy White, Julia Tian, and Brycie Jones, along with Karen Do, Lexie Riegelhaupt, and Elise O’Neil and their colleagues at the Adobe Foundation have provided unwavering support for this project since its inception. The dedicated team at the Annenberg Inclusion Initiative also played a significant role in making this project possible, and we extend our appreciation to our hardworking students for their contributions.

Annenberg Inclusion Initiative Founder: Dr. Stacy L. Smith
Program Director: Dr. Katherine Pieper
Program Manager: Ariana Case
Development Team: Sam Wheeler, Anvitha Chegu Ashokkumar, Sai Prasad Palivela, Sindhura B R
Design Team: Brooke Kong and Isabelle Lim
Research Supervisors: Jenisty Colón and Sophia Castro
Research Assistants: A.J. Domingo, Andrea Chen, Anja Tempel, Braxton Albers, Cierra Morgan, Daisy Ma, Ella Hodgetts, Elva Liu, Fatema Bhaiji, Hrushikesh Lavate, Jaden Sibrian, Jessica Jia, Katelyn Do, Monserrat Rodriguez Ortiz, Sanjana Senthil, Tung Le, Tyrese Shaffer, Yutong Jiang, Zianna Razon
Annenberg Inclusion Initiative Staff Team: Al-Baab Khan, Ashley Kolaya, Bryan Davis, Karla Hernandez, Katherine Neff, Matthew A. Davis, Sarah Neff, Terrell Shaffer, Zoe Moore, Zoily Mercado