Are white and non-white police officers equally likely to kill black suspects?
Well, that's the conclusion of a 2018 US study, as reported in the press:
"White officers do not kill black suspects at a higher rate compared with nonwhite officers," concludes a research team led by Charles Menifield, dean of the School of Public Affairs and Administration at Rutgers University–Newark. "The killing of black suspects is a police problem, not a white police problem."
The actual paper's abstract isn't too different in its conclusion:
although minority suspects are disproportionately killed by police, white officers appear to be no more likely to use lethal force against minorities than nonwhite officers. [...]
The disproportionate killing of African Americans by police officers does not appear to be driven by micro‐level racism. Rather, it is likely driven by a combination of macro‐level public policies that target minority populations and meso‐level policies and practices of police forces.
So, is this paper "bullet proof"? I mean: Has it been criticized, e.g. for its methodology? Is its conclusion consistent with other research on this topic?
united-states mortality racism police
|
show 1 more comment
Well, that's the conclusion of a 2018 US study, as reported in the press:
"White officers do not kill black suspects at a higher rate compared with nonwhite officers," concludes a research team led by Charles Menifield, dean of the School of Public Affairs and Administration at Rutgers University–Newark. "The killing of black suspects is a police problem, not a white police problem."
The actual paper's abstract isn't too different in its conclusion:
although minority suspects are disproportionately killed by police, white officers appear to be no more likely to use lethal force against minorities than nonwhite officers. [...]
The disproportionate killing of African Americans by police officers does not appear to be driven by micro‐level racism. Rather, it is likely driven by a combination of macro‐level public policies that target minority populations and meso‐level policies and practices of police forces.
So, is this paper "bullet proof"? I mean: Has it been criticized, e.g. for its methodology? Is its conclusion consistent with other research on this topic?
united-states mortality racism police
60
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
9
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
1
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
1
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago
|
show 1 more comment
Well, that's the conclusion of a 2018 US study, as reported in the press:
"White officers do not kill black suspects at a higher rate compared with nonwhite officers," concludes a research team led by Charles Menifield, dean of the School of Public Affairs and Administration at Rutgers University–Newark. "The killing of black suspects is a police problem, not a white police problem."
The actual paper's abstract isn't too different in its conclusion:
although minority suspects are disproportionately killed by police, white officers appear to be no more likely to use lethal force against minorities than nonwhite officers. [...]
The disproportionate killing of African Americans by police officers does not appear to be driven by micro‐level racism. Rather, it is likely driven by a combination of macro‐level public policies that target minority populations and meso‐level policies and practices of police forces.
So, is this paper "bullet proof"? I mean: Has it been criticized, e.g. for its methodology? Is its conclusion consistent with other research on this topic?
united-states mortality racism police
Well, that's the conclusion of a 2018 US study, as reported in the press:
"White officers do not kill black suspects at a higher rate compared with nonwhite officers," concludes a research team led by Charles Menifield, dean of the School of Public Affairs and Administration at Rutgers University–Newark. "The killing of black suspects is a police problem, not a white police problem."
The actual paper's abstract isn't too different in its conclusion:
although minority suspects are disproportionately killed by police, white officers appear to be no more likely to use lethal force against minorities than nonwhite officers. [...]
The disproportionate killing of African Americans by police officers does not appear to be driven by micro‐level racism. Rather, it is likely driven by a combination of macro‐level public policies that target minority populations and meso‐level policies and practices of police forces.
So, is this paper "bullet proof"? I mean: Has it been criticized, e.g. for its methodology? Is its conclusion consistent with other research on this topic?
united-states mortality racism police
united-states mortality racism police
edited 2 days ago
Fizz
asked 2 days ago
FizzFizz
9,88413779
9,88413779
60
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
9
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
1
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
1
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago
|
show 1 more comment
60
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
9
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
1
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
1
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago
60
60
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
9
9
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
1
1
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
1
1
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago
|
show 1 more comment
1 Answer
1
active
oldest
votes
TL;DR - we don't know if the study is corroborated.
I will continue to look into this topic to edit and improve the answer. It may be too early to conclude if the results of the 2018 paper are corroborated by other sources.
RE: Methodology, the paper covers it well (emphasis added).
We constructed an original database of all confirmed uses of deadly force by police officers in the United States in 2014 and 2015.
We began by drawing on data gathered by Killed By Police, a
nongovernmental entity that tracks police killings reported in the
news and updates its data set each day. We chose this source as a
base because the site links each killing with a news story that we
could locate online. In order to ensure that the accuracy of the data,
we cross-checked it with two other websites that collect data on
police killings (lethaldb.silk.co
and
FatalEncounters.org).
All three
data sets have been used by other scholars studying police killings
(Lott and Moody 2016; Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017).
The Killed By Police data contained the victim’s name, race, age,
date of birth, gender, date and time of killing, city, state, and a
news account of the killing. We supplemented these data with
other variables available in news accounts and other police killing
data sets, including local population demographics, cause of death,
geographic location of the killing, type of offense, presence of a
nonpolice witness, and whether there was a warrant for the suspect.
...We also coded for a range of
variables about the officers whenever possible, such as officer race
and gender, years of police service, and type of officer. Because of
missing data, we had to thoroughly analyze every news story that
we could locate on each killing.
First, let's look at the credibility of the websites.
Looking at Killed By Police, each entry in the database indeed includes a news article (and usually, 1+ news articles). Thus, it appears credible. Something interesting to note is that it has been fact-checked by FiveThirtyEight. From FiveThirtyEight:
We randomly sampled 146 incidents (10 percent) from the news links posted to Killed By Police. All the posts linked to established outlets, although in some cases a new url for the article had to be found because the news site had restructured its links.
Looking at lethaldb.silk.co, we find the message "It’s time to say goodbye" and a notice that it has been shut down. The Internet Archive didn't have screenshots of older versions of the webpage, so I cannot verify its authenticity.
FatalEncounters.org also appears credible, as it includes a news story with each entry. Note that for all sites I checked some entries, but not all.
Next, let's see if other scholars have actually used the same data set.
The pdf for Lott and Moody 2016 can be accessed here and is published in the Social Science Research Network. I couldn't find the impact factor for this journal. From what I can tell, it is similar to ArXiv, so I would take documents here with a grain of salt. I could see from the appendix that data was collected from killedbypolice.net and fatalencounters.org, but not from the other source.
Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017 can be accessed here. It is published in the Public Administration Review, the same journal as is the paper in question. In 2017, the impact factor was 4.591. Reading the paper confirms it also draws data from KilledByPolice and FatalEncounters (but, again, not from the third source).
Thus, some scholars did actually use data from 2 of the sources as the paper in question.
It may be too early to conclude if the conclusion is consistent with other research on this topic. The paper was published in 2018, and as the authors say
However, to our knowledge, no study has directly assessed the
racial composition of officer killings of suspects.
To address your questions:
Is this paper "bullet proof"?
No paper is truly bullet proof.
Has it been criticized (e.g. for methodology)?
I have not yet found criticisms of this paper. However, it may be too early to tell. By checking the three sources the paper used for its data set, two (KilledByPolice and FatalEncounters) appear to be credible. The third (lethaldb.silk.co) could not be fact-checked due to lack of an online presence (both current and historical). The paper mentions the three websites as having been used by other scholars. This is a true statement for KilledByPolice and FatalEncounters. This is an unverified (possibly false) statement for lethaldb.silk.co.
Is the conclusion of this paper consistent with other research on this topic?
It may be too early to answer this question as the paper was published in June 2018 and has been cited 2 times. A 2004 paper found undergraduate students were more likely "to shoot Black targets but not Whites."
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
|
show 16 more comments
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
TL;DR - we don't know if the study is corroborated.
I will continue to look into this topic to edit and improve the answer. It may be too early to conclude if the results of the 2018 paper are corroborated by other sources.
RE: Methodology, the paper covers it well (emphasis added).
We constructed an original database of all confirmed uses of deadly force by police officers in the United States in 2014 and 2015.
We began by drawing on data gathered by Killed By Police, a
nongovernmental entity that tracks police killings reported in the
news and updates its data set each day. We chose this source as a
base because the site links each killing with a news story that we
could locate online. In order to ensure that the accuracy of the data,
we cross-checked it with two other websites that collect data on
police killings (lethaldb.silk.co
and
FatalEncounters.org).
All three
data sets have been used by other scholars studying police killings
(Lott and Moody 2016; Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017).
The Killed By Police data contained the victim’s name, race, age,
date of birth, gender, date and time of killing, city, state, and a
news account of the killing. We supplemented these data with
other variables available in news accounts and other police killing
data sets, including local population demographics, cause of death,
geographic location of the killing, type of offense, presence of a
nonpolice witness, and whether there was a warrant for the suspect.
...We also coded for a range of
variables about the officers whenever possible, such as officer race
and gender, years of police service, and type of officer. Because of
missing data, we had to thoroughly analyze every news story that
we could locate on each killing.
First, let's look at the credibility of the websites.
Looking at Killed By Police, each entry in the database indeed includes a news article (and usually, 1+ news articles). Thus, it appears credible. Something interesting to note is that it has been fact-checked by FiveThirtyEight. From FiveThirtyEight:
We randomly sampled 146 incidents (10 percent) from the news links posted to Killed By Police. All the posts linked to established outlets, although in some cases a new url for the article had to be found because the news site had restructured its links.
Looking at lethaldb.silk.co, we find the message "It’s time to say goodbye" and a notice that it has been shut down. The Internet Archive didn't have screenshots of older versions of the webpage, so I cannot verify its authenticity.
FatalEncounters.org also appears credible, as it includes a news story with each entry. Note that for all sites I checked some entries, but not all.
Next, let's see if other scholars have actually used the same data set.
The pdf for Lott and Moody 2016 can be accessed here and is published in the Social Science Research Network. I couldn't find the impact factor for this journal. From what I can tell, it is similar to ArXiv, so I would take documents here with a grain of salt. I could see from the appendix that data was collected from killedbypolice.net and fatalencounters.org, but not from the other source.
Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017 can be accessed here. It is published in the Public Administration Review, the same journal as is the paper in question. In 2017, the impact factor was 4.591. Reading the paper confirms it also draws data from KilledByPolice and FatalEncounters (but, again, not from the third source).
Thus, some scholars did actually use data from 2 of the sources as the paper in question.
It may be too early to conclude if the conclusion is consistent with other research on this topic. The paper was published in 2018, and as the authors say
However, to our knowledge, no study has directly assessed the
racial composition of officer killings of suspects.
To address your questions:
Is this paper "bullet proof"?
No paper is truly bullet proof.
Has it been criticized (e.g. for methodology)?
I have not yet found criticisms of this paper. However, it may be too early to tell. By checking the three sources the paper used for its data set, two (KilledByPolice and FatalEncounters) appear to be credible. The third (lethaldb.silk.co) could not be fact-checked due to lack of an online presence (both current and historical). The paper mentions the three websites as having been used by other scholars. This is a true statement for KilledByPolice and FatalEncounters. This is an unverified (possibly false) statement for lethaldb.silk.co.
Is the conclusion of this paper consistent with other research on this topic?
It may be too early to answer this question as the paper was published in June 2018 and has been cited 2 times. A 2004 paper found undergraduate students were more likely "to shoot Black targets but not Whites."
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
|
show 16 more comments
TL;DR - we don't know if the study is corroborated.
I will continue to look into this topic to edit and improve the answer. It may be too early to conclude if the results of the 2018 paper are corroborated by other sources.
RE: Methodology, the paper covers it well (emphasis added).
We constructed an original database of all confirmed uses of deadly force by police officers in the United States in 2014 and 2015.
We began by drawing on data gathered by Killed By Police, a
nongovernmental entity that tracks police killings reported in the
news and updates its data set each day. We chose this source as a
base because the site links each killing with a news story that we
could locate online. In order to ensure that the accuracy of the data,
we cross-checked it with two other websites that collect data on
police killings (lethaldb.silk.co
and
FatalEncounters.org).
All three
data sets have been used by other scholars studying police killings
(Lott and Moody 2016; Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017).
The Killed By Police data contained the victim’s name, race, age,
date of birth, gender, date and time of killing, city, state, and a
news account of the killing. We supplemented these data with
other variables available in news accounts and other police killing
data sets, including local population demographics, cause of death,
geographic location of the killing, type of offense, presence of a
nonpolice witness, and whether there was a warrant for the suspect.
...We also coded for a range of
variables about the officers whenever possible, such as officer race
and gender, years of police service, and type of officer. Because of
missing data, we had to thoroughly analyze every news story that
we could locate on each killing.
First, let's look at the credibility of the websites.
Looking at Killed By Police, each entry in the database indeed includes a news article (and usually, 1+ news articles). Thus, it appears credible. Something interesting to note is that it has been fact-checked by FiveThirtyEight. From FiveThirtyEight:
We randomly sampled 146 incidents (10 percent) from the news links posted to Killed By Police. All the posts linked to established outlets, although in some cases a new url for the article had to be found because the news site had restructured its links.
Looking at lethaldb.silk.co, we find the message "It’s time to say goodbye" and a notice that it has been shut down. The Internet Archive didn't have screenshots of older versions of the webpage, so I cannot verify its authenticity.
FatalEncounters.org also appears credible, as it includes a news story with each entry. Note that for all sites I checked some entries, but not all.
Next, let's see if other scholars have actually used the same data set.
The pdf for Lott and Moody 2016 can be accessed here and is published in the Social Science Research Network. I couldn't find the impact factor for this journal. From what I can tell, it is similar to ArXiv, so I would take documents here with a grain of salt. I could see from the appendix that data was collected from killedbypolice.net and fatalencounters.org, but not from the other source.
Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017 can be accessed here. It is published in the Public Administration Review, the same journal as is the paper in question. In 2017, the impact factor was 4.591. Reading the paper confirms it also draws data from KilledByPolice and FatalEncounters (but, again, not from the third source).
Thus, some scholars did actually use data from 2 of the sources as the paper in question.
It may be too early to conclude if the conclusion is consistent with other research on this topic. The paper was published in 2018, and as the authors say
However, to our knowledge, no study has directly assessed the
racial composition of officer killings of suspects.
To address your questions:
Is this paper "bullet proof"?
No paper is truly bullet proof.
Has it been criticized (e.g. for methodology)?
I have not yet found criticisms of this paper. However, it may be too early to tell. By checking the three sources the paper used for its data set, two (KilledByPolice and FatalEncounters) appear to be credible. The third (lethaldb.silk.co) could not be fact-checked due to lack of an online presence (both current and historical). The paper mentions the three websites as having been used by other scholars. This is a true statement for KilledByPolice and FatalEncounters. This is an unverified (possibly false) statement for lethaldb.silk.co.
Is the conclusion of this paper consistent with other research on this topic?
It may be too early to answer this question as the paper was published in June 2018 and has been cited 2 times. A 2004 paper found undergraduate students were more likely "to shoot Black targets but not Whites."
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
|
show 16 more comments
TL;DR - we don't know if the study is corroborated.
I will continue to look into this topic to edit and improve the answer. It may be too early to conclude if the results of the 2018 paper are corroborated by other sources.
RE: Methodology, the paper covers it well (emphasis added).
We constructed an original database of all confirmed uses of deadly force by police officers in the United States in 2014 and 2015.
We began by drawing on data gathered by Killed By Police, a
nongovernmental entity that tracks police killings reported in the
news and updates its data set each day. We chose this source as a
base because the site links each killing with a news story that we
could locate online. In order to ensure that the accuracy of the data,
we cross-checked it with two other websites that collect data on
police killings (lethaldb.silk.co
and
FatalEncounters.org).
All three
data sets have been used by other scholars studying police killings
(Lott and Moody 2016; Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017).
The Killed By Police data contained the victim’s name, race, age,
date of birth, gender, date and time of killing, city, state, and a
news account of the killing. We supplemented these data with
other variables available in news accounts and other police killing
data sets, including local population demographics, cause of death,
geographic location of the killing, type of offense, presence of a
nonpolice witness, and whether there was a warrant for the suspect.
...We also coded for a range of
variables about the officers whenever possible, such as officer race
and gender, years of police service, and type of officer. Because of
missing data, we had to thoroughly analyze every news story that
we could locate on each killing.
First, let's look at the credibility of the websites.
Looking at Killed By Police, each entry in the database indeed includes a news article (and usually, 1+ news articles). Thus, it appears credible. Something interesting to note is that it has been fact-checked by FiveThirtyEight. From FiveThirtyEight:
We randomly sampled 146 incidents (10 percent) from the news links posted to Killed By Police. All the posts linked to established outlets, although in some cases a new url for the article had to be found because the news site had restructured its links.
Looking at lethaldb.silk.co, we find the message "It’s time to say goodbye" and a notice that it has been shut down. The Internet Archive didn't have screenshots of older versions of the webpage, so I cannot verify its authenticity.
FatalEncounters.org also appears credible, as it includes a news story with each entry. Note that for all sites I checked some entries, but not all.
Next, let's see if other scholars have actually used the same data set.
The pdf for Lott and Moody 2016 can be accessed here and is published in the Social Science Research Network. I couldn't find the impact factor for this journal. From what I can tell, it is similar to ArXiv, so I would take documents here with a grain of salt. I could see from the appendix that data was collected from killedbypolice.net and fatalencounters.org, but not from the other source.
Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017 can be accessed here. It is published in the Public Administration Review, the same journal as is the paper in question. In 2017, the impact factor was 4.591. Reading the paper confirms it also draws data from KilledByPolice and FatalEncounters (but, again, not from the third source).
Thus, some scholars did actually use data from 2 of the sources as the paper in question.
It may be too early to conclude if the conclusion is consistent with other research on this topic. The paper was published in 2018, and as the authors say
However, to our knowledge, no study has directly assessed the
racial composition of officer killings of suspects.
To address your questions:
Is this paper "bullet proof"?
No paper is truly bullet proof.
Has it been criticized (e.g. for methodology)?
I have not yet found criticisms of this paper. However, it may be too early to tell. By checking the three sources the paper used for its data set, two (KilledByPolice and FatalEncounters) appear to be credible. The third (lethaldb.silk.co) could not be fact-checked due to lack of an online presence (both current and historical). The paper mentions the three websites as having been used by other scholars. This is a true statement for KilledByPolice and FatalEncounters. This is an unverified (possibly false) statement for lethaldb.silk.co.
Is the conclusion of this paper consistent with other research on this topic?
It may be too early to answer this question as the paper was published in June 2018 and has been cited 2 times. A 2004 paper found undergraduate students were more likely "to shoot Black targets but not Whites."
TL;DR - we don't know if the study is corroborated.
I will continue to look into this topic to edit and improve the answer. It may be too early to conclude if the results of the 2018 paper are corroborated by other sources.
RE: Methodology, the paper covers it well (emphasis added).
We constructed an original database of all confirmed uses of deadly force by police officers in the United States in 2014 and 2015.
We began by drawing on data gathered by Killed By Police, a
nongovernmental entity that tracks police killings reported in the
news and updates its data set each day. We chose this source as a
base because the site links each killing with a news story that we
could locate online. In order to ensure that the accuracy of the data,
we cross-checked it with two other websites that collect data on
police killings (lethaldb.silk.co
and
FatalEncounters.org).
All three
data sets have been used by other scholars studying police killings
(Lott and Moody 2016; Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017).
The Killed By Police data contained the victim’s name, race, age,
date of birth, gender, date and time of killing, city, state, and a
news account of the killing. We supplemented these data with
other variables available in news accounts and other police killing
data sets, including local population demographics, cause of death,
geographic location of the killing, type of offense, presence of a
nonpolice witness, and whether there was a warrant for the suspect.
...We also coded for a range of
variables about the officers whenever possible, such as officer race
and gender, years of police service, and type of officer. Because of
missing data, we had to thoroughly analyze every news story that
we could locate on each killing.
First, let's look at the credibility of the websites.
Looking at Killed By Police, each entry in the database indeed includes a news article (and usually, 1+ news articles). Thus, it appears credible. Something interesting to note is that it has been fact-checked by FiveThirtyEight. From FiveThirtyEight:
We randomly sampled 146 incidents (10 percent) from the news links posted to Killed By Police. All the posts linked to established outlets, although in some cases a new url for the article had to be found because the news site had restructured its links.
Looking at lethaldb.silk.co, we find the message "It’s time to say goodbye" and a notice that it has been shut down. The Internet Archive didn't have screenshots of older versions of the webpage, so I cannot verify its authenticity.
FatalEncounters.org also appears credible, as it includes a news story with each entry. Note that for all sites I checked some entries, but not all.
Next, let's see if other scholars have actually used the same data set.
The pdf for Lott and Moody 2016 can be accessed here and is published in the Social Science Research Network. I couldn't find the impact factor for this journal. From what I can tell, it is similar to ArXiv, so I would take documents here with a grain of salt. I could see from the appendix that data was collected from killedbypolice.net and fatalencounters.org, but not from the other source.
Nicholson-Crotty, Nicholson-Crotty, and
Fernandez 2017 can be accessed here. It is published in the Public Administration Review, the same journal as is the paper in question. In 2017, the impact factor was 4.591. Reading the paper confirms it also draws data from KilledByPolice and FatalEncounters (but, again, not from the third source).
Thus, some scholars did actually use data from 2 of the sources as the paper in question.
It may be too early to conclude if the conclusion is consistent with other research on this topic. The paper was published in 2018, and as the authors say
However, to our knowledge, no study has directly assessed the
racial composition of officer killings of suspects.
To address your questions:
Is this paper "bullet proof"?
No paper is truly bullet proof.
Has it been criticized (e.g. for methodology)?
I have not yet found criticisms of this paper. However, it may be too early to tell. By checking the three sources the paper used for its data set, two (KilledByPolice and FatalEncounters) appear to be credible. The third (lethaldb.silk.co) could not be fact-checked due to lack of an online presence (both current and historical). The paper mentions the three websites as having been used by other scholars. This is a true statement for KilledByPolice and FatalEncounters. This is an unverified (possibly false) statement for lethaldb.silk.co.
Is the conclusion of this paper consistent with other research on this topic?
It may be too early to answer this question as the paper was published in June 2018 and has been cited 2 times. A 2004 paper found undergraduate students were more likely "to shoot Black targets but not Whites."
edited yesterday
answered yesterday
Barry HarrisonBarry Harrison
2,1761930
2,1761930
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
|
show 16 more comments
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
3
3
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
I will continue looking into this for future edits. From what I can see now, there doesn't appear to be a big reason to doubt the methodology.
– Barry Harrison
yesterday
7
7
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
You establish that none of the data in KBP is fake. You do not establish that the data in KBP is complete: To fake bias in either way, I could simply use true data only, but omit some killings for one of the races.
– FooBar
yesterday
12
12
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
Essentially, 538 would need to also randomly sample x% of incidents from some established outlet, and see whether they all appear in KBP.
– FooBar
yesterday
1
1
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
While this is a pretty thorough answer, it doesn't actually seem to explicitly contain a "yes", "no", "maybe", or even a "don't know". A TL;DR might be in order. (At or near the top, preferably.)
– Grimm The Opiner
yesterday
1
1
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
@Obie2.0 If you trust KBP, you don't need to even perform the check that 538 provides. All I'm saying is that the check done is - as is - incomplete and hence meaningless. Furthermore, data can be biased without bad intent.
– FooBar
yesterday
|
show 16 more comments
60
Do note that there may be some bias introduced based on how the officers are assigned. If black police officers are preferentially assigned to black districts then they will tend to kill more black people than white. This will distort the measurements. Somehow the relative exposure of the officers to black vs white people must be taken into account to arrive at meaningful numbers.
– Daniel R Hicks
yesterday
9
There are other possible interpretations of this research, too. One might be that police shootings are primarily driven by unconscious bias, which might have a smaller gap between white and black officers. Another might be that levels of prejudice against African-Americans are similar among police officers of all races (I don't think this is true, because I've seen research showing major differences in the attitudes of black and white officers).
– Obie 2.0
yesterday
1
@Obie2.0: If you remember what the latter research is, it definitely belongs in an answer.
– Fizz
yesterday
1
@Fizz I don't have time to answer, but it's the Pew study I cited on my recent answer on white supremacism and whistleblowing in police departments.
– Obie 2.0
yesterday
@DanielRHicks - your comment makes no sense. Officers elect to work in an area for the most part. In larger cities they may be transferred to a certain area so that may be what you are refferring to. However better qualified officers will elect to work in safer areas on average - black or white. On average areas with a higher black population will be higher in crime in the US. Therefore these areas - on average - are getting the lesser qualified officers whether black or white. Saying an officer picks area based on race - no way.
– blankip
21 hours ago