Twitter looking into racial bias in tweet image previews

President Donald Trump gave his blessing to a deal that would give Oracle and Walmart a combined 20% stake in a new company called TikTok Global, but questions around security remain. CNN's Selina Wang reports.

Posted: Sep 22, 2020 8:41 AM
Updated: Sep 22, 2020 8:41 AM

Some Twitter users are pointing out that the automatic method the platform employs to display previews of images may be biased toward showing pictures of white people. Twitter agreed the issues was something it needs to work on.

On Saturday, user @bascule tweeted, "Trying a horrible experiment... Which will the Twitter algorithm pick: Mitch McConnell or Barack Obama?" Along with his words were two long, rectangular images. The first consisted of a picture of US Senate majority leader McConnell on the top, who is White, with a slender white rectangle in the middle, and a picture of former US President Obama, who is Black, at the bottom. The second featured the opposite, with Obama at the top and McConnell at the bottom. When a viewer looks at the tweet, a preview version of the images, which are side by side, shows just McConnell.

This came after another Twitter user, @colinmadland, on Friday noticed a similar preview result when he posted a picture that he said showed himself, a White man, side by side with a picture of a Black man with whom he attended an online meeting; Twitter's preview defaulted to showing just the White man.

A number of other Twitter users responded to the post, some sharing the same or similar results. One got the opposite result after digitally adding glasses to Obama's face and removing them from McConnell's. A responding tweet from Anima Anandkumar, director of artificial intelligence research at Nvidia and a professor at the California Institute of Technology, pointed out that she had posted in 2019 about Twitter's preview feature automatically cropping the heads off of images of women in the AI field, but not men.

In a response to @bascule, the company tweeted that it didn't see evidence of racial or gender bias during testing before releasing the preview feature.

"But it's clear that we've got more analysis to do. We'll continue to share what we learn, what actions we take, & will open source it so others can review and replicate," the company wrote. A Twitter spokeswoman said the company has no further comment.

When a Twitter user posts an image to the social network, it uses an algorithm to automatically crop a preview version that viewers will see before clicking through to the full-size image. Twitter said in an engineering blog post in 2018 that it previously used face detection to help figure out how to crop images for previews, but the face-detecting software was prone to errors. The company scrapped that approach and instead had its software home in on what's known as "saliency" in pictures, or the area that's considered most interesting to a person looking at the overall image. As Twitter noted, this has been studied by tracking what people look at; we tend to be interested in things like people, animals, and text.

Zehan Wang, an author of the 2018 blog post and a Twitter engineer, tweeted on Saturday that the company's image-preview algorithm currently does not use face detection. He wrote that Twitter tested the algorithm with pairs of pictures of faces from different ethnic backgrounds and genders, and the company found "no significant bias" when running tests for saliency.

Most users aren't posting the kind of image that @bascule did, with two points of interest that are far apart, which could present a conundrum for an algorithm designed to pick just one area to focus on. But it serves as yet another example of how bias can creep into computer systems that are created by humans and meant to perform tasks that humans are often uniquely good at doing. Additionally, it shows that how an algorithm is tested and how users might interact with it can be meaningfully different.

Mississippi Coronavirus Cases

Data is updated nightly.

Cases: 313166

Reported Deaths: 7228
CountyCasesDeaths
DeSoto21496257
Hinds20294414
Harrison17814309
Rankin13573278
Jackson13411246
Madison10066217
Lee9962173
Jones8364163
Forrest7649152
Lauderdale7181240
Lowndes6370145
Lamar621686
Lafayette6171118
Washington5323133
Bolivar4797132
Oktibbeha461498
Panola4561105
Pearl River4499145
Marshall4397103
Warren4380121
Pontotoc419572
Monroe4100133
Union409076
Neshoba4026176
Lincoln3950110
Hancock377786
Leflore3487125
Sunflower335790
Tate332484
Pike3301105
Scott315373
Alcorn311968
Yazoo310769
Itawamba299477
Copiah296465
Simpson294788
Coahoma294379
Tippah287768
Prentiss279560
Adams269582
Marion268880
Leake266273
Wayne262341
Grenada260386
Covington256381
George246848
Newton246061
Winston226881
Tishomingo225967
Jasper220848
Attala214173
Chickasaw207157
Holmes188673
Clay184754
Stone182033
Tallahatchie178140
Clarke177879
Calhoun170132
Yalobusha163337
Smith162234
Walthall133845
Greene130333
Lawrence128323
Montgomery126742
Noxubee126734
Perry125938
Amite122842
Carroll121728
Webster114532
Jefferson Davis106932
Tunica104826
Claiborne102230
Benton99125
Humphreys96133
Kemper95428
Franklin83623
Quitman80216
Choctaw76118
Wilkinson66930
Jefferson65428
Sharkey50317
Issaquena1686
Unassigned00

Alabama Coronavirus Cases

Cases: 530988

Reported Deaths: 10978
CountyCasesDeaths
Jefferson765291522
Mobile40971804
Madison34751503
Tuscaloosa25775452
Montgomery24329589
Shelby23431249
Baldwin21131308
Lee15884171
Calhoun14501314
Morgan14293279
Etowah13831353
Marshall12222223
Houston10567281
Elmore10061205
Limestone9960151
Cullman9664193
St. Clair9655243
Lauderdale9424241
DeKalb8830186
Talladega8223176
Walker7235277
Autauga6920108
Jackson6810112
Blount6660137
Colbert6298134
Coffee5511119
Dale4831111
Russell441138
Chilton4290112
Franklin425782
Covington4121118
Tallapoosa4027152
Escambia393376
Chambers3563123
Dallas3551151
Clarke351061
Marion3118101
Pike310877
Lawrence300298
Winston274472
Bibb260764
Geneva249977
Marengo249764
Pickens234461
Barbour230857
Hale222977
Butler215969
Fayette212362
Henry188744
Cherokee184845
Randolph180241
Monroe177440
Washington167339
Macon159150
Clay156256
Crenshaw152257
Cleburne148941
Lamar142535
Lowndes138853
Wilcox127130
Bullock123041
Conecuh110529
Perry107726
Coosa107228
Sumter104532
Greene92334
Choctaw60624
Out of AL00
Unassigned00
Tupelo
Cloudy
58° wxIcon
Hi: 65° Lo: 57°
Feels Like: 58°
Columbus
Cloudy
59° wxIcon
Hi: 66° Lo: 61°
Feels Like: 59°
Oxford
Cloudy
54° wxIcon
Hi: 65° Lo: 53°
Feels Like: 54°
Starkville
Cloudy
55° wxIcon
Hi: 65° Lo: 58°
Feels Like: 55°
A frontal system to the south of our area will linger for a few more days. This lingering will linger some more chances for some showers and thunderstorms in our weather forecast over the next few days.
WTVA Radar
WTVA Temperatures
WTVA Severe Weather