Opinion

In Data We Trust: China’s Social Credit system and the quantification of morality

By Maya Raphael

Updated Oct 26, 2020 at 01:46 PM

Reading time: 4 minutes


Human rights

Mar 15, 2018

368

If Black Mirror and Orwell’s 1984 had a child, that child would probably bear an uncanny resemblance to the subject of this article—China’s ‘Social-Credit system’. Unfortunately, this system is not a figment of the imagination created for a sci-fi anthology or dystopian fiction, but rather an evolving reality. So take your seats, get comfy, and have some popcorn ready at hand, while I present you with the next episode in the series, This is actually happening, society is fucked.

The Social Credit System is a government initiative, proposed by no other than (I hate for the protagonist to be so predictable…) China’s communist party. The initiative, which the Chinese government intends to launch nationally by 2020, will essentially be one of the biggest mass surveillance projects in history. It proposes to use big data analysis to track the economic, social and political behaviour of its 1.4 billion citizens, awarding them with three digit “citizen scores” (currently ranging from 350-950) based on algorithms, all of which will use numerous factors to determine how “trustworthy” a citizen is in the eyes of the Chinese government. While there is little information as to what the official government standards are for citizen scores, those being used in the pilot schemes make for pretty ominous indicators as to what they might be. Oh and by the way, these pilot schemes are being run by billion dollar private corporations (such as China’s retail giant Alibaba and its social-credit pilot Sesame Credit). Don’t capitalism and communism make for strange bedfellows when it comes to the profits of citizen data?

The factors that make up the citizen score start off pretty straightforward: your individual “credit history”. Do you pay your bills on time? Water? Electricity? Phone? Rent? Next, it’s down to “verification of your personal details”. Your phone number, home address, email— are you sure it’s all updated so that they can tie your digital identity to your real-life identity? And here’s where it starts getting a little more interesting, “personal behaviour and preference”. Your consumer behaviour is an indicator of how “trustworthy” you really are. For example, if you often purchase video games, expect your score to start plummeting, you are clearly an “idle” citizen. Ever make a reservation at a restaurant and just don’t turn up? Well, that’s no longer a good idea, call the restaurant and cancel immediately if you want to secure yourself a decent citizen score. And as if that’s not enough, another factor currently being taken into consideration is “interpersonal relationships”. Do you have a friend who is only a 400? Not a good idea. Your score might go down just for associating with them. And as if that wasn’t bad enough, did I mention that Sesame Credit has teamed up in a corporate data-tastic partnership with China’s largest online dating platform Baihe? Ouch. Good luck getting someone to swipe right with a score lower than 600.

So what will the consequences of these scores be? According to Rachel Botsman, author of Who Can You Trust? They will be far worse than just losing out on dates. People with low scores will have slower internet speeds, restricted access to restaurants, longer wait times in hospitals, their right to travel or move freely could be taken away from them and will have the burden of paying higher fees for services such as phone charging stations and city bike rentals—a consequence that’s already taken effect.

While mass surveillance, the omnipotent marriage of capitalist corporations and China’s communist government, the use of data tracking to monitor and shape the behaviour of citizens, and the draconian sanctions proposed for the “untrustworthy” are all terrifying, there is something else that scares me more; the way in which an economic discourse is being tacitly underpinned by a moral one. And unlike the points listed above, it scares me not because I’m disposed to seeing it as a warning sign, but precisely because I’m not.

“Allow the trustworthy to roam everywhere under heaven while making it hard for the discredited to take a single step.” This sentence, pious as it may seem, is not taken from a religious manuscript, but is stated in the Chinese government’s documents outlining the plans for the credit system. Still, tempted as I am to use this as yet another example of just how extreme and despotic the Chinese communist party and this particular initiative is, the more I think about the rhetoric used by governments and financial entities in the west—the more it, too, seems to be implicitly packaged in moral discourse. “Together we are one”, “Open. Honest. Hardworking”, ” The better we know you, the more we can do”, ” Honesty first”, “Trust. The feeling is Mutual”. These are just a few of the financial slogans belonging to banks in Europe and the US, the same institutions that have ingrained in us the belief that our financial decisions are not purely economic, but also moral. Take for example, the notion that debt must be paid back, and that houses, jobs and people’s life savings can all be claimed by those banks because not paying back debt is such a serious offence. However, as we so clearly witnessed in 2008, when these same institutions accumulated too much debt of their own, they didn’t have to abide by the moral rules and pay it back—the government bailed them out.

But still, in the western world we have not reached a point where who we are friends with on Facebook affects our credit ratings, right? Wrong. Affirm, a US online money-lending company owned by Paypal co-founder Max Levchin is already digging through its customer’s social networks to evaluate what the default risk might be. And Singapore-based Lenddo, a company which states that it uses “non-traditional data” to provide credit scores in order to fulfil its mission of “empowering the emerging middle class around the world” (how Miss America of them), is so thoughtful that it notifies a debtor’s friends on Facebook when they don’t pay their installations back on time.

Perhaps what we in the western world find so disturbing about China’s social-credit system is the bold and unmistakable government use of personal data for creating a moral index of what a good trustworthy citizen is. Yet maybe what should worry us instead is that corporate companies and governments in the west are doing much of the same thing, only without the transparency and visibility with which China is approaching this new venture. For all we know, we may have already been assigned a ranking in the trust index, yet as opposed to the Chinese, we just haven’t been informed as to what our score is.

Keep On Reading

By Charlie Sawyer

22-year-old groom arrested after police find 9-year-old bride at staged Disneyland wedding

By Fatou Ferraro Mboup

Keep vaping or your Tamagotchi dies. Introducing the latest vape invention in New York

By Abby Amoakuh

ICE hit with backlash for lying to elementary school staff in bid to detain young students

By Eliza Frost

UK to lower voting age to 16 by next election. A controversial move, but the right one

By Charlie Sawyer

Introducing Berlin’s latest tourist attraction Cybrothel, where men can request AI sex dolls covered in blood

By Charlie Sawyer

From performing at Mother Teresa’s canonization to 10+ film roles, no one works as hard as Rita Ora’s agent

By Eliza Frost

Glen Powell’s GQ photoshoot is a satiric look at modern day males—and he’s in on the joke 

By Abby Amoakuh

From dinner parties to grocery flexing: Inside Gen Z’s new language of luxury

By Charlie Sawyer

Johnny Depp plays the victim once more and anoints himself crash test dummy for #MeToo

By Abby Amoakuh

New video game that allows men to r*pe female family members triggers backlash amid incel concerns

By Charlie Sawyer

Everything you need to know about toxic gossip site Tattle Life and how its founder finally got revealed

By Eliza Frost

Will Belly choose herself in the final episodes of The Summer I Turned Pretty?

By Abby Amoakuh

Francesca Farago reveals that influencers are being paid to participate in trend mocking Hailey Bieber

By Charlie Sawyer

Fans express concern after Harry Potter TV series announces the casting of Harry, Ron, and Hermione

By Fatou Ferraro Mboup

Celebrities call out Blue Origin for sending Katy Perry and Lauren Sánchez to space

By Abby Amoakuh

John Lithgow fumbles JK Rowling question as Harry Potter TV show cast struggles with fan backlash

By Charlie Sawyer

Snow White live action remake faces further controversy for ominous trees and gentle kissing warnings

By Fatou Ferraro Mboup

Could the next pope be Black? Peter Turkson’s papal bid could rewrite over 1,500 years of Vatican history

By Charlie Sawyer

Emma Watson reveals disgusting paparazzi ambush on her 18th birthday

By Charlie Sawyer

Lawmakers pressure Trump to provide evidence that Venezuelan asylum seeker Andry Hernández Romero is still alive