Justine Nolan, Associate Professor & Associate Dean, University of New South Wales, Michael Posner, Jerome Kohlberg Professor of Ethics and Finance, Business and Society & Co-Director, Center for Business and Human Rights, NYU Stern School of Business / Tara Wadhwa, Policy Associate, Center for Business and Human Rights, NYU Stern School of Business / Dr Dorothée Baumann-Pauly, Research Director, NYU Stern School of Business, speaking on Panel XIII: 'The Responsibility of Internet Platform Companies to Mitigate Harmful Content Online'.
AI Generated·May contain errors
Video Summary
AI Generated
This presentation examines the tension between free speech and the regulation of harmful digital content, such as terrorist incitement and political disinformation. It argues that neither corporate self-regulation nor blunt state censorship is sufficient, proposing instead a hybrid governance model involving targeted legislation and external oversight to ensure human rights are protected.
Good afternoon, so I'm in that wonderful position of being the last person.
So, you know, it's good for you. You just need to stay awake for 15 minutes without visibly falling asleep.
asleep on me. It's okay if you just don't snore too loudly. So I would like to first acknowledge
my co-authors. I've been working on this research with co-authors who are all at NYU. I'm actually
based at the University of New South Wales, which is in Sydney, not Wales. I was once asked by an
American, where is New South Wales? And I said, just south of Old Wales. And he seemed to accept.
that without any problem, which technically is true. We are south of Wales, just a hell of a lot
with better weather. So my job here is to try and tie this together a little bit and look at it
through one particular lens. So what I think we've all been discussing here on this panel
is truly the role of corporations in society. And then the bigger problem we've been discussing
for the past two days, especially how entities like corporations, as non-state actors
How does all of that fit into our state-centric framework of international law?
So, you know, Claire was kind of viewing the specific aspect of due diligence as a means of
regulating companies. Justin was discussing the role of a potential ombudsman in carrying out that function.
And Sabine was then looking at the role of companies, somewhat within societies that are
transitioning into justice. My particular approach to addressing this is to examine the highly topical
issue at the moment of social media companies. And I'm not so much addressing the thorny issue
of Cambridge Analytica. I mean, obviously Cambridge has long been regarded by all of us as a
a bastion of ethics and virtue, but no longer. You are now all tainted with Cambridge Analytica,
Even if it is in London. So Cambridge's name is now forever tarnished, I think.
I'm not here to further disparage it, so I'm not going to address that. But I'm looking in particular at
this issue regarding the role of companies in harmful content. So not so much the underhand
tactics surrounding privacy, but we'll delve into that a bit toward the end. So what has become
very apparent to all of us and has been somewhat forgotten in the past few weeks amid the drama surrounding it
Cambridge Analytica is the truly revolutionary role the internet has played and its profound
impact on human rights. It has had an unimaginable impact on access to education, truly advancing it further
That has become closely associated with democratization in many areas.
But it lends particular credibility to certain organizations outside the mainstream,
political movements outside the mainstream that simply wouldn't have gained prominence
that they would not have had without the internet. It has also provided economic opportunities to
millions of people around the world. So when we talk about the problems of later and how we think
Regarding the regulation of internet platforms, much of it focuses on a specific aspect when we examine it closely.
think about human rights, we particularly focus on the right to free speech around that. And free
speech is enshrined in the International Covenant on Civil and Political Rights. And when we have been
When talking about regulating the internet, a lot of what people immediately jump to is, well, the
The problem is that we'll be limiting free speech. And sometimes what we forget is that we already do.
limit free speech in many ways. In particular, you can see it in the ICCPR and the European
Convention in many other ways, that this is a fundamental right to hold information and access
information. But you can see that we have also been clear for a very long time that it has limits,
that it might be limited in certain areas. The ambiguity and issues I perceive when examining this
The issue with human rights frameworks is that there is considerable ambiguity regarding those boundaries, along with vague terminology.
around national security, public order, and morals. And we have seen in many places, particularly
more draconian states, that they might use them to clamp down on free speech. And that's the argument
that people have been discussing in connection with this specific problem. My specific concern is that
The topic I want to focus on today revolves around the notion that the internet has become polluted with harmful
content. And so, what are we going to do about it? So, in this particular paper, what we're
Talking about is the potential regulation of two types of harmful content. One is terrorist
incitement, such as using the internet for purposes like terrorist recruitment. And the other is what we
call politically motivated disinformation, what many people refer to as fake news. But it's difficult to use
that term now without conjuring up images of Trump. And to him, fake news is anything that he
obviously doesn't like. And that's a term that's being used a lot in the media, but we're particularly
looking at the lens of what we might call politically motivated disinformation. So we're
looking at what should be the role and who should be regulating this. Is it states? Is it
Companies? Other stakeholders? Is it the responsibility of people like you and me? Is it up to us as consumers?
Do we bear some responsibility in connection with this? So these two issues I'm referring to
around news that's around terrorist incitement and political motivated disinformation are very
well connected because, fundamentally, both have seen social media used in a particular way
in a way that resembles media warfare, if you will, to address issues they wouldn't be able to tackle otherwise
confront otherwise. And they are taking advantage of essential elements of social media. So an
an enormous audience, something that can adapt very quickly, a capacity to launch new ideas, including
untrue ideas, with a genuine sense of energy and urgency, and a medium that truly lacks vigor
oversight. So in terms of terrorist incitement, one thing that we've been looking at is the role
that groups like ISIS have exploited and utilized social media on an unprecedented scale
to both recruit new members and incite violence. Estimates of the type of daily pro-ISIS
messages from studies conducted in the past year have estimated that there have been approximately
200,000 messages per day, somewhat related to largely recruitment for ISIS or inciting violence
Name of ISIS. Now this is one of the challenges we'll encounter when we examine regulation.
So how do we actually talk about and define what terrorist incitement is? And some of the new laws?
that we'll get to in a moment basically involves a ban on speech that focuses on terrorist incitement.
But that in itself is a vague term if you look at it. I mean, for years states have been trying to
Define what terrorism is, and we do not have any comprehensive convention on terrorism, but now
We're essentially handing over the power to non-state actors, such as companies, to ban terrorist incitement.
when the states themselves aren't exactly clear what that is in the first place. And so this is
One of the problems we are going to address is this. The other issue we are focusing on is this.
so-called fake news of politically motivated disinformation. So this came to the fore
obviously quite a bit with the 2016 U.S. election. The role of groups like Cambridge Analytica and
Facebook remains unclear about the role it played in that particular election.
But this shows you that some studies have essentially examined perspectives on how much
news was circulated, particularly during the US election, and you can see that fake news was
actually achieving a higher read rate than mainstream media news during that particular period
election. And so what we want to look at is what's the role of both companies and governments in
trying to put an end to deliberately politically motivated falsehoods that are being targeted
on politics. So then this is roughly what we'll spend the rest of our time discussing because
My interest in this issue is not so much that these problems exist, but what we do about them.
About it? And you'll be glad to hear that I don't have any answers regarding that.
So one of the arguments that people are throwing around is this sort of notion that
The problem with regulating free speech is this kind of censorship creep. Once you start to
regulate speech, and you're opening the doors as to who might do that and how, particularly
governments might apply them incorrectly. Therefore, the argument made by some is that instead of regulating
What we should do is basically to apply more speech, and this quote is
often attributed to U.S. Supreme Court Justice Brandeis when he was talking about sort of the
role of sunlight, if you like. And people have been discussing it in this particular forum
Some people have been talking about technology being our savior. That in terms of technology
Here is both the problem, but the way to solve it is to basically allow more technology so as to allow.
more speech. Now I think the problem we have with this is that that may have worked at
at some point or you know, it was more possible in the past, but now, basically, the speed and scale
that internet traffic is so powerful that I believe it has eroded the more speech-oriented solution. And today
harmful content can spread so widely and rapidly that rebuttals often become ineffective, and the
Rebuttal is often lost. That is, the first ones you know are those who speak first, and they are usually the ones who speak the loudest.
and that we are not convinced that simply letting it run unchecked if you can will be the
in relation to harmful content, the next issue gaining significant attention in this area
the role of government, the role of states in regulating digital content, and this is particularly
Interesting, you know, as lawyers, how this might be done in a way that would be reasonable.
and also that preserve the international sort of doing it within international human rights
framework. So we've seen some advances in this; we're about to see the new European Union law.
the General Data Protection Regulation came into play in May and this will basically require companies
to report data breaches within 72 hours, and it will give users of companies like Facebook, Google
and Twitter giving users a bit more control over how their information is collected and also
proposed fines of up to four percent of a company's revenue in relation to this. We've also
seen the new German law that started this year that could require that on request could require
Companies must remove hate speech, and this again requires removal, essentially within 24 hours.
or potentially face fines as high as 50 million euros, and both of these have some strong points
to them, but I also think they pose some real dangers. One of them is the notion that they're
of this sort of censorship creep, where states begin to regulate it, encouraging other states
to use this type of regulation not in the manner of furthering democracy. We've already seen this in
Poland with the 2016 counter-terrorism law, which essentially allows increased suppression of websites
in the name of national security. Even German law, which refers to something akin to the German criminal code
It talks about speech having to come down, which is helping with the formation of terrorists.
organizations, but also that very broadly in terms of speech that defames religion.
So these are really broad categories, and right now, this is what we're doing with some of these laws.
Yes, they have some connection to state laws, but it also leaves a lot of discretion to companies.
and governments regarding what restrictions should be imposed and what legislation should be regulated.
I also think that what we're witnessing in something like the German law aimed at removing information is
24 hours will lead companies to really want to collect even more information rather
not take down information, since why would they leave it up? What would be in their interest if
They receive a request to take it down and they're potentially facing a large fine? Why would they?
even argue about it? I think there will be greater haste in repealing laws. The third point there
is around self-regulation, and this is a very familiar theme in business and human rights.
debate that companies don't need new laws, that companies simply need to
self-regulate. Some of what we've discussed today, particularly with Claire and Justin, is about saying
What they're proposing is that it has actually been a failure of self-regulation.
So I'm not convinced that self-regulation is useless, but I'm also not convinced that it will
Save the issue by itself. Today we saw Facebook announce that they're banning the IRA.
not the IRA, the Internet Research Agency, the Russian group from its pages, which again is a
a very delayed but proactive step by the company to essentially acknowledge that we recognize there is a problem,
although perhaps two or three years late, but then again, what we've also seen in the last few years
Are companies like Facebook increasing their number of human fact checkers? Look at Google, adjusting
their algorithms, bringing more human oversight into them, YouTube is examining how it could eliminate
and identifies somewhat violent extremist videos. So we've seen the companies being forced into
Take somewhat proactive measures if you like, even though it involves reacting to issues that arise.
I think the problem with relying purely on self-regulation in this content is basically
the business model here. So a company like Facebook derives 89% of its revenue from
advertising. So with that kind of model, the entire model of Facebook is built upon
selling users' data. Now I also think that we're blind if we didn't realize that when
you bought into Facebook in the first place. Leaving aside the underhand tactics of Cambridge
Aside from Analytica, the role of these companies is in the way they are making money.
We're getting a free service, but the truth is they're using our data and selling it to advertisers.
and that has been evident for some time. I mean, more than five years ago there was a
debate, and Mark Zuckerberg was involved in this, essentially arguing that privacy is dead.
that we have willingly forsaken our privacy. Now what we are doing, we are beginning to see here,
is basically clawing it back in different ways. So I think where we end up and where we reach
we will come to in the end in our research is perhaps a more hybrid approach. So part of it
will be relying on companies to act but providing them with essentially more rigorous oversight into
how they do it. Importantly for me, I think the question surrounding self-regulation is that it
shouldn't be entirely in-house, is that if companies are making these decisions about takedowns,
Most of the people in these companies are not human rights advocates; they are not experts.
and so that they may involve a broader group of stakeholders in these decisions.
Companies should be reaching out. For years, that has been an argument in examining how companies operate.
with their supply chains and apparel companies, and the initial reactions of companies, companies
Like Nike was like, "No, we've got this under control; we're going to do it in-house." So
Clearly they don't, and social media companies don't either, but I think they do have
an accountability and a self-evaluation role to play here. I think government interventions will
have a part to play. In the research we are examining, particularly regarding politically
motivated disinformation; I think there's a real role for targeted legislation. I'm not convinced.
the value of something like the German law, but I am convinced of making laws that require
transparency in political advertising, which essentially require online companies to act as
Offline firms related to political advertising must become a reality. There is a bill in the U.S.
called the Honest Ads Act, which I think is a good beginning in this direction, and so I think what
what we need is truly intelligent, targeted legislation, not merely a blatant, crude, and indiscriminate instrument that may allow
a kind of creeping censorship to occur. So what we arrive at, I think, is this hybrid approach,
That for particular problems, legislation may be useful, but it has to be really targeted.
not only the problem but also we want companies to continue to somewhat self-regulate in a manner
but with oversight and also with the involvement of external stakeholders. So I think we're at
point in this particular field, that there's, you know, it's been a lot written about the moral
a reckoning of sorts of the Silicon Valley giants in the past few weeks, and I think that for us
that morality alone won't be enough, that what we've seen is that companies have come out
with great regret and a certain assurance that it won't happen again, and that in itself isn't
will be the answer, and so I think what we need is basically greater transparency in this.
area both on government if they're requesting information be taken down and on companies
and so the path forward we are considering is to try and think about what the specific aspects are
problems related to these two issues and strive to develop legislation that specifically addresses them.