09 September 2020
Prompted by a strange dream, I decided to calculate what your odds
are of correctly guessing the three pieces of evidence the first
time in the game of Clue.
In practice, successfully doing this is likely to provoke accusations
of cheating. But a simple calculation will show that this is likely
undeserved. In a standard game of Clue, there are six character
cards, six weapon cards, and nine location cards. Without any
information at all, that gives the odds of correctly guessing on your
first turn at only 1/6 × 1/6 × 1/9 = 1/342, which is frequent enough
that anyone who plays Clue many times is likely to encounter it. Keep
in mind that each player has these odds on their first guess, which
significantly raises the chances of ever seeing it happen in a game.
Of course, in every game of Clue each player will have some
evidence, and so the odds of a correct first guess go up quite a bit.
How much? That depends on how much evidence (how many cards) you
The rules for the distribution of evidence are pretty simple. The
three “correct” cards are removed from the deck of evidence, it’s
shuffled, and distributed to players as evenly as possible. The
players then proceed to interrogate each other about the cards they
have, in order to eliminate live possibilities about the correct
combination of person, weapon, and location. You hope to eliminate
all but one combination (the correct one)
before any other player can do so. In my circles, when children are
playing, the players are arranged so that the younger will receive
more cards than the older if they can’t be divided evenly.
Not every combination of cards is equally likely. If you are to
receive five cards, you’re most likely to receive two of two of the
card types and one of the third, or three locations, one weapon, and
one person. These five-card hands are dealt a combined 58% of the
time! In addition, some hands make a correct first guess easier than
others: for a five-card hand, the best hand (all characters or all
weapons) gives you almost three times better odds than the worst one
(four locations, one other card). Note that actually, the better
hands tend to be heavy in locations because you have to visit fewer
of them. A low-location hand only improves your chances of guessing
Okay, so what we have to do is figure out the odds of each hand
combination (multiset), and multiply that by the chances of a
correct first guess for each hand, and sum up the results to get the
total odds of a correct first guess (assuming a perfectly shuffled
deck). I wrote Python code to do that here.
Now, here are the results! Some of the hands aren’t possible, because
standard clue only supports six players, which means each of them
would get three cards, but I’ve included
where a player might start out with zero to two instead.
So for a five card hand, you’d expect to guess correctly the first
time about once every 136 games. With six cards that drops to once
every 111 games! Combining these facts with multiple players, you
can show that fair games of clue will end with a player solving the
mystery on their first turn every 30-40 games.
A Clue bot?
Thinking about this problem made me consider writing a Clue bot, but
I ended up deciding against it. It might be an interesting project:
you can do a very good approximation of perfect play with a bot that
just tabulates its knowledge about every player’s hand and uses a
simple pathfinding algorithm to efficiently traverse the board.
However, there are two good reasons not to bother. One is that Clue
isn’t a “fair” game: an improved strategy may reduce your win rate
rather than improve it. (In this specific sense, both Chess and Candy
Land are fair.) The reason for this is that the standard rules of
To make a Suggestion, move a Suspect and a Weapon into the Room
that you just entered.
Normally, moving around the board is a slow process, since rooms are
fairly far apart and you only get to move one d6 each turn. (This
also adds quite a bit of luck into the game.) However, because the
murder suspects are also other players, the above rule means that
each guess (“Suggestion”) you make will instantly teleport one of
them into the room with you. This can either aid (by vastly reducing
travel time) or harm (by preventing an intended move) another player.
With coordination among the other players, it’s possible to harass
one player and make it almost impossible to plan movements. Even
without this unfair practice, it’s often in the interest of
individual players to harass those of equal or greater skill to them.
That’s just clever play! This can backfire, of course, but the better
a player (or bot) is, the more likely other players are to attempt
it, and it can make intelligent pathfinding impossible.
There’s a simpler reason not to bother with a bot, however, and
that’s that close to perfect play is already easily achievable by
humans. We’re already pretty good at intuiting optimal routes, and
extracting as much information as possible from gameplay is easily
done with an algorithm:
The game comes with worksheets for the players to use which
list every card in rows, and have several columns (probably intended
to save paper over multiple games). Simply assign the first column
to yourself, and every succeeding column to the other players in the
order of play. The additional columns are used to collect any
information you can obtain about what hands the other players have.
At the top of each column write the number of cards that player has.
Use your own column to summarize everything you know about the
solution. An “x” means that you know that a card is not part of the
solution, and a box means that you know it is.
For the other columns, a box means that the player does not have the
corresponding card. An “x” means that they do (and therefore, that
there should also be an “x” in your column, the “solution” column).
Whenever a player is not able to show any cards to someone
(including you), place the box in each of the rows for that player.
When a player shows a card to someone besides you, place a tiny
number in that column in any row they might have a card in. (Simply
increment the number you use in each column every time you need a
new one.) Whenever logic forces you to place a box in someone’s
column, check to see if only one row that shares a number remains,
and you can then put an “x” there. If you can work out every card
that a player has, you can put a box in every other row.
Example: Player 1 suggests Ms. Scarlet, the candlestick, and the
ballroom. Player 2 has none of these cards, so you put a box on each
one in their column. Player 3 shows a card, so you put a “1” in each
box in their column. Player 2 suggests Ms. Scarlet, the knife, and
the kitchen. Player 3 has none of these cards, so you now have a box
for Ms. Scarlet in their column. It comes around to your turn, and
you suggest Mr. Green, the candlestick, and the library. Player 1
shows you the candlestick. So you put an “x” on their column for
candlestick, which means a box belongs in Player 3’s column for the
candlestick. Now you’re only left with one “1” in that column, on
the ballroom. So you know Player 3 must have shown Player 1 that
card and so you can put an “x” in the box. Now you know it’s not part
of the correct solution!
Obviously there’s a bit more improvement you can do with ideal
guessing, and it might make sense to keep track of what other players
know so you can surmise if they’re about to make a correct
accusation, in which case you might want to jump the gun if you have
a 50/50 shot. But 95% of strategy can be easily implemented by a
player following the approach above.
22 March 2020
You can find plenty of old, bad guides on validating DNSSEC online.
The worst ones I’ve seen just say to do
% dig example.org
and tell you that the
status: NOERROR you see in the response means
that DNSSEC was validated (or at least, if it exists for that domain,
it was validated).
That’s not true at all. Some resolvers do in fact validate this
information for you, like Google’s DNS:
% dig @220.127.116.11 bad.dnssec-or-not.com
does give you
status: SERVFAIL. But obviously you shouldn’t be
counting on that. A DNS server that doesn’t support DNSSEC, like
Level3’s, will happily return your query with the
% dig @18.104.22.168 bad.dnssec-or-not.com
Some slightly better guides tell you to look for the
AD flag. This
is part of an IETF standard
by which a recursive resolver can indicate to you that it has
verified the DNSSEC data. So if you run those two commands I have
above on a site with valid DNSSEC data (like example.org), you’ll
see that the response from Google includes the
ad flag, but the
response from Level3 does not.
Does this mean that you have verified the DNSSEC data? No. It
means that Google says it has verified the DNSSEC data. And the
interesting thing is that it’s actually quite difficult to verify
it yourself, at least with the traditional tools. And the tools
you’re using most of the time, including
probably your browser too are not verifying DNSSEC data. They’re
relying on you to have configured a resolver with DNSSEC support,
and that resolver to return SERVFAILs if you query a domain with
broken DNSSEC. It’s entirely based on trust.
I’ve found one or two guides out there which tell you how to fetch
all the DNSSEC data you need and verify it yourself piece by piece.
Most of the time you’ll use
dig to get the data you need.
You can certainly do this, as long as you don’t slip up on any part
of the process. (Most guides seem woefully incomplete on how exactly
you need to do this.) But it turns out that a few years ago the BIND
folks added a new tool (alongside their others,
that does automatically verify DNSSEC. I discovered it by accident
when reading a
man page. You can get it on Arch Linux in the
and Ubuntu and Debian have it in
The syntax is very similar to
dig. The rest of this post is pretty
self explanatory. Observe how
delv discovers that the site’s
DNSSEC is broken, even though it’s using a resolver that doesn’t
% delv @22.214.171.124 +short bad.dnssec-or-not.com
;; validating bad.dnssec-or-not.com/A: no valid signature found
;; RRSIG failed to verify resolving 'bad.dnssec-or-not.com/A/IN': 126.96.36.199#53
;; resolution failed: RRSIG failed to verify
% dig @188.8.131.52 +short bad.dnssec-or-not.com
And with a DNSSEC supporting resolver:
% delv @184.108.40.206 +short bad.dnssec-or-not.com
;; resolution failed: SERVFAIL
And with a site with woring DNSSEC:
% delv @220.127.116.11 +nocrypto example.org
; fully validated
example.org. 82231 IN A 18.104.22.168
example.org. 82231 IN RRSIG A 8 2 86400 20200402175057 20200312201336 63865 example.org. [omitted]
26 September 2019
I really enjoyed this article called The Evangelical Mind by Adam Kotsko. Parts of it reflect my experience growing up as an evangelical Christian very well, other parts do not. I have a few thoughts on the parts that don’t.
One point of difference is music. Kotsko’s parents complained that their Christian radio’s programming was “dull and conservative”. Kotsko says elsewhere that his father saw an important place for rock music in Christianity. My experience couldn’t be further from this. Even the most traditional music playing on Christian pop stations would have been regarded as wholly inappropriate for church, and questionable in general.
Kotsko identifies the evangelical movement with the “seeker-sensitive” approach to church growth. Every church I attended as a child was violently opposed to this idea, and many of the pastors would rail against the idea (by name) from the pulpit. There was a constant fear that anything too friendly or enjoyable would water down the tough message of the gospel. The evangelicals I knew liked to point out that “narrow is the way…”
Additionally, Kotsko accuses evangelicalism of “self-satisfied conformism”. While I think this is appropriate as a political and social point, Kotsko extends it to also mean that for the quintessential evangelical, “nothing could be stupider than expecting people to live by the teachings of Christ”. This would have been big news to my church, where nearly every member knew many verses of Romans 6 by heart. Their willingness to hold themselves to the Bible’s standards was certainly selective (never more so than on those political and social points), but the issue was always taken seriously. And apparently “arcane” points of doctrine like predestination were major issues: they were instrumental in a church split, in fact.
I rehearse this because I think Kotsko would not be surprised by any of it. It’s not simply that there are more serious and extreme evangelicals, as there are in any movement. It’s that this internal dissension is a central part of the evangelical movement itself. Whether you view evangelicalism as primarily a theological response to liberal traditions in the early 20th century, or a political response to the changing fabric of American culture of the 60s (as Kotsko does), it is undeniably characterized by paranoia and reactionary attitudes (as Kotsko says).
These are at the heart of modern evangelicalism’s instinct to eat itself. As Kotsko says, “Evangelical Christians nevertheless regard themselves as a persecuted and misunderstood minority, surrounded by a hostile secular culture that is actively seeking to deceive and corrupt their children.” Those who aren’t familiar with evangelicalism may be surprised to learn that this is no exaggeration. It’s a conspiracy theory as expansive as the Reptilian one, but believed by far more people. Beliefs like this are hard to go halfway on; they tend to consume you. You begin to see lizard people, or black helicopters, or “secularists” everywhere. When I came home from college after my first semester, I was excited to let everyone know there had been a mistake - not every non-evangelical had been a tool of Satan out to eat my soul. This did not go over very well.
When you take this kind of conspiratorial view of the world, it’s hard to stop with just those not in your group. Arguably this is made even harder by the plain fact that the majority of Americans claim to be Christians. If you’re going to maintain your self-understanding as a persecuted minority, while you’re the majority, you’ve got to believe that most of the people who claim to be on your side are actually infiltrators. And so it is: evangelicals are forever splitting into smaller, more specific, and more suspicious groups.
The points of difference, while taken extremely seriously by most evangelicals, are also necessarily created by this process. If you’re going to kick someone with almost identical beliefs out of your group, you need an important reason. What could be more important than a central doctrine like predestination, or not diluting your message with “seeker-friendly” music arrangements? Or what could be a more useful tool for purging your group of the infiltrators? The most serious evangelicals are always trying to purify themselves in this way. Controversies that seem unimportant to outsiders, like whose books Lifeway is selling, are great ways of figuring out who’s on the narrow path and who’s in danger of hellfire. Megachurches, in particular, are widely viewed as suspicious organizations that grift off an evangelical identity without any of its substance.
Once more, I note that I don’t think any of this would surprise Kotsko. This kind of continual purging is central to the evangelical experience, but the particular bugbears that apply to each evangelical subgroup are always unique. Mine viewed movies with suspicion, and thought that seeker-friendly worship was a sinister plot, but didn’t require women to cover their heads, use the KJV version of the Bible, or believe that drinking was inherently sinful. What I’m hoping this illustrates is how Kotsko’s particular experience fits into evangelicalism as a whole - a movement that’s a weird continuation of the paranoia of the reactionary conservatism of a prior generation.
31 January 2018
Update for Raspberry Pi 4:
I originally wrote this guide in 2018, and then I got a Raspberry Pi 4 the same
month as they were released. Unfortunately, The Pi 4 was released without
initial support for netbooting. I did manage to work out how to get basic
functionality, but I still had to keep the
/boot partition on the SD card,
which also meant remembering to sync that partition with the NFS
every time there was an OS update.
Even though the SD card wasn’t even mounted 99% of the time,
apparently the heat of being connected to a Pi was enough to eventually fry
my SD card. I managed to get it working just long enough to update the firmware
to a new version, which just now, as of this month, arguably has full support
for netbooting. (
SELF_UPDATE could previously be enabled, but it’s finally
the default. This means that the Raspberry Pi folks now support doing firmware
updates via USB or NFS, not just the SD card.)
Several steps are needed: make sure you’re on the latest (>= 2020-09-03)
firmware. Then run the following to enable boot from a TFTP server:
cp /lib/firmware/raspberrypi/bootloader/stable/pieeprom-2020-09-03.bin .
rpi-eeprom-config pieeprom-2020-09-03.bin > boot.config
# open boot.config in your editor of choice and change BOOT_ORDER to 0x412
rpi-eeprom-config --out new-pieeprom-2020-09-03.bin --config boot.config pieeprom-2020-09-03.bin
sudo rpi-eeprom-update -d -f new-pieeprom-2020-09-03.bin
# and reboot
0x412 option will look for a TFTP server to boot from via DHCP, then fall
back to the SD card, and then fall back to booting from USB. See here
for documentation. The default option (as of the 2020-09-03 firmware) is 0x41,
which unfortunately doesn’t even try to use netbooting.
Some other guides I found suggest that you disable the automatic update for
the eeprom, in order to prevent it from disabling the netboot setting, but
this should not be needed. The documentation says:
If you update your bootloader via apt, then any configuration changes made
using the process described here will be migrated to the updated bootloader.
Once netbooting is enabled, the remainder of this guide should work just fine.
As far as I can find, this is still the only guide to netbooting a Raspberry
Pi that doesn’t assume you’re using another Raspberry Pi as a TFTP server.
One change I had to make is that I’ve switched from using a consumer grade router
with custom Tomato-based firmware to using my own hardware with OPNsense. The same
guidance I provide for how to get your DHCP server to send the PI to the TFTP server
applies, but it seemed to be necessary to use the “Text” type for the server IP
address field, not the “IP address or Host” option. Your milage may vary.
The original guide, for the Raspberry Pi 3:
You can find plenty of guides to booting a Raspberry Pi from the network, but the one’s I’ve seen make one or two assumptions. One is that the official guide assumes that you’re booting off of another Raspberry Pi, which you use to generate the boot folder. Another is that you’ll be providing DHCP and TFTP on the same server, e.g. using
dnsmasq. This is annoying because you end up running two DHCP servers on the same network, and it has the potential to interfere with the network configuration on the server that’s running it.
So here’s my plan. I’ve already got a Tomato router (running Advanced Tomato), and it’s got
dnsmasq as a DHCP server. So in theory I should be able to direct the Pi to my real server, which I’m going to run tftpd-hpa on. The same server also runs my NFS mounts, so I’ll use it to host the root directory for the Pi as well.
I expected this to be simple, but it turned out to be rather hard. There are a lot of moving pieces, and many of them don’t give you much help when they break. So I’m documenting the process here.
What you need to do this:
- A server to host NFS and TFTP
- A router with a configurable DHCP daemon, e.g.
dnsmasq (Tomato-based routers are great for this.)
- A Raspberry Pi 3 (the first model to support netbooting without an SD card) with a working Raspbian installation on an SD card
- A working NFS setup (not hard to do, but not described here)
- Possibly a lot of patience. (This is very much not a step-by-step guide, I assume that you know how to find the tftpd config file yourself, know how to configure your network’s DHCP server, and so on and so forth. I’m simply documenting how to configure things.)
The first, and apparently most difficult part, is just getting a working TFTP server. I installed
tftpd-hpa on Ubuntu 17.10, made sure port
69 was unblocked, did some basic configuration. No luck, even over localhost. After some mucking about, I could tell using
-v -v -v with
tftpd was receiving the request, but it never bothered to respond—and it didn’t say why. After hours of trying different suggestions online, I managed to get a working configuration with the following:
I’m not sure if the
-p is needed, but honestly I’m too scared to change anything now. Some of these settings are almost designed to cause frustration.
--secure isn’t even a security setting, it sets the “default” directory to
TFTP_DIRECTORY and translates all addresses to subdirectories of that one. Yes, that’s right, without
--secure, a request for a relative path won’t work. My
/boot files are owned by
umask=022, and that seems to work fine.
The main thing you need to do for TFTP is set the directory to the path you want to use for the Pi’s boot files. Since I have the NFS server and the TFTP server on the same hardware, I can conveniently point the TFTP server at
/boot in the Pi’s root directory under NFS. (Note that you’re making these files available via the TFTP server, so you want to use the real path to where the boot files are located on your file system, not the place they’re made available over NFS.)
But first things first, we have to get the root directory onto the server first. The official guide is rather useless here. It assumes that we’re going to run the server off of another Pi, which we can conveniently copy the root from. I went the opposite direction. I set up the NFS server with the options
and, mounting the folder on the client Pi (with Raspbian installed to an SD card), copied the root with
rsync to the NFS folder. Conveniently enough, we can use the exact same folder and settings to point the Pi to later. (Having virtually no security on the root folder of the Pi’s filesystem is pretty concerning, however. I haven’t figured out how to get around this given the limitations of PXE booting on the Pi. You could at least limit the IP addresses which the NFS server will answer to, but I do only recommend running this on a carefully secured subnet.)
Alright, so I now have a working Raspbian filesystem served over NFS, and I can point my TFTP server to the
/boot directory as previously described. I do need to edit
/boot/cmdline.txt as described in the official guide to point the boot code towards the NFS server. Also best to edit
/etc/fstab and remove everything but
/proc, otherwise Raspbian thinks the boot didn’t succeed.
dwc_otg.lpm_enable=0 console=serial0,115200 console=tty1 root=/dev/nfs
nfsroot=10.0.1.102:/path/to/root,vers=3 rw ip=dhcp rootwait elevator=deadline
The bit starting with “root” is the important part. We need to point the boot code to the directory with the Pi’s root on the NFS server, as shown.
The remaining task is to get the DHCP server on the network to respond to the PI’s PXE discovery request. I fought
dnsmasq on Advanced Tomato for a long time, and finally settled on setting the appropriate DHCP fields by hand, as established in RFC 2132.
dhcp-option=43,Raspberry Pi Boot
Where the IP address belongs to the TFTP server. There are three spaces after “Boot” as suggested in the official guide, but I don’t know if they’re actually necessary. Surprisingly enough, these two options alone were enough to get it working—I just set them on the DHCP page of Advanced Tomato.
The last step is just to make sure booting over ethernet is enabled on the Pi,
as the official guide says (or see above for the Pi 4). After that, removing
the microSD card and rebooting, everything should just work!
01 March 2017
The term “fake news” has entered the modern parlance so quickly that it is worth beginning a discussion about fake news by trying to determine what, if anything, the term means. One way of investigating it is to try to identify a particularly clear case, rather than to propose a definition. Let me give what I take to be such a case.
Suppose there’s a website where the writers invent their stories, with no effort or intention of basing those stories on actual events. The articles are purely fictional, much like those found on satire sites like The Onion, but we find two critical differences when we look more closely. First, the articles on fake news sites are not intended to be satirical, nor do they contain typical markers of writing not intended to be taken seriously. Instead, they are written with the positive intent to deceive their audience. Second, these articles support and reinforce a particular (often extreme) political viewpoint, and tap into the zeitgeist in order to manipulate the public.
Now, one good reason to accept this as a paradigmatic case of fake news is that there actually are such sites. One receiving some attention in the mainstream press recently is the so-called “Denver Guardian,” run by a man successful enough to hire at least 20 writers. We read, even more worryingly, that children are incapable of reading a fake news article and a real news article and reliably distinguishing between them. We imagine a bleak future in which no one is able to tell true claims from false.
Another reason to take this view of fake news seriously is that everyone seems to accept it. The traditional news media has decried this apparent rejection of facts and has gone so far as to blame the election outcome (at least partially) on these sources of fake news. Facebook, under intense scrutiny and pressure, has shown interest in algorithms that either weed out or reduce the visibility of fake news sources.
The problem with fake news on this popular account is that unlike the occasional false story in the New York Times, it’s designed with the intent to mislead its audience. While, to be sure, even highly trained reporters will sometimes make mistakes, fake news is a kind of propaganda (though, in typical American fashion, it’s privatized).
Here is where I must say I’m rather skeptical of the intent-oriented account of fake news.
One reason to be worried is how easily talk of fake news morphs into blame-passing and mockery of conservatives. In this spirit, we see NPR note gleefully that some fake news writers “have tried to write fake news for liberals — but they just never take the bait.” Note also that insofar as the legitimate news media are able to pass blame for the election result, they direct attention away from their own culpability. Put aside for the moment how much (if any) blame the media deserves for putting Trump in the spotlight; realize first that this strategy has been wholly successful. Liberals everywhere are singing the praises of traditional news media, renewing (more likely, beginning!) subscriptions to the New York Times and Washington Post, and emphasizing the importance of a free press for democracy. (See this previous article on The Vim about how to criticize the media effectively.)
Of course, I’m not here to say that all these changes are unfortunate. Rather, in addition to emphasizing the crucial role of a free press in the face of an openly hostile administration, I think it’s crucial that we take a look at the role of the press in spreading misinformation, and diagnose more carefully the distinction between real and fake news.
Let’s take a look, first, at intent. A well credentialed reporter who tries to give a truthful account but is tripped up by unreliable sources or a subtle bias doesn’t seem to blame for the mistake. On the other hand, someone who writes deliberately false or misleading articles in order to reinforce a reader’s hatred for Hillary Clinton is deeply culpable for their act of lying. That said, in discussing fake news we usually are not trying to determine who’s to blame for various types of false statements, but rather to analyze the effect of the fake news phenomenon on the public. We’re trying to solve a practical problem, not a moral one.
One of the seeming benefits of the intent-based account of fake news is that it draws a bright line between fake news and real news. It also provides a very clear set of conditions for applying the term “fake news”: news is fake if it uses a made-up story to support a particular ideology. My core argument, however, is that these benefits evaporate when we’re trying to solve the practical problem I have stated. The reason for this is simple: the whole point of fake news (in the previous sense) is that it by definition is difficult to tell apart from real news. In fact I take a stronger view: it’s not possible for well-crafted fake news to be distinguished from real news except in terms of the apparent implausibility of its claims.
Implausibility is a tricky thing. We could insist on using it in an objective sense, but here it will be more natural and helpful to think about how what is plausible varies from person to person. Here, therefore, our practical problem becomes much more terrifying; the only hope for distinguishing fake news from real news relies on apparently subjective considerations.
Because of this, I suggest that our fixation on fake news can embolden the very sources of propaganda we attack. Think for a moment about what we’re telling the public on this account of fake news. We’re saying that their news sources are peppered with claims that are deliberately designed to deceive them. We’re telling them that they are unable to distinguish these false claims from true ones. Now, one might argue the situation isn’t as bad as all that. After all, the crucial difference is that these sources intend to mislead you, right? Surely mainstream news organizations have no reason to do that, right?
The problem, as I see it, is that Pandora’s box is open, and the trustworthiness of all of these organizations is up for grabs. Our appeals to plausibility carry no weight when our beliefs about what is plausible are so poorly aligned. Because of all this, Trump is free to throw all this talk back in our faces and say to a CNN reporter, “you’re fake news!”
It’s tempting, of course, to accuse Trump of simply misusing the term. Fake news, we might say, implies an intent to deceive, and CNN clearly has no such intent. What Trump ought to have said, we argue, is that CNN is false news, or that it sometimes says false things. I think this is deeply mistaken diagnosis of Trump’s purpose. Trump’s media agenda is precisely to cast doubt on the sincerity of the press. An ideal Trump supporter literally believes that the mainstream media is “fake news” — that they systematically lie about Trump in order to advance their own (liberal) agenda. That this seems so beyond the pale to us is precisely why it has so great a chance of success. We’re so blinded by the apparent implausibility of CNN’s being fake news that we don’t realize that many people take this claim quite seriously.
Before considering alternatives, let’s take a crucial step back. The fake news / real news dichotomy implied by the “intent” view is supported by a rather traditional take on what real news is. The latter, I suggest, hasn’t been plausible for decades now. Let me introduce this argument with a question: is Huffington Post “real news”? Thinking about the press from a certain traditionalist viewpoint, one would have to say certainly not. Their articles are informed by a center-left liberal viewpoint. At one point, they had an editor’s note at the bottom of articles about Donald Trump noting that he was a serial liar and misogynist. It’s equally clear, however, that Huffington Post is not fake news as typically construed. They are quite sincere about their liberal viewpoint. We could, of course, have a similar discussion about Fox News, MSNBC, and online-only news sites and blogs.
I think a better understanding of news media emphasizes the role that opinion plays in all of them. At a minimum, any news source will be affected by opinion in its reporting with regard to the news it emphasizes and ignores, the language it uses, and what it deems to be legitimate sources. One might argue that there’s still a core of news that remains purely objective: the direct reporting of recorded events. A newspaper might report, “Donald Trump told us so-and-so,” and if necessary, produce a recording of him saying it. I don’t wish to deny that there is some objective core to news, but note that Trump has disputed even basic facts like these. He’s denied saying things he was recorded saying; the faithful believe, and those on the edge are smoothed over with “Mr. Trump means he was taken out of context,” and we all move on to the next scandal.
With that in mind, let’s take another look at our predicament. The practical problem is that the standard view of fake news proclaims that most people aren’t capable of telling real news from fake news. What’s worse, reliably distinguishing real news from fake news requires interpreting the intent of one’s source, which ultimately necessitates a grasp of what is *plausible. I argue that this view fails to give us ways to solve this problem. While it’s certainly true that certain news is fake news in the proposed sense, i.e. that it consists (at worst) in completely fabricated stories, the distinction does not cut across the information people accept in any actionable way.
Here I insert a joke: the reason the fake news writers couldn’t get liberal readers to bite on their stories is that those readers were already subscribed to the New York Times.
Consider again the culpability of the mainstream media in their hyping of Trump (scandals and all) throughout the campaign, which gave him countless millions of dollars in free screen time. It would be wrong to suggest, of course, that the mainstream media was a deliberate propaganda machine on behalf of Trump, but these facts also belie the idea that the media is truly interested in accurately representing the facts to us. Systematically focusing on one candidate or type of story to the detriment of all others is as serious a bias as any. As I argued earlier, it’s a crucial symptom of opinion in journalism when certain decisions are made about which stories to cover and which to drop.
In its never-ending focus on Clinton’s email “scandal”, the mainstream press created the mistaken notion that she was a hopelessly flawed and corrupt candidate. Of course this doesn’t qualify as fake news under the original definition at all; the media did not say anything intended to be false (or anything strictly false at all), only continually engaging in never-ending false controversy. One might think that the “coverage is always good” dictum applies to Clinton equally as well as Trump, but this is not quite true. Coverage is only good if you encourage the belief that the mainstream media perpetually lies about you, and you have supporters willing to believe it. Every negative thing that the media published about Trump was either “lies” or just further proof that the press wanted to destroy his candidacy.
Many in the public ended up believing that Clinton and Trump were comparable in terms of their flaws as candidates. This doesn’t have to be a reasonable belief or survive very much serious inquiry (indeed it does not). It only has to exist in the space of things one can say without being laughed at by nearly everyone. I call this space the *discourse horizon. It’s of fundamental importance in public thought, and it’s partially created by the media. Of course, it also has a corresponding effect on what the media can and cannot say. Journalism can locate something within the discourse horizon simply by presenting it as up for debate. So, as a result, the public feels that “GMOs cause cancer” is a legitimate belief, while “NASA faked the moon landing” is not.
I suggested previously that opinion plays a role in all journalism. I think recent years have seen a vast increase in the amount of opinion pieces available to, and read by, the public. These too can have an effect on the space of acceptable beliefs. Even more traditional media often blurs the line between its traditional journalism and opinion pieces. I frequently find it hard to tell on some sites when a piece is original reporting and when it is an opinion piece (on Slate for example). This means, from the public’s point of view, it’s often enough to find one or two people who are willing to state publicly the thing you’d like to believe.
There are, of course, many varying degrees of opinion in journalism. Fake news, in the received sense, hardly counts as opinion at all, since it is written without regard to the truth of the claims it makes. Editorials, and opinion-friendly sources like Huffington Post, explicitly endorse a particular political viewpoint. The mainstream news is written from an apparently objective perspective, but in fact is affected by opinion in a variety of hidden ways. I think a crucial point about “fake news” is that it’s a very tiny portion of the giant media buffet. It’s certainly true that there are a small number of sites that make up absurd stories for advertizing revenue, but they have a relatively small impact on the media diet of the vast majority. Most articles are quite sincere. What really counts is just how much opinion is available, and crucially, the fact that you can find an opinion piece that validates nearly any of your opinions.
The accepted solution to this problem is fact-checking, of course. If you read something from an opinion piece or unknown source, you should look it up on FactCheck or try to find a corroborating source. If this is the solution, then what we need to do is teach the public media literacy.
I think what I have said already should cast doubt on this solution. First, there are valid questions about whether the mainstream media itself is trustworthy. They not only misrepresented the nature of the election, thereby making them partially responsible for the Trump phenomenon, they are also limited by, and responsible for their part in creating, the discourse horizon. Furthermore, their financial interest in presenting controversy and attracting viewers regularly compromises them, as we saw when the Washington Post recently reported that Russia had hacked a power station in Vermont. Second, I question the efficacy of the fact-checking solution when the portion of the public we are concerned about is forced to choose between competing sources of information and the legitimacy of traditional journalism is up for grabs.
I have a much darker suggestion to make about the people who believe fake news. Much of it, the “Pizzagate” story for example, is so outlandish and unbelievable that it’s almost inconceivable that anyone could seriously believe it. So I suggest that most of them don’t believe it. The immediate question that arises for them is not whether the statement is true, but rather whether it contains the correct value judgment about its subject. To the Trump voter, Clinton is nasty, despicable, and morally rotten. That’s exactly the sort of thing she would do! Sharing the article is an invitation to one’s friends to wink together at it, to join with others in pretending to believe the lie.
Trump voters aren’t unique in this regard. We saw much the same thing very recently in Trump’s “golden shower” controversy. The whole story came from a single unsubstantiated report published by Buzzfeed. It sounds incredibly unlikely. Do some people really believe it? Maybe. The point, however, for most people who shared the story was not whether it was true but rather it said the right kinds of things about (and provided an opportunity to mock) Trump. Liberals take solace in the fact that Trump is not merely evil and ignorant but a pervert.
Even conspiracy theories are present among liberals. A survey found that half of Clinton voters believe that Russia hacked the election vote counts. It’s absurd and obviously false, and (crucially) as far from reality as anything on a fake news site.
I think that there is little hope of solving this problem through media literacy. Not only is “fake news” only part of what I take to be a much larger problem, there is little practical hope for convincing Trump supporters to take traditional media seriously. Not only do they frequently not care whether the story is true, they also have serious doubts (encouraged by Trump himself) about the good intentions of mainstream reporters. It does no good to tell them to verify facts with trustworthy sources when what counts as a trustworthy source is itself up for grabs.
What I would like to do, therefore, is to offer an alternative account of fake news and some steps towards a real solution to the problem it poses.
The received view of fake news is correct to portray it as fundamentally opposed to fact-based journalism, but is wrong about why. Traditional journalism is a journalism that is keyed to the truth; it has as its one supreme goal representing reality accurately to the general public. Fake news is news that is not so keyed; it has some other goal which can, and often does, interfere with the accurate presentation of facts. On this account, there are elements other than the intentions of journalists at play. Fake news can exist at The Guardian just as well as the Denver Guardian. Whenever there is a systematic force that causes certain facts to be misrepresented (or over-or-under-represented), we are dealing with fake news. Now we begin to see that fake news is all around us. The mainstream media’s obsession with Clinton’s email server was not, on the previous view, “fake news” because (a) it reported on actual facts, and (b) the intention of the reporters was not to mislead. I offer the following rebuttal: that this reporting led many to believe that Clinton was hopelessly corrupt was no accident. Instead, we have a clear cut case of what happens when systemic concerns other than accurately representing the truth to the public take priority. The Clinton story was fake news on my account precisely because these systemic forces led the mainstream media to mislead the public with a constant barrage of (largely accurate) stories about what was ultimately a minor issue with Clinton’s qualifications. Media today is driven by controversy and outrage (and the financial interests of corporations), not truthful reporting.
When we use the term “fake news” in my suggested sense, we refer to anything that pretends to be news, where news is understood normatively as a truth-informing enterprise. The key problem with the received view of fake news is that it focuses on only a single way in which journalism can be warped away from the truth (ill intent), and misses a variety of other systemic interests which pervert even traditional journalism. Worse still, its single-minded focus on intent provides room for critics of journalism like Trump to claim that mainstream news is “fake”. We must therefore avoid scaremongering made-up news (a relatively small phenomenon), and instead focus on the many other ways in which news can be fake.
This account provides the beginnings of another conversation about fake news. What are these systemic forces? How can we fight them? What the original account of fake news surely got right was that sometimes propaganda is at work and the author deliberately tries to mislead us. My account suggests that there are other forces just as crucial: the profit motive, the constant need for advertizing revenue and “clicks”; these can all bend reporting away from the truth. I think that to fight one of these we must fight them all.
One benefit of this approach is that it provides us with some common ground with the Trump supporter who is skeptical of the mainstream media. If I’m right, we should be skeptical. The solution can only be openness on both sides to reforming our institutions.
We must also be aware that people who “believe” fake news are not always deceived. They share articles they know (or strongly suspect) to be false not because they are deluded but because these articles are the only ones that support their value system. Their alternatives — believing absurd claims or facing up to a cruel reality — are both terrifying. Our approach to their condition must begin with empathy, and remembering that we too are susceptible to this problem. If I’m right, we’re all trapped by the discourse horizon. What we need to find, together, is an alternative.
This post was co-published on The Vim