Thoughts on rationalism and the rationalist community from a skeptical perspective. The author rejects rationality in the sense that he believes it isn't a logically coherent concept, that the larger rationalism community is insufficiently critical of it's beliefs and that ELIEZER YUDKOWSKY IS NOT THE TRUE CALIF.

Privacy Regulation Is Likely Unworkably Hard

Don't Count On The Government Regulating Facebook

Tyler Cowen provides a great analysis of one of the generic calls for regulating big data (and Facebook in particular). Putting this together with his previous post pointing out that it would cost us each ~$80/year to use facebook on a paid basis1. Taken together they make a compelling case that there is no appetite in the US for serious laws protecting data privacy and that whatever laws we do get will probably do more harm than good.

To expand on Cowen’s point a little bit let’s seriously consider for a moment what a world where the law granted individuals broad rights to control how their information was kept and used. That would be a world where it would suddenly be very hard to conduct a little poll on your blog. Scott Alexander came up with some interesting hypothesizes regarding brain functioning and trans-gender individuals by asking his readers to fill out a survey. But doing that survey meant collecting personal and medical information about his readers (their gender identification, age, other mental health diagnoses) and storing it for analysis. He certainly wouldn’t have bothered to do any such think if he was required to document regulatory compliance, include a mechanism for individuals to request their data be removed or navigate complex consent and disclosure rules (now you’ve gotta store emails and passwords making things worse and risk liability if you become unable to delete info). And what about the concerned parent afraid children in her town are getting sick too frequently. Will it now be so difficult for her to post a survey that we won’t discover the presence of environmental carcinogens?

One is tempted to respond that these cases are obviously different. These aren’t people using big data to track individuals but people choosing to share non-personally identifiable data on a survey. But how can we put that into a law and make it so obvious bloggers don’t feel any need to consult attorneys before running survey?

One might try and hang your hat on the fact that the surveys I described don’t record your email address or name2. However, if you don’t want repeated voting to be totally trivial that means recording an IP address. Enough questions and you’ll end up deanonymizing everyone and there is always a risk (Oops, turns out there is only one 45 year old Broglida). On the other hand google if it’s ok as long as you don’t deliberately request real world identifying information the regulation is toothless — google doesn’t really care what your name is they just want your age, politics, click history etc.. .

Well maybe it should only be about passively collected data. That’s damn hard to define already (why is a click on an ajax link in a form different than a click on a link to a story) and risks making normal http server logs illegal. Besides, it’s a huge benefit to consumers that startups are able to see which design or UI visitors prefer. So checking if users find a new theme or video controls preferable (say by serving it to 50% of them and seeing if they spend more time on the site) shouldn’t require corporate counsel be looped in or we make innovation and improvement hugely expensive. Moreover, users with special needs and other niche interests are likely to particularly suffer if there is no low cost hassle free way of trying out alternate page versions and evaluating user response.

Ultimately, we don’t really want the world that we could get by regulating data ownership. It’s not the world in which facebook doesn’t have scary power. It’s the world where companies like facebook have more scary power because they have the resources to hire legal counsel and lobby for regulatory changes to ensure their practices stay technically legal while the startups and potential competitors don’t have those advantages. Not only do we not want the world we would get by passing data ownership regulations I don’t think most people even have a clear idea why that would be a good thing. People just have a vague feeling of discomfort with companies like facebook not a clear conception of a particular harm to avoid and that’s a disastrous situation for regulation.

Having said this, I do fear the power of companies like facebook (and even governmental entities) to blackmail individuals based on the information they are able to uncover with big data. However, I believe the best response to this is more openness and, ideally, an open standards based social network that doesn’t leave everything in the hands of one company. Ultimately, that will mean less privacy and less protection for our data but that’s why specifying the harm you fear really matters. If the problem is, as I fear, the unique leverage being the sole possessor of this kind of data provides facebook and/or governments then the answer is to make sure they aren’t the sole possessor of anything.

Zeynep Tufekci’s Facebook solution – can it work? – Marginal REVOLUTION

Here is her NYT piece, I’ll go through her four main solutions, breaking up, paragraph by paragraph, what is one unified discussion: What would a genuine legislative remedy look like? First, personalized data collection would be allowed only through opt-in mechanisms that were clear, concise and transparent.


  1. Now, while a subscription funded facebook would surely be much much cheaper I think Cowen is completely correct when he points out that any fee based system would hugely reduce the user base and therefore the value of using facebook. Indeed, almost all of the benefit facebook provides over any random blogging platform is simply that everyone is on it. Personally, I favor an open social graph but this is even less protective of personal information. 
  2. Even that is pretty limiting. For instance, it prevents running any survey that wants to be able to do a follow up or simply email people their individual results 

A Norm Against Partisan Smearing?

Reading Reich’s book (Who We Are And How We Got Here) really drives home to me just how tempting it is to collapse into tribal based cheering (e.g. cheering on your genes/genetic history/etc as the best) and how important our norms against racism are in limiting this.

It makes me wonder if we couldn’t develop similarly strong norms about not cheering on your political/social tribe in the same manner. It’s a more delicate situation since we need to preserve the ability to disagree and offer useful criticism. However, it still seems to me that we might be able to cultivate a norm which strongly disapproved of trying to make the other side look bad or implying they are improperly motivated/biased.

I mean, of course, we won’t actually get rid of hypocrisy or self-serving beliefs but if it required the same kind of extreme caution to allege bad faith to the other ideologies that we require to make claims about racial differences it might make a big difference.

Free Speech Slip and Slide

In the past I’ve written at length about my concern that the newly invigorated attitude that we must outlaw, or at least severely socially punish the speakers, racist/sexist/etc.. speech is a mistake. I have doubts about the efficacy of such punishments and believe that pushing racism adjacent views into a hidden underground where they fester and mutate1 creates more hate. However, the primary thrust of my concern was the usual slippery slope argument (importantly serious harms arise as soon as well-intentioned people start to fear that an epistemic mistake could land them in trouble). Unfortunately, evidence for a steep slippery plastic slope with extra soap arrived all too quickly.

Superiority of Western Culture

First we had this really stupid opinion piece that I would have guessed was written by a machine learning algorithm trained on 1980s era conservative values pieces if it had only mentioned crack (still managed a shout out to the pill for destroying our perfect 1950s society). Personally, I thought it was just as stupid this time around as I did in the late 80s and early 90s except these authors should have seen how that went and known better. However, as far as offensiveness goes it rates as a “kids these days…have no … always on their..” but somehow it has become the subject of accusations of racism and the subject of serious controversy (yes, that last article is written by a friend of the original author so take its slant with a grain of salt).

True, there is no credible effort to have the author fired from her position in the law school but it has generated enough outrage for students to get up in time to picket Wax’s class as racist and its not just some hasty people with signs. At least a non-trivial segment of the Penn campus left is willing to call this piece racist, sexist or otherwise suggest it isn’t just dumb and wrong but deserving of open moral scorn.

While one might try and charitably reconstruct some argument based on the text of the oped2 what is going on is what is always going on with accusations of racism/sexism/islamophobia etc.. Rather than parsing the literal content of a piece and asserting those claims amount to racism (or providing evidence that the author was being disingenuous) people decide to call something racist if it feels like the things racists would say. In this case there is no doubt this oped has that feel. Indeed, it hits many of the points that one would expect from a racist dog-whistle: glorification of European/western culture, suggestion that something associated with whites is superior, a nostalgic comparison to the 1950s, reference to some aspect of black culture the author disapproves of (“anti-“acting white” rap culture of inner-city blacks”) and even the obligatory focus on whites that have the traits you are criticizing.

The problem with taking this as grounds for accusations of racism is that it confuses being the sort of person whose strong affinity for traditionalism and reverence for long lived institutions and practices may make needed reform more difficult with actual racism. However, we are generally quite willing to let the earnest man who is such a strong believer in feminism that he frequently gives a piece of his mind to men who he views as pushing an aggressive male-centric approach on women and thereby does more to perpetuate the stereotype of women as unable to handle these situations than anyone he criticizes. This case is only different in that it is harder to imagine genuinely feeling that these old school conservative values are the secret to a better life and wanting to help minorities by sharing. Also in that often people who feel this way about morals and newfangled social innovations also feel this way about minorities but that’s just a stereotype.

Most importantly, it renders the standard for racism uselessly subjective. If it is no longer necessary to have overt animus or believe in some particular stereotype then it is insanely easy to apply the term to virtually anyone you want. Especially given that as the sphere of things that have been labeled racist expands fewer and fewer non-racists say anything in that sphere so just imagine the same dialog in 20 years about pieces supporting free speech. It would be something mostly racists talk about as a cover, anyone like me writing about it would explain that we believed in it for everyone (while detractors would point out that we kept focusing on the free speech of the racists as they don’t see it from the context in which that is the right place to make one’s stand), one could raise analogies to the contract rights arguments offered in the civil rights movement (yes its bad but the constitution…we just can’t do anything). The only thing this lacks is the subjective feel that comes from hearing lots of racists say something that sounds similar but we can’t cede to racists the power to decide what is and isn’t considered.

Also, as a practical matter this kind of use of the accusation of racism isn’t productive. The reason to use the term at all is to invoke our shared disapprobation of certain behaviors to change people’s behavior. Telling someone ‘suggesting that blacks only eat fried Chicken or look like Gorillas’ is racist usually results in an immediate change and the world is a better place but when you say that some vague thing about the gestalt I get from your article is racist doesn’t. If I were the author and was willing to sell out my views so I wouldn’t be racist how would I even know where to start?

Call these ideas out as stupid or even the kind of progress phobic thinking that perpetuates racism that’s great but its just not racism.

University of Tampa’s Impolitic Twitter Firing

Also, we have the University of Tampa firing a visiting professor for the following poorly considered and bumblinging inappropriate tweet

I dont believe in instant karma but this kinda feels like it for Texas. Hopefully this will help them realize the GOP doesnt care about them.

This is obviously just a case of someone not realizing how what he said would be taken in context. When he did he apologized. That should have been the end of it.

While at first glance one might feel that this isn’t really relevant to the broader picture at the moment. However, while it wasn’t exactly an academic paper this tweet is fundamentally nothing but an expression of a political sentiment. Indeed, suppose the author really believed this was some kind of divine vengeance on Texas for voting GOP. Surely that is core political-religious speech if anything is so its hard to see how this is anything but a direct attack on the idea that Professors get to comment on current events and broader social issues without fear of being fired for controversial views (assuming they don’t bear on their academic qualifications…mathematicians probably shouldn’t say $\omega$ and $2^\omega$ have the same cardinality).

Mistakes

We need room for people to make mistakes! Even mistakes about what to believe on controversial issues because only when people feel they won’t lose their jobs or be shunned if they get it wrong can they allow themselves to explore the issue and reach the right conclusions.

I know its really hard in these discussions to imagine any other perspective than your own but rarely is it the case that someone just wakes up out of the blue filled with hate and the desire to see another race suffer. Sure, sometimes the reasons are just visceral (your gang is white they are black) but in most cases there is some chain of thought and emotion that made every step they took seem reasonable so if you suspect the target of your criticism of simply reasonless hate you should probably reevaluate that view.

However, that is what makes the situation so dangerous as well. Given that even racists think they have good and sound justifications for their beliefs an atmosphere which imposes severe penalties for even minor infractions allows only one safe response: parrot back the official dogma.

But, if we are going to fix the remaining barriers and harms inflicted by problematic stereotypes and structural racism/sexism we need to find them in non-obvious places and that takes open speculation. We’ve picked all the low hanging fruit so more looking for white or male ‘perpetrators’ (if it could have been fixed easily that way we would have) we instead need to look at the less examined reservoirs of stereotypes such as members of the group themselves or the well-intentioned helper3. That means we need to walk on the edge and consider possibly offensive or unpleasant possibilities if we are going to figure out what is really going on so we can do something to fix things.


  1. I’ve seen any number of scenarios in which the perception that certain topics can’t even be discussed doesn’t erase those ideas from people’s minds. Rather, it pushes them to form groups (the ones that go silent when a woman or minority comes by and we work so hard to eliminate) in which they feel they can comfortably express views they are sympathetic to but are too controversial for general consumption. Unfortunately, when people gather together for the purpose of feeling safe sharing controversial views creates a strong social pressure not to call anyone else’s views in that group out for sexism/racism/etc.. even in a polite friendly way. I’m constantly amazed at how quickly both such groups form and how quickly they descend to the lowest common denominator and serve as a breeding ground where hateful ideas can infect good people because there is no opportunity to apply the corrective of a good counterargument and criticism. 
  2. Taking their complaints at face value would seem to suggest the problem is that suggesting WASP culture (not so named) is superior is racist or at least unacceptable and bad. While those of us immersed in liberal sensibilities naturally flinch a bit when the suggestion is made that one culture is superior to another that doesn’t make the claim wrong or racist. Indeed, we all believe that, at least in the modern context, modern western culture is superior to the violent revenge culture in some New Guinean tribes all things considered (of course cultures have so many traits surely we could cherry pick a few improvements but the original piece doesn’t deny this). Hell, the very idea of tolerance and equality that those on the left are fighting for is a rare value for a culture to have and we are right to identify it as something good and important. But I think this “can’t say one culture is better than another” line isn’t a very charitable interpretation. 
  3. Everyone knows that a great deal of slut-shaming and outfit policing is done to women by women and we’ve learned recently that it is other women who do the majority of interrupting women and may very well be the ones preventing more competitive female involvement. This matches both my experience at caltech (women who had few if any female friends their whole lives were way more likely to just blunder in and shot their load on the conversation or dismiss someone else’s contribution as stupid) and what evolutionary psychology would suggest (men have little interest in policing women but each gender needs to police rivals). Of course, men aren’t on the hook they are just on the hook for something else perpetuating harmful male stereotypes which can harm women as much as they do men (say by men not being willing to become primary caregivers). 

More Crappy Treatment Of College Athletes

Why do we put up with this kind of shit (preventing college athletes from even monetizing their own youtube videos)? I mean no one really believes that this is deeply important to preserve some weird value of “amatuerness” in sports do they? Even if you thought that why not let the athletes themselves vote on whether being amatuer is worth the loss of revenue?

If you think they are too young and immature go ask former college athletes to make the call. Of course they won’t because this is all about making money off them.

Sigh, it just pisses me off that we can fight so much about issues of political controversy on campuses but in places where its clear as day that colleges are doing the wrong thing and both the right and left should support fixing somehow gets a pass. Yes this is just a contentless rant but sometimes it happens.

Does Anyone Really Object To Normalizing Racism/Sexism?

Or Reasons Not To Call Trump Racist

When it is revealed that a public figure said something with racist/sexist overtones criticism piles on fast. Even if it is clear that the figure doesn’t really have these racist/sexist attitudes the common refrain is that its still extremely harmful because it normalizes racism/sexism/etc.. Presumably the theory being that if other people believe that high status people commonly behave this way they will think its ok for them to as well.

Is this just a lie (or self-deception) for partisan purposes? I mean consider the implications if you really believed the following back when Bush was President (No one will plausibly believe Trump isn’t saying sexist things whatever you do):

  1. G. W. Bush isn’t really a racist/sexist (replace with Clinton if you prefer) but he sometimes uses racist/sexist language without thinking in the privacy of the white house.
  2. If people realized the president was saying these racist things they too would think that racism was ok and it would have bad consequences.

First, you should be much more angry at whatever staffer leaked the fact that the president used racist language than at the president himself. The staffer who leaked it had time to contemplate it and still choose to make the country think the president uses racist slurs while the president has a slip of the tongue from time to time. Indeed, you should be most angry if the staffer is a minority themselves who claims to be leaking the information because of his concern for racial justice. Even if you give the leaker some kind of pass for ignorance1 at the very least you should be trying your damnedest to (quietly) discourage any future such leaks.

Second, you should be archenemies with the liberal activists and members of the social justice community who spin stories about how racist/sexist the president is even, perhaps especially when it is true (excepting perhaps the very rare case where you believe it will do enough to affect the balance of power to outweigh the harms to race relations). Even with Trump it should be inexcusable to make allegations about dog whistle racism without absolutely rock solid evidence such as staffer testimony of intent and recognition in the community.

Third, you should be worried about maximally racist/sexist interpretations of a public figure’s comments. Even if it is plausible they meant them in the worst possible way you should favor the least racist/sexist interpretation that is plausible just so you don’t further normalize racism/sexism.

Yet, while I see people make the ‘this normalizes X’ argument all the damn time I’ve yet to see them get angry upset or even remonstrate people who are working to push marginally plausible theories of racist/sexist intent or dubitable claims of racist/sexist language. I’ve certainly never seen anyone making such an argument even suggest that it was bad/wrong for someone to leak that information. To the contrary they usually suggest it was in the national interest.

So how should one understand such claims? They can’t really believe the harm from normalization is that big a deal or they wouldn’t be on board with accusations that offer only minor political benefit at the cost of normalizing such behavior. My best guess is what they really mean is: how dare you break this social norm which I feel is very important. Even though your action only had a really tiny harmful effect the norm is really important because without it people would come to believe it was normal and acceptable to engage in racism/sexism.

That’s a fair statement but notice the implication: since any particular incident only does minor harm to this norm and barely nudges people’s sense of what is normal only a minor penalty is appropriate. After all, the benefit to the speaker is presumably virtually nothing from the slur and its sufficient if everyone takes relatively weak action to ensure they don’t utter any slurs so a small deterrent should suffice. In other words we still can’t interpret the speaker as making a cogent complaint as their intent in raising the specter of normalization was to show why this kind of behavior was so serious we couldn’t just let it go with a slap on the wrist but the speaker’s own disposition to prioritize a modicum of political advantage over avoiding further instances of normalization shows that he can’t coherently believe that the possibility of normalization shows the seriousness of the offense.


  1. Shouldn’t the speaker get the very same pass if he hasn’t worked harder to control his occasional slips of the tongue because he isn’t aware that it has any negative effect on others? Often racist phrases are picked up simply from hearing them said so the speaker isn’t in any way morally more responsible than the leaker…indeed arguably a better position as the leaker has to sit down and think over if he should leak while the speaker may have never even done that regarding his slips of the tongue. 

Rejecting Rationality

I felt I would use this first post to explain this blog’s title. It is not, despite appearances to the contrary, meant to suggest any animosity toward the rationality community nor sympathy with the idea that when evaluating claims we should ever favor emotions and intuition over argumentation and evidence. Rather, it is intended as a critique of the ambiguous overuse of the term `rationality’ by the rationality community in general (and Yudkowsky specifically).

I want to suggest that there are two different concepts we use the word rationality to describe and that the rationality community overuses the term in a way that invites confusion. Both conceptions of rationality are judgements of epistemic virtue but the nature of that virtue differs.

Rationality As Ideal Evaluation Of Evidence

The first conception of rationality reflects the classic idea that rationality is a matter of a priori theoretical insight. This makes intuitive sense as rationality, in telling us how we should respond to evidence, shouldn’t depend on the particular way the evidence turns out. On this conception rationality constrains how one reaches judgements from arbitrary data and something is rational just if we expect it to maximize true beliefs in the face of a completely unknown/unspecified fact pattern1. In other words this is the kind of rationality you want if you are suddenly flung into another universe where the natural laws, number of dimensions or even the correspondence between mental and physical states might differ radically from our own.

On this conception having logically coherent beliefs and obeying the axioms of probability can be said to be rationally required (as doing so never forces you to belief less truths) but it’s hard to make a case for much else. Carnap (among others) suggested at one point that there might be something like a rationally (in this sense) preferable way of assigning priors but the long history of failed attempts and conceptual arguments suggests this isn’t possible.

Note that on this conception of rationality it is perfectly appropriate to criticize a belief forming method for how it might perform if faced with some other set of circumstances. For instance, we could appropriately criticize the rule: never believe in ghosts/psychics on the grounds that it would have lead us to the wrong conclusions in a world where these things were real.

Rationality As Heuristic

The second conception of rationality is simpler. Rationality is what will lead human beings like us to true beliefs in this world. Thus, this notion of rationality can take into account things that happen to be true. For instance, consider the rule that when asked a question on a math test (written by humans in the usual circumstances) that calls for a numerical answer you should judge that 0 is the most probable answer. This rule is almost certainly truth-conducive but only because it happens to be true that human psychology tends to favor asking questions whose answer is 0.

Now a heuristic like this might, at first, seem pretty distant from the kind of things we usually mean by rationality but think about some of the rules that are frequently said to be rationally required/favored. For instance, one should steelman2 your opponents arguments, try to consider the issue in the most dispassionate way you can manage and you should break up complex/important events.

For instance, suppose that humans were psychologically disposed to be overly deferential so it was far more common to underestimate the strength of your argument than it was to underestimate your opponent’s argument. In this case steelmanning would make us even more likely to reach the wrong conclusions not less. Similarly, our emotions could have reflected useful information available to our subconscious minds but not our concuss minds in such a way that they provided a good guide to truth. In such a world trying to reach probability judgements via dispassionate consideration wouldn’t be truth conducive.

Thus, on this conception of rationality whether or not a belief forming method is rational depends only on how well it does in the actual world.

The Problematic Ambiguity

Unfortunately, when people in the rationality community talk about rationality they tend to blur these two concepts together. That is they advocate belief forming mechanisms that could only be said to be rational in the heuristic sense but assume that they can determine matters of rationality purely by contemplation without empirical evidence.

For instance, consider these remarks by Yudkowsky or this lesswrong post. Whether or not they come out and assert it they convey the impression that there is some higher discipline or lifestyle of rationality which goes far beyond simply not engaging in logical contradiction or violating probability axioms. Yet they seem to assume that we can determine what is/isn’t rational by pure conceptual analysis rather than empirical validation.

This issue is even more clear when we criticize others for the ways they form beliefs. For instance, we are inclined to say that people who adopt the rule ‘believe what my community tells me is true’ or ‘believe god exists/doesn’t exist regardless of evidence’ are being irrational since such rules would yield incorrect results if they had been born in a community with crazy beliefs or in a universe with/without deities. Yet, as I observed above the very rules we take to be core rational virtues have the very same property.

The upshot of this isn’t that we should give up on finding good heuristics for truth. Not at all. Rather, I’m merely suggesting we take more care, especially in criticizing other people’s belief forming methods, to ensure we are applying coherent standards.

A Third Way

One might hope that there was yet another concept of rationality that someone split the difference of the two I provided here. A notion that allows us to take into account things like our psychological makeup or seemingly basic (if contingent) properties our universe has, e.g., we experience it as predictable rather than being an orderless succession of experiential states, but doesn’t let us build in facts like Yeti’s don’t exist into supposedly rational belief forming mechanisms. Frankly, I’m skeptical that any such coherent notion can be articulated but don’t currently have a compelling argument for that claim.

Finally, I’d like to end by pointing out there is another issue we should be aware of regarding the term rationality (though hardly unique to it). That is rationality is ultimately a property of belief forming rules while in the actual world what we get is instances of belief formation and some vague intentions about how we will form beliefs in the future. Thus there is the constant temptation to simply find some belief forming rule that qualifies as sufficiently rational and use it to justify this instance of our belief. However, it’s not generally valid to infer that you are forming beliefs appropriately just because each belief you form agrees with some sufficiently rational (in the heuristic sense) belief forming mechanism.

For instance, suppose there are a 100 different decent heuristics for forming a certain kind of belief. We know that each one is imperfect and gets different cases wrong but any attempt to come up with a better rule doesn’t yield anything humans (with our limited brains) can usefully apply. It is entirely plausible that almost any particular belief of this kind matches up with 1 of these 100 different heuristics thus allowing you to always cite a justification for your belief even though you underperform every single one of these heuristics.



  1. I’m glossing over the question of whether there is a distinction between an arbitrary possible world and a `random’ possible world. For instance, suppose that some belief forming rule is true in all but finitely many possible worlds (out of some hugely uncountable set of possible worlds). That rule is not authorized in an arbitrary possible world (choose the counterexample world and it leads to falsehood) but intuitively it seems justified and any non-trivial probability measure (i.e. one that doesn’t concentrate on any finite set of worlds) on the space of possible worlds would assign probability 1 to the validity of the belief forming procedure. However, this won’t be an issue in this discussion. 
  2. The opposite of strawmannirg. Rendering your opponents argument in the strongest fashion possible.