Studies

The Internet has been afire recently with the news that both Facebook and OkCupid have experimented on their users. Both companies have apologized or pseudo-apologized for their actions, while being careful to note that such online experimentation isn’t uncommon.

OkCupid took it one step further in their non-apology, candidly declaring that “if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site” and revealing two more experiments they’ve conducted on users.

The first was born out of OkCupid’s short-lived blind date app. To celebrate the app’s release, OkCupid removed all the photos from the site on launch day. During those seven photo-less hours, OkCupid noticed some interesting things:

• Users responded to first messages 44% more often
• Conversations were deeper
• Contact info was exchanged more quickly

In short, OkCupid functioned better without pictures. When the photos were restored, the conversations that had started blind melted away. “The goodness was gone,” notes the blog post, “in fact worse than gone. It was like we’d turned on the bright lights at the bar at midnight.” The blind date app revealed a similar phenomenon. When users got to the date, they had a good time more or less regardless of how physically attractive their partner was. “Basically,” the post reads, “people are exactly as shallow as their technology allows them to be.”

In a related experiment, OkCupid decided to test its original rating system that allowed users to judge each other on two separate scales: Personality and Looks. “Our thinking was that a person might not be classically gorgeous or handsome but could still be cool,” the blog explains, “and we wanted to recognize that, which just goes to show that when OkCupid started out, the only thing with more bugs than our HTML was our understanding of human nature.”

After gathering the data, OkCupid found that “looks” and “personality” were essentially the same thing to users. They ran a second, direct experiment to confirm their hunch that people just look and pictures and ignore profiles. A small sample of users were shown profiles that did not contain text, resulting in two sets of scores for each profile: one score for the picture and text together, and one for the picture alone.

The results were predictably disheartening: text is less than 10% of what people think of you. The blog says it best: “your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.” Ouch.

Facebook caused a huge outcry back in June when it revealed it had manipulated the news feeds of over half a million users as part of a psychological study to examine how emotions spread on social media.

The response was intense (to say the least), but Facebook is far from the only Internet company to treat its users like lab rats. OkCupid fessed up to conducting studies on its members via a blog entry posted on July 28. And they weren't exactly apologetic about it.

“We noticed recently that people didn’t like it when Facebook 'experimented' with their news feed,” the entry reads. “Even the FTC is getting involved. But guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Admittedly, they have a point. No matter how popular or successful OkCupid is, there are always improvements to be made and the only way to discover those improvements is to conduct experiments. Or, in the site’s own words, “OkCupid doesn’t really know what it’s doing. Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

In this case, the experiment told users they were more compatible than they really were to test the power of suggestion. Typically, among users who were given a 30% compatibility rating by OkCupid, a single message from one to another turned into a conversation just 10% of the time. But, if OkCupid told users with low compatibility that their compatibility score was 90%, the odds of having a conversation jumped to 17%.

The experiment found the same results in the opposite direction. When users with 90% compatibility were told their score was only 30%, the likelihood of a conversation dropped from 20% to 16%. OkCupid isn’t at all surprised that users take the compatibility rating so seriously – “after all,” notes the blog post, “that’s what the site teaches you to do.”

Then OkCupid took a step further. The question became “Does the displayed match percentage cause more than just that first message – does the mere suggestion cause people to actually like each other?”

As far as this data goes, the answer is yes. When OkCupid tells people they’re a good match, they act as if they are, even if they should be wrong for each other - which means that at the end of the day, the myth of compatibility may be just as powerful as the truth.

If you’ve been anywhere near a news source lately, you probably heard about Facebook’s big news feed experiment. The social network manipulated the news feeds of hundreds of thousands of users to see if the emotion they absorbed through reading content on their news feeds impacted the emotion they later displayed in their own posts. People were, unsurprisingly, not too psyched at the revelation that Facebook had toyed with their emotions.

Shortly afterwards OkCupid revealed that it, too, has experimented on users, and the furor started again. In their most recent experiment, OkCupid told users — falsely — that they’re compatible in order to spark more conversations. As a result, OkCupid found that perceived compatibility is just as effective as real compatibility.

Reactions to both experiments have been mixed. Some have said that OkCupid’s testing is less controversial than Facebook’s. Others have called the OkCupid experiment worse than Facebook’s. What everyone seems to agree on is that they’re not quite sure if they should be upset or not. On one hand, lying to customers seems like an obvious faux-pas. But on the other hand, isn’t that just how the Internet works?

As Josh Constine noted in a TechCrunch post, by using services like Google, Twitter, LinkedIn and yes, Facebook, we agree to be part of experiments that change the way we experience the sites. The experiments are called A/B tests, and companies use them to figure how to encourage users to visit a site longer or click more things. This is nothing new.

However, there may be some room for concern. In academia, research involving human subjects is severely limited and carefully monitored by review boards to ensure that it is not deceptive and harm is minimized. Where companies are concerned, there’s no such thing as a review board. It’s up to the companies themselves to abide by the core principles of ethical research.

So how should you feel about Facebook’s and OkCupid’s experiments?

Any way you want. Unlike those two companies, I’m not here to manipulate into doing or feeling anything.

But if asked to take a stand, I’d have to put myself pro-OkCupid and less-than-convinced about Facebook. Facebook deliberately tried to change users’ emotions for the worse by manipulating content in their feeds, all without their consent. It’s hard to get behind that, no matter how much you enjoy psychological studies. For OkCupid, I’m willing to give a pass. At the end of the day, those kinds of experiments are just OkCupid doing its job. Without testing, OkCupid would never improve its ability to match users – and that’s the whole reason we’re there in the first place.

Are you an eHarmony or OkCupid user? Chances are, you wouldn’t join both sites, because they cater to two different types of users. eHarmony attracts daters who are more serious and committed to finding a partner, whereas OkCupid skews a bit younger and takes itself a lot less seriously.

But regardless of which online dating site you choose – wouldn’t you want to understand how to use it most effectively, so you could obtain better results? Would you want to know how other people are using the site, and potentially how they are matched and communicate with you?

Harvard Business School professor Mikolaj “Misiek” Piskorski is the author of the newly released book A Social Strategy: How We Profit From Social Media. In conducting research for his book, he obtained data sets from both OkCupid and eHarmony to determine how different demographics communicate, flirt, and connect over the websites. He set out to see the differences in communication styles between men and women as well as older and younger users.

In the course of writing his book, which is designed for businesses with social media presences, Piskorski studied the online dating habits of millions of users. After personal information was made anonymous so it wouldn’t be compromised, he started his search: specifically, how online daters send messages to each other, how they flirt online, and how they use the sites.

In a recent interview with Fast Company magazine, Piskorski said, “Where eHarmony varies dramatically is communication. People reach out to each other more on eHarmony, and get more responses on there. The people you traditionally would think have the hardest time reaching out to people do very well on eHarmony.”

What does this mean in terms of day to day use of the site? Generally speaking, because each person's pool of matches is smaller on a site like eHarmony where the matches are qualified, they tend to have an easier time reaching out. For timid users, it’s an empowering thing – they will message more on a site like eHarmony than on OkCupid when they know they are competing with thousands of other members.

Another reason for the increased communication on eHarmony is due to the fact that older women and men who are older, more overweight, or shorter than average daters are also more likely to reach out on eHarmony without feeling intimidated. Again, the limited number of matches he feels is a primary reason. Because eHarmony users have fewer choices than okCupid users, they are more likely to reach out, especially women, to people they are matched with.

So does less mean more? Perhaps. OkCupid users tended to gravitate towards specific matching services that offered more bite-sized options, too. For women, it was Quiver, which showed them matches that OkCupid thought would be good based on their likes and communication patterns. For men, it was a service called Quickmatch, where they could look at photos and basic profile information and rate the users according to what they find attractive.

Perhaps a study of dating app communication will be next on Pikorski’s list.

I think a lot of things while sitting at my computer, but until now, none of those things have involved which giant Internet company has the hottest employees. I was perfectly content to search for cat videos on Google and order weird home appliances I’ll never use on Amazon without thinking about the attractiveness of the people on the other side of those companies.

Then Hinge came along, a dating app that matches young professionals in similar networks, and decided that was no way to live. According to Hinge, users are 14.2% more likely to “swipe right” for Amazon employees than their counterparts at tech companies like Google, Microsoft, Apple, and Facebook. Microsoft came in second, with right swipes occurring 8.2% more often than average. Apple ranks as the least attractive tech firm, with a dismal percentage of 0.2, which is a bit surprising given the cool factor attached to all things Apple.

Before you rush to send in your resume to Amazon, consider the facts behind the findings. Amazon reported having 117,300 employees as of January, including part-time workers. In contrast, Microsoft is home to 99,000 employees, Apple to 80,300, Google to 47,756, and Facebook to 6,337. Because Hinge connects daters through their career networks, it’s likely that more Amazon employees are on the app in the first place.

Oh, and there’s also the fact that Hinge found Amazon employees to be the least “picky” of all the tech companies. Meaning, in the app world, that they’re more likely to swipe right on a profile. And meaning, in the real world, that they’re not exactly selective about who they go on dates with (no judgment, of course…do your thang, Amazon employees). Amazon employees’ more open minded approach to dating could also account for their higher numbers.

Facebook employees displayed the most pickiness – defined by how often the users pass on prospective matches by swiping left – of the bunch. Employees at the social network turned down potential matches 7.5% more than the average Hinge user. Apple employees were found to be the second pickiest, though at a rate of only 0.5% more than average.

On the whole, techie types stacked up well against the competition. Men and women at four of the five companies were all rated more attractive than the average Hinge user (the fifth, Apple, got right-swiped at about the average rate).

Good luck ever ordering from Amazon again without thinking about the hottie who may be processing your order on the other side.

Do you have an iPhone or Android phone? Chances are, you didn’t purchase one or the other by chance: you had a definite preference.

Are You Interested, a dating app for singles, decided to test out its own user base and how their dating preferences correlated to the type of phone they used. We know that things like ethnicity, income, and height play a major role in how much success a dater has online. But could your phone have an influence too, considering how much time, money and effort we put into them? In some cases, yes.

AYI found that iOS users were contacted 17% more often than Android users. Turns out, those who prefer Apple products are more desirable dates. I looked into Cupidtino, the dating site dedicated to lovers of all products Apple, to see some profiles of the most desirable users, but found that it is now defunct. I guess more options are better, even for those dedicated to Apple lovers.

Android users seem to be the ones doing the pursuing, while Apple users tend to wait to be contacted. According to the study, Android users were 12% more likely than iOS users to contact someone on AYI.

The dating app company was able to examine 20 million interactions between their users, pulling from a portion of the 2.4 million mobile downloads of the app. Since other online daters can’t see what phone the other person has, AYI looked at what type of dater owned which type of phone. Interestingly, both groups skewed male, but Android users tend to be slightly older, with 42% between 45 and 60 compared to only 29% of iPhone users. Sixty-seven percent of iPhone users were under 45.

In addition, income seems to be a factor. Android users were 30% more likely to make under $60,000 than those with iPhones. Also, 83% of singles making over $150,000 owned an iOS device.

Marital status is another factor, with Android users being 20% more likely than iOS users to be divorced. Another interesting finding from the study: iOS users tend to drink 50% more often and take drugs twice as often as the Android users. On the flip side, they were also 18% more likely to work out every day compared to Android users.

In terms of education, iOS users were twice as likely to have a Master’s degree and 55% more likely to have a Bachelor’s degree. A whopping 72% of Android users had not completed college.

AYI studied profile information from 13,690 of its mobile app users in the United States for the study. For more information on this dating site please read our review of Are You Interested.