Moving to Medium
I’m going to try posting on Medium instead of WordPress. Here’s the latest: https://link.medium.com/eJDjJSdU96
Should I accept that review request?
A constant question that comes up for academics is: Should I accept that review request? When I look back on how I managed my time as a junior faculty member, this was one area where I wasted time by saying yes way too often. Pre-tenure, I nervously said yes to all requests. I was afraid to say no and didn’t understand when it was prudent to say no. Over time, I’ve developed some rules of thumb for when to say yes that I’d like to share.
First (and this is obvious but it needs to be said), I only accept review requests where the content is in my area of expertise. Sometimes part of the content is in my area and part is not, and I will note that in my review. (“I’m not an expert on machine learning, and will comment mainly on the HCI parts of this paper.”)
Second, if I have submitted to a venue (conference, journal), then I owe them reviews back. I have generated a need for reviews, and I need to give back.
If I’m overwhelmingly busy, I sometimes say no even if I feel I owe them. But I’ll explain the details, and encourage the editor to ask me again another time. No one wants to hear about your full to-do list, but it is helpful to say something short like “I have a major grant deadline coming up,” and people will understand. It’s also polite to suggest other possible reviewers.
If a venue is low quality and is somewhere I would never consider submitting, I say no. Pre-tenure when I nervously accepted every request, I spent way too much time reviewing material that I should not have wasted my time on. If the venue has different social norms and standards than what you are accustomed to, then you also may be too harsh a critic of the work, because you don’t know their standards.
If a venue is not one I’ve ever submitted to or is from another discipline but is high quality, then I ask myself some simple questions: Does this look interesting? Am I the best person to review it? Often when someone from a different field sends me a review request, it’s because they really did their homework—they realize that the work is interdisciplinary and put in some effort to identify an interdisciplinary reviewer. All of us who do interdisciplinary work have received reviews where this was not done and reviewers missed the point. I respect the editor who went to the extra effort to find someone with that missing expertise, and I try to say yes if I can to those requests.
Finally, the older you get, the more likely it is that you know the person asking you to review. And in that case, you need to consider the pros and cons of the request in the context of your relationship to that person. However, don’t let a friend who is an editor abuse your friendship. It’s OK to politely decline if they ask you too many times too close together.
Do you have different rules for what to agree to review? Leave me a comment!
The Solution to Free Speech is a Functional Marketplace of Varied Venues
I believe in free speech. I believe in a free society where I have the right to say something that deeply offends you, and you may say something that deeply offends me. Censorship of the internet in countries like China is disturbing, and other countries (including the United States and the European Union) are slipping towards censorship one tiny step at a time.
At the same time, I believe in the right to be free from harassment. I believe in the right to be free from crazy, false nonsense showing up on my computer screen (if I don’t want it to). I also believe there is such a thing as “false” and “true,” as I explain in a chapter from my forthcoming book Should You Believe Wikipedia? Truth is socially constructed, and we can sometimes make wrong decisions about what we believe to be “true.” But truth exists, and all we can do is keep working hard to find it.
So how do we balance these competing desires? The answer is zoning. There need to be places on the internet with different rules for what it’s OK to say, and what standards there are for verification of claims and politeness. Some of those places should be totally open, modulo respecting the most basic laws like the right to honest dealing in business and freedom from liable. Other places should have standards.
For example, the subreddit r/science has over 21 million subscribers. Posts on r/science must link to a peer-reviewed scientific article published in the last six months in a journal with an impact factor of at least 1.5. Comments must be about the science, and anecdotes and jokes are not allowed. The volunteer mods delete tons of great, interesting content. But that’s OK, because you can post that content on other subreddits like r/everythingscience or r/sciences, where the rules are laxer. Reddit is one site on the internet that gets this right. Different subs have different standards, and you can choose one that suits you or go ahead and create your own (as I suggest in my 1996 paper Finding One’s Own Space in Cyberspace).
When there are multiple spaces with different social norms, we can have a marketplace of ideas. Parents who are upset about inappropriate content on YouTube should send their kids to watch videos on a site with higher standards. YouTube will never improve its practices if we all don’t vote with our feet. A marketplace doesn’t work unless people have alternatives and make smart choices.
Unfortunately, some sites have become so big that it’s hard to find meaningful alternatives. A dozen of my friends have proclaimed recently that they are quitting Facebook because they object to Facebook’s practices. That’s great—that’s what you should do if you don’t like the site’s policies. But what’s the alternative? In our research on grassroots groups, Sucheta Ghoshal and I have found that groups who do not agree with Facebook’s policies and find its privacy features insufficient often still use it to publicize their cause because that’s where the people are. They’re stuck.
One of the imperatives in the revised ACM Code of Conduct (the first update in 25 years) says:
3.7 Recognize and take special care of systems that become integrated into the infrastructure of society.
Even the simplest computer systems have the potential to impact all aspects of society when integrated with everyday activities such as commerce, travel, government, healthcare, and education. When organizations and groups develop systems that become an important part of the infrastructure of society, their leaders have an added responsibility to be good stewards of these systems. Part of that stewardship requires establishing policies for fair system access, including for those who may have been excluded. That stewardship also requires that computing professionals monitor the level of integration of their systems into the infrastructure of society. As the level of adoption changes, the ethical responsibilities of the organization or group are likely to change as well. Continual monitoring of how society is using a system will allow the organization or group to remain consistent with their ethical obligations outlined in the Code. When appropriate standards of care do not exist, computing professionals have a duty to ensure they are developed.
The impossibly hard problem that follows is: What should we do in response to very large platforms that are integrated into the structure of society and fail to be good stewards? Democratic presidential candidate Elizabeth Warren wants to break up big tech, and she may have a point. The implications are headache-inducing.
In the mean time, one thing we all must do is to vote with our feet. To tell platforms who don’t meet our personal standards (Too restrictive of speech? Too unrestrictive? Or just a lousy user interface?) that we won’t use them until they clean up their act. And to support alternative platforms that emerge as they struggle to get started. The marketplace of ideas can’t work unless there’s an actual, working, competitive marketplace.
Combating Human Trafficking with Big Data: Today’s Plot Twist
When the government shuts down websites that serve the sex industry, the activity doesn’t stop—it just moves. All things considered, it’s constructive for the government to keep shutting things down. It does slow down illegal activity, at least for a while. But on the other hand, it also slows down law enforcement, who rely on those sites for leads to help rescue victims of human trafficking.
Human trafficking—when the victim is forced to participate or is under age—is different from consensual sex work. Georgia Tech PhD student Julia Deeb-Swihart uses machine learning, network analysis, and techniques from information visualization to create tools to help law enforcement combat trafficking. As the activity moves, our research moves to follow it.
New legislation passed last month gives the government greater authority to prosecute websites that facilitate trafficking, and has the bad guys scared. But give them credit for being clever. Hiding in plain site is the Facebook group “best automotive reviews.” The main purpose of the page is to tell customers of a sex worker review site what the new URL is, each time the site moves. But in the mean time, people have been discussing their automotive needs, like these posts:
It’s certainly a new challenge for machine learning to detect those posts! The technical challenge of the week. But wherever they go, we’ll keep chasing them.
What if we all insisted on reasonable NDAs?
Next week I am attending a mini-conference in which a big tech company (I’ll call it BTC) has invited a group of academics to advise them. Everyone attending was asked to sign a non-disclosure agreement (NDA). The NDA I was sent initially didn’t define what was confidential, and had no time limit. So basically they’re asking everyone to keep secret who-knows-what forever. Does that make sense?
How can you protect confidential information if you don’t even know what is confidential? A fair NDA needs to spell it out. This is called a “marking requirement.” Any tangible materials containing proprietary information shared with you should be marked “confidential.” Ideally also, the agreement should say that if confidential information is disclosed orally, they will follow-up with a copy in tangible form marked confidential within a few weeks after the disclosure. That last part can be harder to get companies to agree to, because it’s a hassle.
Second, a fair NDA should have an end date. It’s not reasonable to ask you to assume a lifelong obligation, is it? They’re not going to tell me the formula for Coca-Cola—it’s stuff that changes rapidly. At the speed that things change in high tech, a three-year limit is fair. Five years at most.
I told my hosts at BTC that I’d please like some changes to the NDA, and they graciously complied. The back-and-forth process between their lawyers and my university’s lawyers took so long, I almost ended up not going to the event. They were reasonable, and the result is fair. But here’s my question: why doesn’t everyone always ask for more reasonable NDAs? If we all did, then they wouldn’t be sending out the unfair versions in the first place.
Companies keep asking people to sign ridiculous non-disclosure agreements, because folks sign them without objecting. If we all insist on reasonable NDAs, this will no longer be a problem.