For about 10 years now, Google has relied on an army of human evaluators to provide feedback and critical insights on countless experiments run by the search engine. The core of the job is to rate the relevance of search results based on a user’s search query and, to assign a rating, Google raters must strictly follow the instructions provided in a document known as General Guidelines.