CLICK OR SKIP EVALUATION OF REORDERING RULES

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for evaluating a query term reordering rule. In one aspect, a method includes accessing query log data that identifies, for an initial search query, two or more query terms that are included in a particular order in the initial search query, search results that were generated using the initial search query, and a particular search result selected by the user. A determination is made, using the query log data, that the particular search result includes the two or more query terms in a different order than the particular order in which the two or more query terms are ordered in the initial search query. In response to this determination, a click count is incremented for a query term reordering rule associated with the two or more query terms.