Job Market Paper

"The Value of Competitor Information: Evidence from a Field Experiment."

Understanding the competitive environment is central to strategic decision-making. To what extent are firms aware of their competitors, and how does information on competitor decisions impact firms’ strategic choices? I explore these questions by running a field experiment in collaboration with Yelp across 3,218 businesses in the personal care industry, where treatment firms receive easily accessible information on their competitors’ prices. At baseline, I find that over 46% of firms are not aware of their competitors’ prices. However, once firms receive competitor information, they are 17% more likely to change their prices, and do so by improving their alignment with competitor offerings. The effect is larger for firms that face higher levels of competition, as well as those showing lower sophistication in pricing, suggesting that a lack of competition or capabilities to use information may not fully explain firms’ lack of knowledge. If competitor information is both decision-relevant and easily accessible, why had firms not invested in this information on their own? Evidence from interviews and a follow-up experiment across control firms suggests that managers appear to have underestimated the value of paying attention to competitor information, because they believed they were already aware of it. These findings suggest that inattention may be a key barrier that leads firms to fail to realize gains from even readily accessible data.


Product Quality and Entering through Tying: Experimental Evidence” (with Michael Luca). Management Science 65(2), February 2019: 596-603. Extended Abstract in EC’18.

Dominant platform businesses often develop products in adjacent markets to complement their core business. One common approach used to gain traction in these adjacent markets has been to pursue a tying strategy. For example, Microsoft preinstalled Internet Explorer into Windows, and Apple set Apple Maps as the iOS default. Policymakers have raised concerns that dominant platforms may be leveraging their market power to gain traction for lower quality products when they use a tying strategy. In this paper, we empirically explore this question by examining Google’s decision to tie its new reviews product to its search engine. We experimentally vary the reviews displayed above Google’s organic search results to show either exclusively Google reviews (Google’s current tying strategy) or reviews from multiple platforms determined to be the best-performing by Google’s own organic search algorithm. We find that users prefer the version that does not exclude competitor reviews. Furthermore, looking at observational data on user traffic to Yelp from search engines, we find that Google’s exclusion of downstream competitors may have been effective. The share of Yelp’s traffic coming from Google has declined over this period, relative to traffic from Bing and Yahoo (which do not exclude other companies’ reviews), and Google reviews has grown more quickly than Yelp and TripAdvisor during the period in which they excluded these (and other) reviews providers. Overall, these results suggest that tying has the potential to facilitate entry in complementary markets even when the tied product is of worse quality than competitors.

Nowcasting Gentrification: Using Yelp Data to Quantify Neighborhood Change” (with Edward L. Glaeser and Michael Luca). American Economic Review Papers and Proceedings 108 (May 2018): 77–82.

Data from digital platforms have the potential to improve our understanding of gentrification, both by predicting gentrification and by characterizing the local economy of gentrifying neighborhoods. To explore, we identify gentrifying neighborhoods using government data, and then use Yelp data to analyze local business activity. We find that gentrifying neighborhoods tend to have growing numbers of local groceries, cafes, restaurants, and bars, with little evidence of crowd-out of other types of businesses. Moreover, local economic activity, as measured by Yelp data, is a leading indicator for housing price changes and can help to predict which neighborhoods are gentrifying.

Nowcasting the Local Economy: Using Yelp Data to Measure Economic Activity” (with Edward L. Glaeser and Michael Luca). Accepted in NBER/CRIW Volume for Big Data for 21st Century Statistics (forthcoming).

Can new data sources from online platforms help to measure local economic activity? Government datasets from agencies such as the U.S. Census Bureau provide the standard measures of local economic activity at the local level. However, these statistics typically appear only after multi-year lags, and the public-facing versions are aggregated to the county or ZIP code level. In contrast, crowdsourced data from online platforms such as Yelp are often contemporaneous and geographically finer than official government statistics. In this paper, we present evidence that Yelp data can complement government surveys by measuring economic activity in close to real time, at a granular level, and at almost any geographic scale. Changes in the number of businesses and restaurants reviewed on Yelp can predict changes in the number of overall establishments and restaurants in County Business Patterns. An algorithm using contemporaneous and lagged Yelp data can explain 29.2 percent of the residual variance after accounting for lagged CBP data, in a testing sample not used to generate the algorithm. The algorithm is more accurate for denser, wealthier, and more educated ZIP codes.

Working papers

“How Does Compliance Affect the Returns to Algorithms? Evidence from Boston’s Restaurant Inspectors” (with Edward L. Glaeser, Andrew Hillis, Scott Duke Kominers, and Michael Luca). Working Paper, September 2019.

Algorithms have the potential to improve our ability to target services – but the returns are limited if employees make choices largely based on other considerations. Partnering with Boston’s Inspectional Services Department, we compare the performance of three different methods of targeting restaurant hygiene inspections: (1) human judgment based on inspector discretion (the status quo); (2) a “data-poor” algorithm based on the average number of violations across historical inspections; and (3) a “data-rich” algorithm based on a random forest model trained on historical inspections and Yelp data. The “data-rich” algorithm slightly outperforms the “data-poor” algorithm, and both dramatically improve upon inspector discretion -- suggesting that the greatest gains come from using data to supplement inspectors’ priors, rather than from sophisticated algorithm design. Yet, inspectors are only half as likely to comply with inspection directives based on either algorithm, relative to individual judgment. These findings suggest that the implementation gains from big data and machine learning are limited by employee compliance.

“Aligning Employee Effort to Strategic Change: The Role of Gift Exchange” (with Michael Norton). Working Paper, September 2019.

A large literature across strategy and organizational theory suggests that aligning employee behaviors to execute strategic change is difficult. We explore whether gifting can help organizations align employee behavior to strategic change. We propose that gifts may be useful in eliciting behavior reorientation in settings like strategic change where formal incentives may be insufficient, as they are based on reciprocity rather than contingent on measurable outcomes. We examine this empirically by running a field experiment in a company that embarked on a new strategic direction requiring employees to shift from maximizing individual performance to collaborating together. To explore whether and how gifts can help firms align employee efforts to new goals, we introduce in-kind gifts from managers in two ways: one using a relational frame (“Thanks for your hard work collaborating!”) and the other using an additive incentive frame (“Thanks for your hard work collaborating! As a reminder, under the new HR reform, higher team performance will increase your bonus.”). Compared to employees who receive no gift, both gift treatments increase employees' reported willingness to help co-employees by some 30 minutes per day. We also find that the incentive frame significantly reduces the willingness to help of high-performing employees, providing suggestive evidence that gift exchange may work through developing relational ties that motivate desired employee behaviors.

“The Informative Role of Online Advertising: Evidence from a Field Experiment” (with Daisy Dai and Michael Luca). Working Paper, August 2018.

To shed light on the effectiveness and mechanism of online advertising, we design and analyze a large-scale field experiment on Yelp, an online reviews platform. The experiment consists of roughly 18,000 restaurants and 500 million advertising exposures. Yelp’s search advertising packages are randomly assigned to more than 7,000 restaurants for a three-month period. We find that advertising increases purchase intentions, such as page views, map direction views, calls, and reviews. A back-of-the-envelope calculation suggests that advertising would on average produce a positive return for restaurants in the sample. We find larger advertising effects for newer, independent and higher rated restaurants, consistent with the informative view of advertising and suggesting that the information that platforms choose to include in ads may lead to differential returns from advertising.

Measuring Gentrification: Using Yelp Data to Quantify Neighborhood Change” (with Edward L. Glaeser and Michael Luca). NBER Working Paper Series, No. 24952, August 2018.

We demonstrate that data from digital platforms such as Yelp have the potential to improve our understanding of gentrification, both by providing data in close to real time (i.e. nowcasting and forecasting) and by providing additional context about how the local economy is changing. Combining Yelp and Census data, we find that gentrification, as measured by changes in the educational, age, and racial composition within a ZIP code, is strongly associated with increases in the numbers of grocery stores, cafes, restaurants, and bars, with little evidence of crowd-out of other categories of businesses. We also find that changes in the local business landscape is a leading indicator of housing price changes, and that the entry of Starbucks (and coffee shops more generally) into a neighborhood predicts gentrification. Each additional Starbucks that enters a zip code is associated with a 0.5% increase in housing prices.