All articles
Finance

The Death of the Know-It-All: How the Internet Killed America's Professional Secret-Keepers

The Gatekeepers Who Held All the Cards

Walk into a travel agency in 1990, and you'd encounter someone who possessed what felt like magical powers. Behind their desk sat a computer terminal connected to airline reservation systems that you, as a regular person, could never access. They knew every flight, every price, every connection—information that was literally impossible for you to obtain anywhere else.

That travel agent wasn't just booking your vacation. They were your only window into an entire world of options and prices. Without them, you couldn't even begin to comparison shop. You had to trust their expertise, accept their recommendations, and pay their fees because they held the keys to information you needed but couldn't get.

This wasn't unique to travel. Across the American economy, entire professions existed primarily because they controlled access to information that customers desperately needed but couldn't obtain independently.

The Information Monopolies That Shaped Commerce

Insurance brokers made their living by being the only people who could navigate the labyrinth of policy options and pricing across multiple companies. You wanted to compare auto insurance rates? You'd need to call a dozen different companies individually, or rely on a broker who had access to rate sheets you'd never see.

Real estate agents controlled the Multiple Listing Service—a database of available properties that was strictly off-limits to the general public. Want to know what houses were for sale in your neighborhood? You needed an agent. Want to know what comparable homes had sold for? Same answer.

Car salespeople thrived on information asymmetry that seems almost quaint today. They knew the dealer's actual cost, available incentives, and inventory levels across multiple locations. You knew the sticker price and whatever you could glean from a brief test drive. The negotiation wasn't just about money—it was about who had access to better information.

Stockbrokers charged substantial commissions partly because they had direct access to trading floors and market information that individual investors couldn't obtain. Want to buy 100 shares of IBM? You needed someone with a Series 7 license and a connection to the exchange.

The Premium for Not Knowing

This information scarcity came with a hefty price tag. Travel agents typically charged fees plus earned commissions from airlines and hotels. Insurance brokers collected substantial commissions on every policy sold. Real estate agents split 6% of your home's sale price. Stockbrokers charged $50-100 per trade regardless of the transaction size.

But the hidden cost was often higher than the visible fees. Without the ability to comparison shop effectively, consumers had no way to know if they were getting competitive prices. The travel agent might book you on a convenient flight without mentioning a cheaper option. The insurance broker might steer you toward policies that paid higher commissions. The real estate agent might show you houses in their preferred price range rather than exploring all available options.

When the Walls Came Down

The internet didn't just provide new ways to access information—it demolished the barriers that entire industries had built their business models around. Expedia and Travelocity gave consumers direct access to the same airline reservation systems that travel agents had monopolized. Suddenly, anyone could compare flights, prices, and schedules without paying for the privilege.

Insurance comparison websites aggregated quotes from dozens of companies, eliminating the need for brokers in many transactions. Real estate websites like Zillow published home sale prices and property details that had previously been closely guarded professional secrets. Online brokerages like E*Trade and Charles Schwab offered stock trading for a fraction of traditional commission rates.

The transformation was swift and merciless. Entire categories of middlemen found their core value proposition—exclusive access to information—eliminated virtually overnight.

The Survivors and the Casualties

Some industries adapted better than others. Travel agents who specialized in complex international itineraries or luxury experiences found ways to add value beyond mere booking services. Insurance brokers who focused on commercial policies or specialized coverage maintained their relevance. Real estate agents emphasized market knowledge and negotiation skills rather than just access to listings.

But the casualties were enormous. The number of travel agencies in America dropped from over 34,000 in 2000 to fewer than 13,000 today. Traditional stockbrokers saw their industry consolidate dramatically as discount brokers captured market share. Car salespeople still exist, but their role has fundamentally changed now that customers arrive at dealerships armed with invoice prices, incentive information, and competing quotes.

The New Middlemen

Interestingly, the internet didn't eliminate middlemen entirely—it created new ones. Amazon became the ultimate retail middleman, standing between manufacturers and consumers. Google became the middleman between questions and answers. Facebook became the middleman between people and their social connections.

But these new intermediaries operate on fundamentally different principles. Instead of restricting access to information, they compete by organizing and presenting it more effectively. Instead of charging for access to exclusive data, they make money by making information more accessible and useful.

What We Gained and Lost

The democratization of information transformed American commerce in ways that are still reverberating. Consumers gained unprecedented ability to comparison shop, research options, and make informed decisions. The premium for expertise—the extra cost of not knowing—largely disappeared.

But we also lost something valuable. Those old-school middlemen, for all their information hoarding, often provided genuine expertise and personalized service. A good travel agent knew your preferences and could suggest destinations you'd never considered. An experienced insurance broker understood the fine print and could explain coverage options clearly. A knowledgeable real estate agent brought years of local market insight to your home purchase.

Today's self-service economy assumes that access to information is equivalent to expertise. Sometimes that's true. Sometimes it's not.

The Permanent Revolution

The internet's assault on information asymmetry continues to reshape industries. Telemedicine platforms challenge the traditional doctor-patient relationship. Educational technology disrupts classroom-based learning. Financial technology companies offer services that traditional banks once monopolized.

What we witnessed in travel, insurance, and real estate wasn't just technological change—it was the collapse of business models built on controlling access to information. In an economy where information wants to be free, the only sustainable competitive advantage is making that information more useful, not keeping it secret.

The middlemen who thrived by knowing things that customers couldn't discover for themselves have largely disappeared. In their place, we have a new economy built on the assumption that information should be accessible to everyone—and that the real value lies in helping people make sense of it all.


All articles