What Are Index Funds, and Why Do They Keep Beating the Professionals?

In 2007 Warren Buffett made a public wager. He bet a million dollars that a plain index fund tracking the American stock market would beat a basket of hand-picked hedge funds over ten years, after fees. He won, and it was not close. The professionals, with their research teams and their models and their access, were beaten by a product that does nothing more than buy the whole market and sit still.

That story is the fastest way into the question of what are index funds and why so many people who study markets closely end up recommending them to everybody else.

The idea is almost embarrassingly simple

An index is just a list. The S&P 500 is a list of roughly five hundred large American companies. The FTSE 100 is a list of the hundred biggest listed companies in the UK. An index fund buys everything on the list, in proportion to size, and then does essentially nothing else. Nobody is deciding that this quarter looks good for energy stocks. There is no forecast, no conviction, no star manager.

Because there is no research team to pay for and very little trading to do, the running cost is tiny. That is the whole engine of the thing. A traditional actively managed fund might charge one percent a year or more. A broad index fund often charges under a tenth of that. It sounds trivial. Over thirty years, compounded, it is the difference between two very different retirements.

Why the professionals lose

This is the part people find hardest to accept, because it feels like it should not be true. Surely a clever expert beats a dumb list.

The trouble is that the market is made of professionals. When a fund manager buys, another professional is selling, and both of them cannot be right. Collectively, active investors own the market, so collectively they must earn the market return before costs, and less than the market return after costs. That is arithmetic, not opinion. Some managers do beat the index, occasionally spectacularly, but identifying them in advance rather than in hindsight has proved extraordinarily difficult, and the ones who won last decade are not reliably the ones who win the next.

Index funds vs mutual funds, and the ETF confusion

People trip over the vocabulary constantly. The index funds vs mutual funds framing is slightly misleading, because an index fund is usually a type of mutual fund. The real distinction is between passive funds, which track a list, and active funds, which pay someone to pick.

An exchange traded fund is a wrapper rather than a strategy. Most ETFs are passive index trackers, but some are actively managed, and the wrapper mainly changes how you buy and sell it, on an exchange through the day rather than once at the close. For a long term investor the wrapper matters far less than two things: what the fund actually holds, and what it charges.

What actually matters when you compare them

The ongoing charge is the first number to look at. Then the tracking difference, meaning how closely the fund has actually followed its index over time. Then what the index itself contains, because a fund tracking one national market is a much narrower bet than one tracking global shares, and a lot of people who think they are diversified are holding a heavy concentration in a handful of very large technology companies without realising it.

Anyone comparing the best index funds for beginners will find the field crowded with near identical products from large providers, and the honest answer is that the differences between the cheapest broad global trackers are small. Regulators publish plain guidance on how these products work, and the material at Investor.gov is a reasonable place to start reading before anyone tries to sell you something more complicated.

The part that is actually hard

Owning an index fund is easy. Holding one through a crash is not. The market falls twenty percent, the news is uniformly grim, and every instinct tells you to protect what is left. Investors who sell at that point lock in the loss and then, almost always, buy back higher.

Understanding the ordinary rhythm of downturns helps enormously here, and it is worth reading a plain account of what is a recession before you live through your first one as an investor. Downturns are a normal feature of the system rather than a sign it is broken, and the long run returns that make index investing worthwhile are precisely the compensation for enduring them.

What index funds are not

They are not a guarantee. They will fall when the market falls, by design, and a global tracker offers no protection against a bad decade. They do not suit money you need next year. And they are not a substitute for understanding what you own, which is where a surprising number of people come unstuck when their holdings sit with a provider in another jurisdiction, in documents written in another language. Getting the paperwork right, whether through a broker who publishes in your language or a proper business document translation, is unglamorous and occasionally decisive.

None of this is personal advice, and your situation, tax position and time horizon change everything. But the underlying insight has survived fifty years of people trying to argue it away. Buy the whole market, keep the costs low, and then leave it alone. The difficulty was never the strategy. It was the sitting still.