The world's energy system seems to have come unhinged. Oil is trading at record high prices because demand keeps rising even as supplies become unreliable. Oil exporters from Iran to Russia and Venezuela are using their petrocash to pursue agendas that undercut western security and interests. Supplies of natural gas also seem less secure than ever.

The root cause of these troubles is dysfunctional energy politics. The countries with the strongest incentives to cut their vulnerability to volatile energy markets - notably America - are unable to act because influential politicians view all serious policies as politically radioactive. Efforts to boost supply have little leverage because the most attractive geological riches are found mainly in countries where state-owned companies control the resources and outsiders have little clout. Thus, the current energy debates are generating a volcano of proposals that have no positive impact on tight markets.

Yet these structural barriers to serious policy remain hidden because the debate labours under the meaningless umbrella of "energy security". Proper policy on oil and gas must start with the distinct uses for these fuels - each requiring its own political strategy.

The effort on oil must focus on transportation. Vehicles and aircraft work best with liquid fuels that can store large quantities of energy in a compact space and flow easily through pipes to engines. Searching for a better substitute is worthwhile, but the effort faces an uphill battle. With today's technologies, no other energy liquid can reliably beat petroleum. Liquids can be made from coal, as South Africa and China are doing. But that approach is costly and has unattractive environmental implications. Brazil and the US have focused on ethanol, which they distill from sugar or grain from crops. However, those programmes, which account for less than 0.5 per cent of the world's energy liquids, have a negligible impact on the oil market. Yet, America is redoubling its ethanol effort because it is politically unbeatable to reward corn growers and grain handlers who are a formidable force in US politics. Indeed, requirements for ethanol in America have created a more rigid fuel supply system that actually raises the price of oil products, although ethanol's backers originally claimed they would cut energy costs. That same political force also blocks imports of cheaper Brazilian ethanol. In principle, a better approach is so-called "cellulosic ethanol", which promises lower costs as it converts whole plants into ethanol rather than just the grain. But like most messiahs, its attraction lies in the future. So far, nobody has made the system work at the scale of a commercial refinery.

The best way to temper oil demand today is by lifting efficiency. Even this economic winner is politically difficult to implement. The US, which consumes one-quarter of the world's oil, has not changed fuel efficiency standards for new cars in 16 years. Every big economy - even China's - has stricter fuel economy rules than America's. Political gridlock has stymied even modest proposals to allow trading of efficiency credits. A trading scheme is politically inconvenient as it could force US carmakers (which make generally inefficient cars) to buy valuable credits from foreign brands. No politican wants to multiply Detroit's problems.

Even better ideas - such as a stiffer petrol tax - stay stuck on opinion pages of newspapers and in academic journals. Despite what is increasingly termed today's "energy crisis", these ideas barely cross the lips of politicians who want to remain viable among the thicket of anti-tax conservatives and pro-Detroit lobbyists.

The approaches needed for natural gas are quite different. In western Europe, which has long depended on imported gas from Russia, Algeria and a few smaller suppliers, the vulnerabilities are particularly stark. In principle, though, gas dependencies are easier to manage than oil because gas has rivals for each of its major uses. In electric power generation, countries must preserve diversity - ensuring, for example, that advanced coal and nuclear technologies remain viable. While "diversity" is motherhood in energy policy, in reality it requires difficult choices. In continental Europe, for example, policy-­makers have not seriously confronted the conflict between the need for diversity while, at the same time, opening the power sector to morecompetition. Historically, companies in competitive power markets have invested heavily in gas because gas plants are smaller and require less capital than coal or nuclear plants.

Gas suppliers who dream of extending their powers forget that it is harder to corner gas markets when users have a choice. Algeria learnt that lesson in 1981 when it left a key pipeline empty in a pricing dispute with Italy - extracting a better price at the time but losing billions of dollars for the future by destroying its reputation as a reliable supplier.

That lesson should be sobering for Russia today. In December, Gazprom, Russia's giant state gas company, cut deliveries to Ukraine, which then siphoned supplies that flow on to Europe. The company rattled its pipes again last month - threatening retaliation if Europe dared try to wean itself from Russia's gas. While Gazprom's management must pander to Russian nationalism (where pipe-rattling is welcome), the company's long-term viability rests on its reliability as a supplier to lucrative west European markets. Similarly, the recent decision by Evo Morales, Bolivia's president, to nationalise his country's gas fields will give him a boost domestically and might generate some instant extra revenue, but it will also encourage his customers in Brazil and Argentina to look elsewhere for energy.

"Resource nationalism" is back in vogue. But for gas suppliers in particular, it usually ends badly - not least because the infrastructure is costly to build and buyers can afford to be choosy. Gas users can further subdue Russia's rattling by multiplying sources of supply. A robust market for liquefied natural gas will help.

The tendency for gridlock in energy politics means that policymakers must focus where tough decisions matter most, such as efficiency in the use of oil and diversity in the application of gas. Yet, prospects for serious policy are poor - not least because the US, which should be a leader, is the most hamstrung. Luckily, the markets are responding on their own - albeit slowly and patchily. Costly oil is encouraging conservation and new supplies; LNG is accelerating, and gas buyers are more wary of Russian gas than they were a decade ago when Russia was seen as a reliable supplier. If the political structure remains dysfunctional on matters of energy, then the best second is perhaps no policy at all.

The Brazilian government is declaring victory in its decades-long struggle to become self-sufficient in the supply of oil. The milestone is cause for celebration in a country that has long paid a high price for imported energy.

It will also reverberate here in the United States where policy-makers, too, are trying to wean the nation from costly imports, jittery markets and the foreign spigot. But we must learn the right lessons. Brazil's success came not from treating oil as an addiction but by producing even more of the stuff and by becoming even more dependent on world markets

Here in the United States, most attention to Brazil's fuel supply has focused on the country's aggressive program to replace oil with ethanol that is made by fermenting homegrown sugar. American newspapers are filled with stories about Brazil's famous "flex fuel" vehicles that make it easy to switch between ethanol and conventional gasoline.

Guided partly by Brazil's apparent success, American policy-makers are crafting new mandates for ethanol, and flex fuel vehicles are now taking shape. We have the impression that ethanol is king.

In reality, ethanol is a minor player in Brazilian energy supply. It accounts for less than one-tenth of all the country's energy liquids.

The real source of Brazil's self-sufficiency is the country's extraordinary success in producing more oil. After the 1970s oil shocks, when Brazil's fuel import bill soared, the government pushed Petrobras, the state-controlled oil company, to look asunder for new energy sources.

Petrobras delivered, especially at home, where the firm pioneered the technologies that make it possible to extract oil locked in sediments under the seabed in extremely deep water. In the middle 1970s Brazil struggled to produce just 180,000 barrels of oil per day while importing four times that amount. Today it produces about 2 million and is self-sufficient. Indeed, the current milestone of self-sufficiency arrives with the inauguration of Brazil's newest deep water platform, the "P50." When P50 reaches its full output later this year, that one platform will deliver more liquid to Brazil than the country's entire ethanol program.

Brazil's self-sufficiency offers three lessons for U.S. energy policy:

-First is that ethanol, with current technology, will do little to sever our dependence on imported energy. Today's approach involves growing a crop - sugar in Brazil, corn in the United States - and then fermenting the fruits to yield fuel. Sugar plants in Brazil's climate are a lot more efficient at converting sunlight to biomass than is corn in the Midwest, but U.S. policy nonetheless favors corn (and imposes tariffs on imported sugar) because the program is really a scheme to deliver heartland votes rather than a commercially viable fuel.

Yet, even with Brazil's favorable climate and sugar's inviting biology, ethanol is already reaching the limit. That's because the land and other resources devoted to ethanol can be put to other uses such as growing food and cash crops.

Indeed, today the Brazilian government is actually reducing the share of ethanol that must be blended into gasoline because sugar growers prefer to make even more money by selling their product as sugar on the world market rather than fermenting it into alcohol.

New technologies - notably "cellulosic biomass"- could breathe fresh life into ethanol and replace still more oil. Cellulosic biomass is intriguing because it cuts costs by allowing the entire plant - the cellulose in the stalks, as well as the prized grain or sugar - to be fermented into fuel.

Advocates for this technology, including President Bush in his State of the Union address, have wrongly confused the sexy promise of this new-fangled approach to making ethanol with the practical realities of fuel markets. Schemes to produce cellulosic biomass, today, work only under special circumstances and nobody has delivered the fuel at the industrial scale that would be required for the technology to become commercially viable.

-Second, we should learn that, for now, the greatest force to loosen the world's oil markets lies with oil itself. We can use oil more efficiently, as would occur with a gasoline tax or wise fuel economy standards. But we can also find ways to produce more of the stuff - as Brazil did with Petrobras.

The problem for U.S. policy-makers is that the richest veins for new production lie mainly outside the United States and beyond our direct control.

Indeed, the Brazilian government made Petrobras more efficient by putting the firm partly beyond its control as well. When the government sold part of the company on international stock exchanges, it accepted Western accounting procedures and other strictures that have given Petrobras the autonomy and accountability to its shareholders that, in turn, helped make it an efficient company.

We have a stake in seeing other countries do the same - from Algeria to Mexico to Iran and even Russia. But we must remember that Brazil did this on its own, in response to internal pressures for reform, with little leverage from foreign governments.

-Third, we should learn from Brazil not to confuse the goal of greater self-sufficiency with the illusion of independence. Even as Brazil has become self-sufficient it has also, ironically, become more dependent on world markets. That's because the Brazilian government has wisely relaxed price controls so that the prices of fuels within the country are set to the world market. Thus Brazilians see real world prices when they fill up at the pump, and the decisions about which cars to buy and how much to drive reflect real costs and benefits of the fuel they consume. That is why, even as the country becomes self-sufficient, Brazilians are working ever harder to be more frugal with oil - because the price at the pump is high and rising.

Dependence on oil is a liability that must be managed. But it is not an addiction.

Efficiency, sober policies toward modest alternatives such as ethanol, and more production - all tools of the manager, not the addict - are required. Brazil helps show the way, but only if we learn the right lessons.

Analysis of the Indian-U.S. nuclear agreement, as well as substituting natural gas for coal in fueling the Chinese electricity sector, reveals that side agreements between developed and developing countries could result in massive greenhouse gas emission reductions.

Three months ago the Russian energy giant Gazprom forced Ukraine to pay sharply higher prices for natural gas. At the time, the story was portrayed as a political struggle for control in Kiev. But last week Gazprom announced it was tripling gas prices in Belarus, a country that is politically close to the Kremlin. Moldova has been forced to accept a doubling of prices over the next three to four years, and the other former Soviet republics are already paying market prices for Russian gas.

The truth is that these price increases are not political. Rather, they reflect worrisome economic and geological facts about Russian gas fields. The Kremlin is not simply trying to use Gazprom to reassert authority in Belarus, Ukraine or anywhere else. There are in fact deep problems with Gazprom -- problems created by its inefficient management and a looming decline in gas production.

Russia controls over a quarter of the world's gas reserves -- more than any other country. Most of the known Russian reserves (about 80 percent) are in west Siberia and concentrated in a handful of giant and super-giant gas fields. Since the early 1970s the rate of discovery for these new fields has been declining. Moreover, output from the country's mainstay super-giant fields is also steadily falling.

Huge investments are needed to replace this dwindling supply, and all the options for new production will prove costly and difficult. New fields in the far north and east of the country are distant from most of Russia's people and export markets, requiring wholly new transport systems such as pipelines. Moreover, most of these fields are found in extremely harsh environments where it is technically and financially difficult to operate.

Gazprom controls neither the capital nor the technology that will be needed. The state-controlled company is already deeply in debt and burdened by many expensive obligations, such as supplying Russia's population and friends with cheap gas. The company has to work with foreign partners.

So far Gazprom has been able to forestall crisis. Economic stagnation across the former Soviet Union and Eastern Europe since 1990 dampened gas demand. Russia, which had a surplus at the time, sharply increased its gas exports and made contractual commitments that will remain in force for many years.

But following the long stagnation, Russia's internal gas consumption is rising again as the economy expands. And new Russian policies to promote development of the country's eastern regions will, in the next few years, require large new commitments to supply gas to that region (along with spending on railroads, airports and other infrastructure).

Even when the Russian economy was in the doldrums the country was notable as a large gas consumer because of its extremely inefficient energy system. Today Russia is the world's second-largest gas user, after the United States, although its economy is only one-twentieth the size of the U.S. economy.

Electricity in Russia is produced for the most part by gas, but the country's gas-fired electric generators work at 33 percent efficiency on average, compared with 50 to 55 percent in Europe. More than 90 percent of residential and industrial gas consumers don't have meters. Gas is even cheaper than coal -- Russia is the only large country where that is true -- so incentives to switch to an abundant fuel are weak.

In recent years Russia has boosted gas supplies by squeezing Turkmenistan to sell gas to Russia at a deep discount. But Turkmen gas production is poised to decline, and Turkmenistan's gas industry is barely functional because the country's political environment is scary for long-term investors. Other Central Asian suppliers, notably Kazakhstan, are unlikely to be able to bridge the gap.

Caught between growing internal consumption of gas, continued inefficiency and mounting external obligations, Russia's gas industry faces a looming crisis. Given the country's vast resources, it seems that many producers could fill the void. But a series of policy decisions created two roadblocks that Gazprom has been happy to reinforce. One is the lack of access to the Gazprom-controlled pipeline network, which explains why few companies even bother to look for gas: They know they can't get what they find to market. The other barrier to investment is the low internal prices, which make gas production uneconomic except for companies that can sell their products outside.

Gazprom needs cash -- much more cash -- for investment. At the same time, it needs a strong incentive for former Soviet republics to cut their own very inefficient consumption.

Analysts have ignored the risk that Russia's supplies could fall short because they focus on Russia's vast gas resources and the new Western investors who are -- albeit cautiously -- entering into joint ventures with Gazprom. But those resources and ventures are for the long term, and the looming crisis of supply is unfolding now.

The gas shortage is likely to become most acute over the next few years. If there is an unusually cold winter in 2008, the year of Russia's presidential election, then Gazprom will face a politically unpleasant choice: whether to cut off internal customers (voters) or the Western customers who are the firm's main source of hard cash.

The writer is a research fellow at the Program on Energy and Sustainable Development at Stanford University. She is co-author of "Axis of Oil" and of a forthcoming comprehensive review of Russia's gas pipelines.