Margerie joined the Total Group, Total S.A., after graduating from ESCP Europe in Paris in 1974. He started working for Total in the Finance Department and Exploration & Production division.
He became president of Total Middle East in 1995 before joining the group's executive committee as president of the Exploration & Production division in May 1999. In January 2002, he became president of the Exploration & Production division of Total.
He was appointed a member of the board of directors on 12 May 2006 and became CEO on 14 February 2007. He became chairman of the company on 21 May 2010, a post he held until his death in 2014. Under de Margerie's leadership, Total expanded its operations in Iraqi Kurdistan, Myanmar, Qatar, and Russia.[4]
De Margerie had strong ties with many countries, particularly Russia. As head of Total, he was very critical of sanctions placed on Russia in response to its involvement in Ukraine, labeling them "useless" and advocating for Western oil companies to continue dealing with Russia. De Margerie, charismatic and dubbed "Big Mustache", was an astute strategist who recognized that the sanctions had placed the Total Group at a distinct advantage to the restrained international competitors. He down played the situation by saying that “it was not the first time there was a crisis between Europe and Russia”. Russia's President Vladimir Putin paid tribute to de Margerie as a “true friend of our country” via telegram to the French President, Mr Hollande; further stating, de Margerie had “pioneered many of the major joint projects and laid the foundation for many years of fruitful co-operation between France and Russia in the energy sector”.[5]
On 23 July 2011, he and 15 other heads of French companies asked the French government to pay more taxes.[6]
In May 2013, Total was fined $398.2 million in a settlement with U.S. authorities over allegations the company paid $60 million in bribes to obtain oil and gas contracts in Iran between 1995 and 2004. French prosecutors desired to charge de Margerie for corrupting foreign public officials and misuse of company funds.[7] Later that year, citing lack of evidence, de Margerie was acquitted by a Paris court in charges relating to an Iraq oil-for-food scandal, in which Total was accused of using bribery and other illicit means to access Iraqi oil between 1996 and 2003.[8]