He was born at Bourges (Cher), and followed his father’s profession of advocate. Having made his mark in opposition during the last days of the empire, he was appointed deputy mayor of Paris after the government was overthrown. He was elected to the Assembly on 8 February 1871, as a member of the extreme Left. While not approving of the Commune, he was the first to propose amnesty for the condemned (on 13 September 1871), but the proposal was voted down. He strongly supported compulsory primary education, and was firmly anti-clerical. He was president of the chamber from 1881 -- replacing Léon Gambetta -- to March 1885, when he became prime minister upon the resignation of Jules Ferry; but he resigned when, after the general elections of that year, he only just obtained a majority for the vote of credit for the Torigking expedition.

He remained conspicuous as a public man, took a prominent part in exposing the Panama scandals, was a powerful candidate for the presidency after the murder of President Carnot in 1894, and was again president of the chamber from December 1894 to 1898. In June of the latter year he formed a cabinet when the country was violently excited over the Dreyfus affair; his firmness and honesty increased popular respect for him, but a chance vote on a matter of special excitement overthrew his ministry in October. As a leader of the radicals, he actively supported the ministries of Waldeck-Rousseau and Combes, especially corcerning the laws on the religious orders and the separation of church and state. In 1899 he was a candidate for the presidency. In May 1906 he was elected president of the chamber of deputies by 500 out of 581 votes.