We study decentralized implementation of efficient outcomes through multilateral bargaining in the river sharing problem. We introduce a class of mechanisms in the form of two-stage games in which agents first announce consumption levels and then bargain over monetary compensations. The defining characteristic of a mechanism is the way it assigns bargaining power to agents as a consequence of their locations, inflows, and consumption decisions. We first determine which mechanisms give incentives to always allocate the water efficiently, in the sense that, regardless of the agents' benefit functions, equilibrium play always yields an efficient outcome. Among these, we take an axiomatic approach to single out three mechanisms that guarantee a fair division of the welfare gain obtained through cooperation along the river.