Bankers' fixed pay may also be put at risk

Mark Carney

Fundamental changes are needed to institutionally alter compensation.

"Fundamental changes are needed to institutionally alter compensation," Carney told an audience at the Monetary Authority of Singapore lecture seri

Read More Forex banks prepare to claw back bonuses

Earlier this month, regulators across multiple jurisdictions fined six banks more than $4 billion for their roles in rigging foreign-exchange rates. The Financial Conduct Authority cited failure to improve practices after probes into the rigging of Libor rates - an investigation which netted around $6 billion in fines on its own.

"Such repeated fines underscore that massive penalties alone are not sufficient to address the issues," Carney said.

He noted that the U.K. has introduced remuneration codes, with at least 40 percent of bonus payments deferred for at least three years, and funds are exposed to clawbacks for up to seven years if evidence of misconduct emerges.

Read More Bank of England chief sounds dovish note on rates

"Prior to the crisis, we had compensation schemes that overvalued the present and heavily discounted the future and that encouraged risk taking and short termism," he said, adding that he has requested G-20 leaders create compensation standards.

Carney, who is in the rare position of having headed more than one central bank, also said he was concerned that new European rules that cap the size of bonuses will also limit the ability to cut or hold back compensation for industry players. In that case, fixed pay may need to be put at risk, he said.

Read More Investors reject bank CEO pay plans

In addition, senior management needs to be held personally responsible for setting cultural norms at their institutions, Carney said.

"The excuse of having delegated responsibility will no longer wash," he said, adding that the link between seniority and accountability appears to be severed in some cases. "In the aftermath of the crisis, the public was rightly angered that many leaders and senior management that were responsible for some of the misdeeds of that crisis were allowing cultures to develop where misconduct took place [and then] walked away," Carney said.

Read More Commentary: Bonded bankers

The U.K. parliament has established a stronger framework for delegating responsibility to individual executives and board members, Carney noted.

-By CNBC.Com's Leslie Shaffer; Follow her on Twitter @LeslieShaffer1

JefferiesAnd the Best Place to Work in the global financial markets 2016 is...

Register for Financial Markets News Alerts