Parti Quebecois leadership candidate Jean-Francois Lisée apologized for tweeting in support of “lone wolf” singer Remigio Pereira, whose performance of O Canada at the Major League Baseball All-Star Game on Tuesday night has already become infamous.

Pereira, a member of a capella group The Tenors, had changed the lyrics to the national anthem from “With glowing hearts, we see thee rise, the Truth North strong and free,” to “We’re all brothers and sisters, all lives matter to the great.”

“All lives matter” has become a controversial retort to the Black Lives Matter movement, which emerged after several much-publicized acts of police violence against members of the black community in the United States.

While the group’s other members released a statement on Tuesday night disowning Pereira’s actions and saying he would not be performing with the group again, Lisée took to Twitter on Wednesday to congratulate the singers for taking a stand in support of victims of violence in a now-deleted tweet.

After some back and forth with other Twitter users, Lisée withdrew his support.