Congress's problems increased after party change