Setsiders say American Idol is going downhill. Execs are looking to revamp the whole show and only Randy Jackson and Ryan Seacrest will be safe.

“The ratings are getting lower and lower each week,” a source tells BettyConfidential. “The audience misses Paula Abdul and Ellen DeGeneres just didn’t add anything to the show. She’s making jokes, not judging. Now, all the judges (Simon Cowell, Kara DioGuardi, Randy and Ellen) are trying to produce more chemistry between them. Ellen is trying to get in with Kara and Simon off-camera, but it just not happening and on-screen it comes across as fake.”

And, although Simon wasn’t happy about Paula Abdul leaving and Ellen joining the show, he’s trying to keep the show going. “He’s professional. He’s going to try and help the show end this season with a bang, so viewers will look forward to next season.” The source adds that a whole new judges table is in the works.

Read Simon Cowell Reveals Why He Quit American Idol

“They need to create another Simon and Paula for the show. They messed up when they let Paula go and now Simon is leaving,” says our source. “The talent isn’t even what it used to be. There’s no one who has made it to the finals that is Kelly Clarkson, Clay Akins or Adam Lambert. Producers have their work cut out for them.”

Meanwhile, Simon is excited about the X Factor coming to the states. He’s already signed Paula and Mariah Carey is next. “One thing Simon is adamant about is that the judges have a music background,” our source adds.

Here’s our top picks to replace Simon—and we’re not adamant that they have a music background. All we care about is making good television!