A star-studded lineup won't be playing in the Pro Bowl this season.
Browns quarterback Derek Anderson will replace Brady and Cleveland tight end Kellen Winslow will sub for Gates on the AFC's roster. Pittsburgh Steelers defensive tackle Casey Hampton will take Williams' spot.
Brady, who was sacked five times by the Giants and pounded throughout the Super Bowl, has been bothered by a tender ankle. There was no official word why Moss wasn't going to play.
Gates is still bothered by the left big toe he dislocated in San Diego's wild-card playoff win over Tennessee on Jan. 6. He was able to play in a divisional playoff win at Indianapolis and the AFC Championship Game loss at New England.
Williams had been bothered by an ankle injury since December.
They join teammate LaDainian Tomlinson in pulling out of the game in Honolulu. Tomlinson reinjured his sprained left knee in the 21-12 loss to the Patriots.
The withdrawals still leave six Chargers in the game.
In a release, the Browns did not provide a reason for Anderson replacing the Patriots star.
With Anderson and Winslow making the trip, the Browns will have six players in the Pro Bowl, the club's most since sending six in 1994.
Johnson will accompany teammate T.J. Houshmandzadeh, who was picked for his first Pro Bowl. It will mark the first time a pair of Bengals receivers reached the Pro Bowl together.
Johnson is coming off a most unhappy season in Cincinnati, where his self-promotion has worn thin on coaches, teammates and fans. He stopped talking to the local media after a columnist suggested the team might be better off without him.