For the past few days the MW3 servers were acting up and gamers were unable to connect. We found that shutting down your Xbox and rebooting seemed to help.
As of last night, none of my friends reported any connection issues.
Awhile back, I had issues with mw2 doing that. It ended up being a router issue.
Is your NAT type set to strict?