I finally get up to 50,000 bankroll so I could go in the higher tournaments and it took forever. Anyway, any time I go to quick match 7/10 times I get to the free buy in games and the other 3 I get the 4,000 buy ins. I host the 50,000 games and I get 1 person after about 5 minutes, 2-3 if I'm lucky, then another and most of the time by the time the 2nd person comes the 1st person quits seconds later. I got lucky once after about 15 minutes and got 3 other people I believe. Might of been longer and only 3 people, including me at the table. Then one of them leaves or they all do.

Can someone tell me what's going on? Is it usually this hard or what's your average wait time?

There might just not be too many people playing the $50,000 tables.  It could also have to do the time of day/night you play and what timezone you're in.  I typically play any time between midnight and 3 AM (PST) and I usually have to wait a few minutes for a game to finally get started.  The only thing I can think of for you to do is just go make a sandwich or something and wait a bit.  A game with video chat only has 4 players, but that would probably be even less likely to work out for you.

I try to get into a 50000 game once in awhile but usually give up and settle for yet another 4000 game.