Yeah, calling them pathetic is probably a bit much, but I don't think that was his point. I think he's saying that he's tired of catering to that market and he's glad the mobile market came along to fill that niche in so that he can focus on making games for core gamers again. He seems to see casual games as an entry point, and the people who never explore beyond the "Candy Crush Saga" thing are missing out on what gaming's all about.
It's kind of a slight on Casual gamers, but I think the message he's trying to convey is "Nintendo is back! We're gonna start making games for core gamers again!" which is a welcome message for those who think Nintendo's been making tepid games ever since the Wii came out.