First of all i feel people may be confusing MP and Co op. Minecraft for example is not a coop game, it is however a multiplayer game in which you can play co-operatively.
Now this then leads to actual co op games. They are far and few between, and i think most people have pointed out often a by product of the single player experience. You have a few good example that took the extra steps a little like the gears series or dead space, but ultimately fell into the trap of stupid AIs at some point in the single player (Gears 1 i found almost impossible to complete in SP mode due to the AI dying within 5 seconds in the final boss stage).
The problem like so many have pointed out is the publisher wants to make money and thats either SP or MP. It seems us here are the minority who want the coop experience and the majority want the esport that is now CoD MP. I have always preferred coop but for more or less found nothing other the course of playing games for almost 30 years. High speed internet has more or less killed the LAN scene. In the past we needed to have LANs to enjoy certain games, nowadays we can all sit in our own houses with VOIP and happily play with 10 other friends night after night with out the hassle of lugging our PCs about.
As for actual coop games in my own honest opinion i dont see the market for them. An AI isnt a substitute for your friend, and time constraints etc also make coop nigh on impossible (well for most people over 18 i would guess this is true) and this could then take away from the game as a coop or single player experience. I feel really it is just a case of if you can play a mp co-operatively then fine, i love playing Minecraft, DayZ, BF etc with mates, but if they are not there i can still have fun playing by myself. I am talking as a person who loves coop games, i would love to see someone make a truly fantastic coop game, but my head tells me it really isnt possible and would just flop as it would detract from either the sp or mp aspect of the game.