What’s all the mystery and how do I select an antenna for the application?

It’s not as much the mystery of antenna design and performance, as it is the experience of what does and doesn’t work. The simple fact is the application and mounting location has more affect on the ultimate gain and radiated pattern than will the antenna type.