I agree with you, it's very frustrating. Its easy to view these issues in isolation, we have this computer, dongle and cable, why doesn't it work as I want it to?
At some point, before we know or remember, Apple decided it was a good idea to let their Laptops be used with an external Monitor, Mouse and Keyboard. Great idea. So they added additional USB ports and a display port. This was to allow us to plug our laptop into a large display. With the Pro models this was DVI, as time went on things got thinner and Apple arrived at the miniDisplay port. Display port. But then we thought hey why don't we use our HDTVs as displays, cool idea. What, there is no Sound going out the DisplayPort. No there isn't, sound goes out the sound port (Headphone). What to do? lets use a new standard developed with Intel, which does have Sound and Video. Yeah ThunderBolt. Each iteration we move forward, we get new options then we springboard into doing unexpected things, which causes new innovation. This is a Good Thing™ and getting this new port means Apple is listening and changing to meet our needs,
25 years later and we're back to talking about the "missing" numeric keypad. I use an extended keyboard and have since the days of the keyboard we called the skateboard. Why? When I'm working, I use the delete forward and the arrow keys a lot. So with fn-Delete and the little arrow keys I could get by, but I like the extended keyboard, a cable is a small price to pay. The bonus USB ports make it far better. I think Bluetooth adds nothing, sure cables were a constant problem with mice but a single cable from the Keyboard, not a big problem. I find managing the constant steam of recharging batteries a bigger pain. So why the change? There are 2 main reasons
IMO.
Apple with the success of Retail has found that Macs are not as trouble free and easy to support as they used to believed. Oh, they are a huge step better than anything else!!! There people just give up doing anything new. But its not all smooth sailing, ever plugged a USB device that needs power into your keyboard, thats a support call, now Apple is closely monitoring those calls. Once the cost of support outweighs the benefit of a feature they get rid of it. Mouse cables high support BlueTooth low. User swappable HDs high support, gone. Charger cables being yanked, magSafe connectors. The file system is next;-) The short keyboard requires less support, this means less unhappy people.
Apple has plans for the space that extension takes up. If you haven't watched the WWDC keynote take the time too. The mouse is going away. Sure, it may take a while and you will be able to buy one, but the space is going to be taken by the TrackPad. I have both, and for working in Finder, Browsing the Web and email, on a 27" screen the TrackPad is way better than the mouse and I've been using a mouse since it was first released. So Apple wants that desk space. No mouse mat, no keyboard extension just a TrackPad, gives the users more space and less hassle.
As to the handful that this effects, what is the answer? It's a standard USB port or Bluetooth, any keyboard will work, I'm sure many will say that there are far better Mice and Keyboards than Apples, so why worry, If we don't like Apple's shortie buy a 3rd party device. These changes don't worry a million people, but I'm one of the few that is affected, so I'm pissed. Give me an Apple extended USB Keyboard. I know it isn't Apples "fault" I have specific needs/wants but I'm not the mass market, so i just have to find my own work around. On this, I just pass the short keyboard on to the person getting my old Mac and cling to my USB Extended.
i don't think its either Technical or Commercial, I think Apple is trying to give the best product to the widest number of people, within tightly constrained parameters. And as the adage goes "You can't please all of the people all of the time" opps that was "fool"
</end rant>