Honestly I wouldn't know and am hesitant to guess, but here's my line of thought.
So, as I can't tell, let's just list all of the Avengers we DON'T have (Original, not sub-divisions (i.e. West Coast))
Swordsman, Mantis, Moondragon, Hellcat, Two-Gun Kid, Starfox, Doctor Druid, Namor.
That's a pretty large list to be looking at and looking at the Cast and Crew on IMDB we can see that nobody is CURRENTLY listed to be playing any of those roles - SO... we're left with a bit of a conundrum. We need more information on the film before anybody can base any decisions on it, so for the time being my guess is as follows:
There will be no Special Operations for the Age of Ultron, but we WILL get SOME kind of Avengers tie-in - and personally i'd love to see "Swordsman" join the fray.