You can't assign a control to a directive if the directive has an isolated scope setting. The controller has to have the instance specific scope.
Which makes it a real pain to mix directive attributes which apply to all directives with customised behaviour.