This week's book giveaway is in the OCMJEA forum. We're giving away four copies of OCM Java EE 6 Enterprise Architect Exam Guide and have Paul Allen & Joseph Bambara on-line! See this thread for details.
Just modify the xsd to define the unique constraint as follows:
Your unique constraint definition did not have proper namespaces. Also, the unique constraint must be placed in the element from where you specify your selector xpath. You had placed it inside Capability, and the selector specified the xpath as Capability. It will never find Capability element inside Capability, so even if the namespace was correct, it would not yield the desired results.