Agile software development has been one of the most important paradigms of software engineering community. Agile methods that are shaped around Agile Manifesto and principles, provide promising results when applied properly in software organizations. Agile assessment models and tools have potential to indicate agile adoption problems at project level or organization level. In the scope of this study, we identified 37 agility assessment tools. Among those tools, we evaluated 11 agility assessment tools based upon 9 criteria within a multiple case study. The purpose of this study is to evaluate existing agility assessment tools to provide an overview about potential uses, advantages and drawbacks. The results of the case study indicate that none of the 11 tools are eligible to fully achieve the 9 criteria.