Embodiments are directed towards concurrent evaluation of large rule sets with conditions. A rule compiler may receive rule sets that include rules for policy management. During compilation, root nodes may be generated that include the rules and set to the current node in during the building of a decision tree. Next, the most common operand and a condition from the rule set may be determined. Evaluators corresponding to the most common operand and its condition may be generated. Each evaluator may include transition points pointing to other nodes in the decision tree. If two or more rules remain a node, the rule compiler may generate another node to process the two or more rules. If a transition corresponds to a single rule absent any condition, the rule compiler generates a match node. Completed decisions trees are deployed for execution in a policy engine.