"Eh, I doubt it, in the grand scheme of things, Grimoire Heart never really mattered. Besides Ultear was there when died. She wouldn't have let an Avenger get past her."

Very little could get past Ultear. It was actually more likely she killed him than an avenger, now that he thought about it.