Was looking for that solution for a long time. I use PullTab with Witch . I have Witch open with cmd+tab.
Now I can close windows from my app switcher without activating the window first.