IMO your first two suggestions aren't actually a form of testing.

If you've rolled out a feature to real paying customers (not beta testers), and find that it's broken, you don't get a pass because you were only "testing".