The comments SciRate gets at the moment are pretty decent, I think because people mostly just integrate it into their existing review process. https://scirate.com/arxiv/1501.07071 is a good example. If the community were to grow though we'd definitely want heavy moderation.