After a recent topic and several staff discussions, we have decided to add rule #12 to the Site and Forum Rules to clarify our expectations for ratings and reviews. Most of this isn't new, but we wanted to make it clear that yes, we expect you to play quests and try other submissions yourself before rating them.
This by no means requires you to play a whole quest, of course. If you lose interest or rage quit, by all means share your experience in a review. But if you haven't played any of the quest yourself, your impressions from quest projects or let's plays would make more sense in the comments.
If you see any ratings or reviews breaking these rules, please use the report function to let us know.
12. Be considerate with reviews and ratings.
Reviews should reflect your own opinion after trying a database submission for yourself. In the case of quests, it's recommended that you at least play in a few dungeons (depending on the format of the quest), but more complete playthroughs are ideal. Do not rate quests based solely on viewing a Let's Play or on the description, screenshots, or quest project alone. Music submissions need to be listened to. Scripts should be at least tried in an example quest. Tilesets and loose tiles should be tried for yourself, unless a significant portion of the tiles are displayed in the screenshots. Any reviews that rate the submission without trying it first will be removed.
Database entries should be rated with your own personal opinion, not to "correct" other peoples' ratings. Do not rate things higher or lower than you normally would with the intent of undermining other members' reviews or adjusting the overall score. Reviews that do this will be removed.
Constructive criticism is of course encouraged in reviews, but please try to be respectful of the person who submitted it. Remember that in the end, we're a community mostly of amateurs doing this for fun. Just like with other areas of the forum, harassment will not be tolerated in the reviews and comments on a submission.