To help students gauge their understanding of basic concepts and encourage good study habits, we administered short online quizzes that use generic questions in the crucial first few weeks of a course. The purpose of the study was to investigate whether the combination of these web quizzes with generic questions with only binary feedback (right or wrong) would be beneficial for students' learning. We implemented these quizzes in three classes in two different subjects at two different universities, one in Sweden and one in the USA. The students' views on the quizzes' effect on their learning was investigated with surveys and interviews. Almost all students appreciated having these quizzes and 38% of them changed their view on how much they knew of the material covered in the course. Furthermore, over 20% of the students reported altering their study habits as a consequence, in particular studying harder or earlier. In conclusion, this study indicated that short quizzes using generic questions with limited correct/incorrect feedback on each question, have positive effects when administered early in courses. The combination of generic questions and short quizzes could be of value for those contemplating automatic formative assessment, particularly if there is some hesitation with respect to the resources needed for constructing and validating the automatic feedback.