No, you can not apply just for courses. You always have to apply for a full study programme to study at the University of Iceland.
You can register for courses within the programme, or with a written approval of faculty, you can register for courses in other programmes instead of free elective courses in your programme or as additional ECTS. Further information at your Faculty office.