Do I have to finish my basement walls with drywall?
All build­ing codes in the USA and Cana­da spec­i­fy that plas­tic insu­la­tion (EPS) must be cov­ered by a ther­mal bar­ri­er equiv­a­lent to 15 min­utes of fire pro­tec­tion in hab­it­able spaces. If the base­ment is clas­si­fied as hab­it­able space, then gyp­sum board must be applied but does have to taped and filled. Check with your local build­ing offi­cial.
How do I protect the ICFs below grade?

All ICF walls below grade, that have hab­it­able space on one side (base­ment), must have a water­proof­ing / damp­proof­ing mem­brane installed. For walls that do not have hab­it­able space on one side (crawl space, frost walls, etc.) the EPS can be left exposed to the earth. The EPS will not dete­ri­o­rate when exposed to the earth.