SCRUM in Infrastructure Projects

I have met quite a few project managers who have made the jump from one side to the other, I.e. moved from Infrastructure and the construction world to IT and vice versa , this was possible because all of them were pure Project Managers at heart with the PMI discipline etched in their DNA and this makes me wonder if a SCRUM Master of a practitioner of SCRUM Methodology can ever go to the other side ?

Can we actually use agile principles on the other side ? What will Iterative development mean to them, If I am constructing a house how can I go Iterative ? Do I do it room by room , can I start living in a part of house while I get the other part of the house constructed ? Can I really see value / benefit in this ?  Though the Idea might sound outrageous I believe this can be done , the next little project that I do which is non IT, either learning photography or making pottery artifacts I will consciously try and go the agile way !