So let’s break down the average cost to build a house into each stage. I Built My Own House From the Ground Up -- and You Can Too ... but that hasn’t stopped him from building a house out of nothing but a hole in the ground in … The cost to build a house is based on changing factors like size, location, labor, materials and current real estate trends, which make it impossible to nail down a perfectly accurate, one-size-fits-all answer.