..for now this is still a free country. If you can afford it without sheisting someone, developing a Ponzi scheme, shang hi-ing your church or ripping off your grandmother, build it as large as you like!!!
If I built a house based on my family size it would have 7 bedrooms. So, why should they restrict the size of a home if you could afford it.