Just a thought if you want to pursue this:

Perhaps you could try see whether you could use Riivolution for changing the villager houses textures on the fly...