In the absence of a sewer problem, or a dead animal, that musty smell is always fungal (mould).  Sometimes the smell is only in a wardrobe, but often it can be more pervasive.  Ventilation is the answer – see subfloor, see HRV.