Any process that modulates the rate, frequency, or extent of cell-substrate junction assembly. Cell-substrate junction assembly is the aggregation, arrangement and bonding together of a set of components to form a junction between a cell and its substrate. [ ]