Any process that modulates the frequency, rate or extent of secretory granule organization. [ http://www.ncbi.nlm.nih.gov/pubmed/15039777 http://purl.obolibrary.org/obo/go/references/0000058 ]