This also happens with Lilium washingtonianum seedpods in the Cascade range, and causes nearly 100% losses of the seed crop. It also happens with Cimicifuga elata in the Columbia River gorge. I don't know the identity of the pest, or how to control it. I have never seen it in the garden.