The catchy name 'Daffy-down-dilly' originates from the novel Little Daffydowndilly which was written by the acclaimed American author Nathaniel Hawthorne (1804 - 1864). Nathaniel Hawthorne was born in Salem, Massachusetts. His most famous novel is 'The Scarlet Letter' (1850).
Old Ben Weatherstaff has described the coming of springtime to Mary: "in th' flower gardens out there things will be stirrin' down below in th' dark. ... You'll see bits o' green spikes stickin' out o' th' black earth' after a bit. ... Crocusses an' snowdrops an' daffydowndillys."