When Searching for the Perfect Sweater Dress stick to the finer knits and avoid anything to overly textured. Try breaking up the silhouette with a blazer or vest. Adding such a layering piece will act as a security blanket if you sub-conscious of the cling sweater dress style.