Like Kurt, I don't see another way to speed this up.
Symbols cannot be linked to an external instance. Once used, they become part of the file.
That makes it also impossible to use CC Libraries, when placed from a CC library, they either are placed Linked (and when embedded are expanded) or placed as a Copy which keeps them as Symbols but loses the link.
... View more