If I go the many SDF projects path, how do I share libraries without downloading it to my computer on every project?

You can reference other files via module paths.

you can use a package manager to manage dependencies (i.e. publish to a binary repository like npm or similar) or use some facility in your version control system (e.g. with git can be submodules or subtrees)