new: added --source argument to agent init (ENG-99)

[evilsocket]

• Added an optional --source argument to dreadnode agent init that supports custom templates in the form of:
  • username/repository (github repository partial string) -> will download https://github.com/username/repository/archive/refs/heads/main.zip
  • https://github.com/username/repository (full github url) -> will download https://github.com/username/repository/archive/refs/heads/main.zip
  • https://example.com/custom.zip -> will download as is if full URL to a zip archive.

Unzipping should be safe from path traversal attacks.

• Refactored install_template / install_template_from_dir in order to perform validation (at least a Dockerfile is required for a template) and handle nested folders correctly (there was a bug).
• Fixed install_template / install_template_from_dir to handle non text files properly.
• Added unit tests coverage for these changes and fixes.
• Updated documentation to reflect changes.

Closes ENG-99

[linear]

ENG-99 CLI - Agent templates per strike

Given the unique requirements of strikes, we might want to let the user select from some docker base images to use for their agent (or maybe suggest them from the server) based on tools that might be required.

For example, certain dangerous-capabilities zones might benefit from having tools like mongo or psql.

[monoxgas]

Looking good!

Currently checking on how easy it might be to get access to private repos with authentication through various means.

I did come across https://github.com/jelmer/dulwich, which might be a more well-supported library than GitPython if we wanted to add it the ability to clone local repos from SSH paths using everyone's default ssh config.

Going to try and avoid adding too much complexity with maybe just some web token auth primitives. I'll keep you posted.

[evilsocket]

Looking good!

Currently checking on how easy it might be to get access to private repos with authentication through various means.

I did come across https://github.com/jelmer/dulwich, which might be a more well-supported library than GitPython if we wanted to add it the ability to clone local repos from SSH paths using everyone's default ssh config.

Going to try and avoid adding too much complexity with maybe just some web token auth primitives. I'll keep you posted.

i specifically avoided using gitpython or similar because: do we really want to clone the whole repo, with the whole .git folder, the logs, diffs, commits and whatnot?

[evilsocket]

@monoxgas ooooooooooooooooo, now I get it :D github_repo.api_zip_url FTW!

[evilsocket]

@monoxgas love the github_repo.api_zip_url solution! this PR looks ready to merge, wdyt?

[monoxgas]

Let's GOOO