Adding url uploads to document picker (#375)

* WIP adding url uploads to document picker

* fix manual script for uploading url to custom-documents

* fix metadata for url scraping

* wip url parsing

* update how async link scraping works

* docker-compose defaults added
no autocomplete on URLs

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

.dockerignore

@@ -11,5 +11,6 @@ collector/outputs/**
 **/__pycache__/
 **/.env
 **/.env.*
+**/bundleinspector.html
 !docker/.env.example
 !frontend/.env.production