-
Notifications
You must be signed in to change notification settings - Fork 0
License
dataquito/dpa-comapp
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
# Co-mapp - ## About: ## Installation The analysis pipeline can be run after cloning this repository and calling `make init` and `make deploy`. ### Dependencies * Python 3.5.2 * luigi * git * psql (PostgreSQL) 9.5.4 * PostGIS 2.1.4 * ...and other Python packages (see `requirements.txt`) ## Data Pipeline After you create the evironment set up the pipeline_tasks in luigi.cfg The general process of the pipeline is: * **Ingest:** * LocalIngest: Ingest data from multiple sources * LocalToS3: Upload to S3 and save historical by date * UpdateOutput: Preprocess to Output * UpdateDB: Update Postgres tables and Create indexes (see commons/pg_raw_schemas) * **ETL:** * **Model:** * ### Contributors | [![javurena7][ph-javurena7]][gh-javurena7] | [![rsanchezavalos][ph-rsanchez]][gh-rsanchez] | [![andreanr][ph-andreanr]][gh-andreanr]| | :--: | :--: | :--: | | [javurena7][gh-javurena7] | [rsanchezavalos][gh-rsanchez] | [andreanr][gh-andreanr] | [ph-javurena7]: https://avatars0.githubusercontent.com/u/14095871?v=3&s=550 [gh-javurena7]: https://github.com/javurena7 [ph-andreanr]: https://avatars1.githubusercontent.com/u/5949086?v=3&s=460 [gh-andreanr]: https://github.com/andreanr [ph-rsanchez]: https://avatars.githubusercontent.com/u/10931011?v=3&s=460 [gh-rsanchez]: https://github.com/rsanchezavalos
About
No description, website, or topics provided.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published