High level overview of next steps

[dhardestylewis]

Technical improvements

Note: I only included ~ past month's work here, there's still a lot of other GitHub issues contributing to scoping!

bolded most important

👉 most immediate!

• ⏸️ update database against comparables
  Comparables #11
  • ⏸️ latest TNRIS DEMs
    Update TNRIS Lidar dataset & database against new projects in TNRIS S3 bucket #39
  • ⏸️ NOAA coastal collections
    NOAA coastal collections #82
  • ⏸️ seamless backfill
    Seamless backfill #68
• (optional/metadata) update PostgreSQL DB with LPC resolution
  • case study is Balmorhea, for which no ~"Lidar point-to-point spec" was provided
    How LPC resolution of Balmorhea was set #45
• 👉 finish implementing best-in-time-and-space algo in PostgreSQL
  Best-in-time-and-space performance improvement approach #41
• 👉 revise selection table based on TNRIS feedback & @andycarter-pe suggestion to pull acquisitiondate using TNRIS API
  Draft selection table for best-in-time-and-space version of the terrain_aggregator workflow #44
• update computatonal gridding against TNRIS preference for 1m basemap
  • aligned with quarter quads
  • 256x256 pixels each
  • 0 pixel buffer - provide warning about order-of-operations when working with non-overlapping tiles
    New computational gridding #71
• 👉 re-issue tiles at 1m basemap (ie zoom level 0)
  • as cloud-optimized GeoTIFFs
  • as XYZ tiles
    How many tile services do we want to provide? #72
• establish DB relationships to prepare for web-selection / on-the-fly aggregation
  Establish DB relationships between most important data products #59
  • de facto watersheds GIS dataset
    latest national Watershed Boundary Dataset (WBD) #61
  • de facto Texas border GIS dataset
    Border of Texas #69
• prepare front-end web tile service, two options ready:
  • @wmobley's
    https://github.com/wmobley/texas_damageplain
  • @dhardestylewis's
    https://seamless-elevation.herokuapp.com/
• postgis Docker image hasn't been building recently, needs minor patch
  Update postgis Docker image to build successfully #31
  • provide static copy of Singularity file in the interim
• Determine how to do multiple concurrent connections to Stampede2 PostgreSQL physical DB - them's some interlocking lock.files
  Troubleshoot Stampede2 concurrent PostgreSQL connections #66
• Architect continuity-of-service in case main systems fail

Preparing and responding to QAQC

• 👉 Incorporate TNRIS feedback
  QAQC from TNRIS #73
• 👉 Provide TNRIS back with corrected metadata availability file
  Document TNRIS DEM coverage file issues #28

Documentation

• Continue free-form master description of work & vision
  free-form description to incorporate into README.md or other publications #75
• Review/incorporate/cite past work
  Possible citations #74
• Revise README.md with Table of Contents & fold-out sectioning
  Provide Table of Contents and fold-out sections to README.md #63
• Continue gathering cost/cost-savings info
  Gather info on typical flood study cost #24
• Store DB & upstream lidar tiles metadata files on GitHub
  Set up Git Large File Storage #76
  Set up local git version management of DB on Stampede2 #65
• Depict available subgrids, as well as subgridding scheme
  Subgrids available on Corral #57
• Provide back timing info to compute a single subgrid
  Single subgrid timing info #70
• Continue moving towards more descriptive naming
  Rename database from postgres to terrain_aggregator throughout #62

Marketing, licensing, & provenance

• Continue marketing / preparing for marketing of alpha release web service
  Formulate hype campaign #53
• Revise licensing policy in light of Office Tech Commercialization feedback
  terrain_aggregator licensing policy #67
• Finish unforking repo, clarifying extent of @Khushbooagarwalhub's contributions to describing how to run PostgreSQL on Stampede2
  Unfork this repo #33

[dhardestylewis]

@dhardestylewis update against latest GitHub issues, as well as less recent ones!

[dhardestylewis]

Here is the highest level context for this work, from the TDEM Conference, May 2022:
https://docs.google.com/presentation/d/1Exz4S31sIxykHHGL_pmuu74rLLD-FDJf/edit?disco=AAAAejplNHM