init postgres sidecar

[ransomw1c]

#256

[ransomw1c]

as of bc3ff8c ,

make pg-demo-coord-build-app
make build-and-push-pg-sidecar
./hack/fuse-demo/create_coord_pg_pod.sh

followed by

./hack/fuse-demo/run_coord_pg_shell.sh -s

and

./hack/fuse-demo/run_coord_pg_shell.sh

to enter shells in the sidecar and application containers, respectively,

and then, first, in the application container

/tmp/coord/.scripts/wrap_application.sh -s -c /tmp/coord -b postgres -- ./mock_application_pg.sh 5430

followed by

./wrap_datamon_pg.sh -c /tmp/coord -x -r ransom-datamon-test-repo -l pg-coord-example -m 'postgres coordination example' -p 5430

in the sidecar

is a minimal demo of creating a database and coordinating an upload to datamon.

[kerneltime]

The approach looks fine. Will try to give it a try tomorrow.

[ransomw1c]

POC demo is

./hack/fuse-demo/demo_pg_coord.sh

• -s skip container builds (after the first use)
• -b build datamon source
• -c passthrough constant, an arbitrary non-negative integer, verifies that the mock application accesses source and output data

---

ensure no deployment exists before running pg demo via kubectl delete as needed

[ransomw1c]

note to self

to resolve in parallel: i256-tinicache--wip workaround for rate-limiting error from the host (not a distro pkg, perhaps use a distro pkg?) where the pid 0 bin resides.

[fredbi]

See my comment on #256 and https://www.postgresql.org/docs/current/sql-checkpoint.html

[ransomw1c]

consider Postgres CHECKPOINT along with vacuuming.

https://www.postgresql.org/docs/current/sql-checkpoint.html

#256 (comment)

[ransomw1c]

demo_pg_coord.sh requires postgres 12 on local. it's possible to install via an unofficial brew repository

brew tap petere/postgresql
brew tap-pin petere/postgresql

except the brew repository has an issue with the os x system libraries with the following workaround

cd /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library
sudo mv Perl Perl.bkup_postgresinstall
sudo ln -s /Library/Perl
open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg
sudo mv Perl Perl.bkup_link
sudo mv Perl.bkup_postgresinstall Perl

such that it's possible to install postgres 12 via brew with

brew install petere/postgresql/postgresql@12

and follow instructions to access postgres. i used the add /usr/local/opt/postgresql@12/bin to path option.

[ransomw1c]

status on landing is that internals have a reasonable amount of stress testing, while user-interface is to be significantly revisited.