#334 Add in-memory database (#346)

* #334 Savepoint

* #334 Savpoint

* #334 Update dependencies

* #334 Prepare for versioned release

* #334 Improve workflows

* #334 Improve workflows

* #334 Prepare for versioned release

* #334 Fix docker build test

* #334 Fix docker build test

Author: docktermj

.github/workflows/docker-push-containers-to-dockerhub-manual.yaml

@@ -0,0 +1,27 @@
+name: docker push containers to dockerhub - manual
+
+on:
+  workflow_dispatch:
+
+permissions:
+  contents: read
+
+jobs:
+  docker-push-containers-to-dockerhub-manual:
+    runs-on: ubuntu-latest
+
+    steps:
+      - name: Get repo name
+        id: repo-basename
+        run: |
+          echo "repo=$(basename ${{ github.repository }})" >> "$GITHUB_OUTPUT"
+        shell: bash
+
+      - name: Build docker image and push to DockerHub
+        uses: senzing-factory/github-action-docker-buildx-build@v1
+        with:
+          build-options: "--push"
+          image-repository: senzing/${{ steps.repo-basename.outputs.repo }}
+          image-tag: latest
+          password: ${{ secrets.DOCKERHUB_ACCESS_TOKEN }}
+          username: ${{ secrets.DOCKERHUB_USERNAME }}

.github/workflows/docker-push-containers-to-dockerhub.yaml

@@ -26,5 +26,4 @@ jobs:
           image-repository: senzing/${{ steps.repo-basename.outputs.repo }}
           image-tag: ${{ github.ref_name }}
           password: ${{ secrets.DOCKERHUB_ACCESS_TOKEN }}
-          platforms: linux/amd64
           username: ${{ secrets.DOCKERHUB_USERNAME }}

CHANGELOG.md

@@ -9,6 +9,12 @@ and this project adheres to [Semantic Versioning].
 
 -
 
+## [0.8.5] - 2024-10-21
+
+### Changed in 0.8.5
+
+- Add ephemeral database to Dockerfile
+
 ## [0.8.4] - 2024-10-09
 
 ### Changed in 0.8.4

Dockerfile

@@ -2,8 +2,8 @@
 # Stages
 # -----------------------------------------------------------------------------
 
-ARG IMAGE_BUILDER=golang:1.22.4-bullseye
-ARG IMAGE_FINAL=senzing/senzingapi-runtime-staging:latest
+ARG IMAGE_BUILDER=golang:1.23.2-bullseye
+ARG IMAGE_FINAL=senzing/senzingapi-runtime-beta:latest
 
 # -----------------------------------------------------------------------------
 # Stage: senzingapi_runtime
@@ -69,18 +69,14 @@ COPY ./rootfs /
 
 COPY --from=builder "/output/linux/serve-grpc" "/app/serve-grpc"
 
-# Install database
-
-COPY ./testdata/sqlite/G2C.db /tmp/sqlite/G2C.db
-RUN chmod --recursive 777 /tmp/sqlite
-
 # Run as non-root container
 
 USER 1001
 
 # Runtime environment variables.
 
-ENV SENZING_TOOLS_DATABASE_URL=sqlite3://na:na@nowhere/tmp/sqlite/G2C.db
+ENV SENZING_TOOLS_DATABASE_URL=sqlite3://na:na@nowhere/tmp/sqlite/G2C.db?mode=memory&cache=shared
+ENV SENZING_TOOLS_ENABLE_ALL=true
 ENV LD_LIBRARY_PATH=/opt/senzing/er/lib/
 
 # Runtime execution.

README.md

@@ -16,9 +16,6 @@ the recommendation is not to use it yet.
 
 ## Synopsis
 
-`serve-grpc` is a command in the [senzing-tools] suite of tools.
-This command is a [gRPC] server application that supports requests to the Senzing SDK via network access.
-
 [![Go Reference Badge]][Package reference]
 [![Go Report Card Badge]][Go Report Card]
 [![License Badge]][License]
@@ -39,85 +36,16 @@ Senzing SDKs for accessing the gRPC server:
 1. Go: [sz-sdk-go-grpc]
 1. Python: [sz-sdk-python-grpc]
 
-A simple demonstration using `senzing-tools` and a SQLite database.
-
-```console
-export LD_LIBRARY_PATH=/opt/senzing/er/lib/
-export SENZING_TOOLS_DATABASE_URL=sqlite3://na:na@nowhere/tmp/sqlite/G2C.db
-senzing-tools init-database
-senzing-tools serve-grpc --enable-all
-
-```
-
 ## Install
 
-1. The `serve-grpc` command is installed with the [senzing-tools] suite of tools.
-   See [senzing-tools install](https://github.com/senzing-garage/senzing-tools#install).
-
 ## Use
 
-```console
-export LD_LIBRARY_PATH=/opt/senzing/er/lib/
-senzing-tools serve-grpc [flags]
-```
-
-1. For options and flags:
-    1. [Online documentation](https://hub.senzing.com/senzing-tools/senzing-tools_serve-grpc.html)
-    1. Runtime documentation:
-
-        ```console
-        export LD_LIBRARY_PATH=/opt/senzing/er/lib/
-        senzing-tools serve-grpc --help
-        ```
-
-1. In addition to the following simple usage examples, there are additional [Examples](docs/examples.md).
-
-### Using command line options
-
-1. :pencil2: Specify database using command line option.
+1. Docker container with internal, ephemeral database and
+   gRPC accessable on port 8261.
    Example:
 
     ```console
-    export LD_LIBRARY_PATH=/opt/senzing/er/lib/
-    senzing-tools serve-grpc \
-        --database-url postgresql://username:[email protected]:5432/G2 \
-        --enable-all
-
-    ```
-
-1. Run `senzing-tools serve-grpc --help` or see [Parameters](#parameters) for additional parameters.
-
-### Using environment variables
-
-1. :pencil2: Specify database using environment variable.
-   Example:
-
-    ```console
-    export LD_LIBRARY_PATH=/opt/senzing/er/lib/
-    export SENZING_TOOLS_DATABASE_URL=postgresql://username:[email protected]:5432/G2
-    export SENZING_TOOLS_ENABLE_ALL=true
-    senzing-tools serve-grpc
-    ```
-
-1. Run `senzing-tools serve-grpc --help` or see [Parameters](#parameters) for additional parameters.
-
-### Using Docker
-
-This usage shows how to initialze a database with a Docker container.
-
-1. This usage specifies a URL of an external database.
-   Example:
-
-    ```console
-    docker run \
-        --env SENZING_TOOLS_DATABASE_URL=postgresql://username:[email protected]:5432/G2 \
-        --env SENZING_TOOLS_ENABLE_ALL=true \
-        --interactive \
-        --publish 8258:8258 \
-        --rm \
-        --tty \
-        senzing/senzing-tools serve-grpc
-
+    docker run -it --name senzing-serve-grpc -p 8261:8261 --rm senzing/serve-grpc
     ```
 
 1. See [Parameters](#parameters) for additional parameters.
@@ -126,11 +54,6 @@ This usage shows how to initialze a database with a Docker container.
 
 - **[SENZING_TOOLS_DATABASE_URL]**
 - **[SENZING_TOOLS_ENABLE_ALL]**
-- **[SENZING_TOOLS_ENABLE_G2CONFIG]**
-- **[SENZING_TOOLS_ENABLE_G2CONFIGMGR]**
-- **[SENZING_TOOLS_ENABLE_G2DIAGNOSTIC]**
-- **[SENZING_TOOLS_ENABLE_G2ENGINE]**
-- **[SENZING_TOOLS_ENABLE_G2PRODUCT]**
 - **[SENZING_TOOLS_ENGINE_CONFIGURATION_JSON]**
 - **[SENZING_TOOLS_ENGINE_LOG_LEVEL]**
 - **[SENZING_TOOLS_ENGINE_MODULE_NAME]**
@@ -159,7 +82,6 @@ This usage shows how to initialze a database with a Docker container.
 [go-test-windows.yaml]: https://github.com/senzing-garage/serve-grpc/actions/workflows/go-test-windows.yaml
 [golangci-lint.yaml Badge]: https://github.com/senzing-garage/serve-grpc/actions/workflows/golangci-lint.yaml/badge.svg
 [golangci-lint.yaml]: https://github.com/senzing-garage/serve-grpc/actions/workflows/golangci-lint.yaml
-[gRPC]: https://github.com/senzing-garage/knowledge-base/blob/main/WHATIS/grpc.md
 [License Badge]: https://img.shields.io/badge/License-Apache2-brightgreen.svg
 [License]: https://github.com/senzing-garage/serve-grpc/blob/main/LICENSE
 [Package reference]: https://pkg.go.dev/github.com/senzing-garage/serve-grpc
@@ -168,17 +90,11 @@ This usage shows how to initialze a database with a Docker container.
 [Senzing Quick Start guides]: https://docs.senzing.com/quickstart/
 [SENZING_TOOLS_DATABASE_URL]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_database_url
 [SENZING_TOOLS_ENABLE_ALL]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_all
-[SENZING_TOOLS_ENABLE_G2CONFIG]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_g2config
-[SENZING_TOOLS_ENABLE_G2CONFIGMGR]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_g2configmgr
-[SENZING_TOOLS_ENABLE_G2DIAGNOSTIC]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_g2diagnostic
-[SENZING_TOOLS_ENABLE_G2ENGINE]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_g2engine
-[SENZING_TOOLS_ENABLE_G2PRODUCT]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_enable_g2product
 [SENZING_TOOLS_ENGINE_CONFIGURATION_JSON]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_engine_configuration_json
 [SENZING_TOOLS_ENGINE_LOG_LEVEL]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_engine_log_level
 [SENZING_TOOLS_ENGINE_MODULE_NAME]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_engine_module_name
 [SENZING_TOOLS_GRPC_PORT]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_grpc_port
 [SENZING_TOOLS_LOG_LEVEL]: https://github.com/senzing-garage/knowledge-base/blob/main/lists/environment-variables.md#senzing_tools_log_level
-[senzing-tools]: https://github.com/senzing-garage/senzing-tools
 [Senzing]: https://senzing.com/
 [senzing/sz-sdk-go-core]: https://github.com/senzing-garage/sz-sdk-go-core
 [sz-sdk-go-grpc]: https://github.com/senzing-garage/sz-sdk-go-grpc

go.mod

@@ -43,7 +43,7 @@ require (
 	golang.org/x/net v0.30.0 // indirect
 	golang.org/x/sys v0.26.0 // indirect
 	golang.org/x/text v0.19.0 // indirect
-	google.golang.org/genproto/googleapis/rpc v0.0.0-20241007155032-5fefd90f89a9 // indirect
+	google.golang.org/genproto/googleapis/rpc v0.0.0-20241015192408-796eee8c2d53 // indirect
 	google.golang.org/protobuf v1.35.1 // indirect
 	gopkg.in/ini.v1 v1.67.0 // indirect
 	gopkg.in/yaml.v3 v3.0.1 // indirect

go.sum

@@ -78,8 +78,8 @@ golang.org/x/sys v0.26.0 h1:KHjCJyddX0LoSTb3J+vWpupP9p0oznkqVk/IfjymZbo=
 golang.org/x/sys v0.26.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
 golang.org/x/text v0.19.0 h1:kTxAhCbGbxhK0IwgSKiMO5awPoDQ0RpfiVYBfK860YM=
 golang.org/x/text v0.19.0/go.mod h1:BuEKDfySbSR4drPmRPG/7iBdf8hvFMuRexcpahXilzY=
-google.golang.org/genproto/googleapis/rpc v0.0.0-20241007155032-5fefd90f89a9 h1:QCqS/PdaHTSWGvupk2F/ehwHtGc0/GYkT+3GAcR1CCc=
-google.golang.org/genproto/googleapis/rpc v0.0.0-20241007155032-5fefd90f89a9/go.mod h1:GX3210XPVPUjJbTUbvwI8f2IpZDMZuPJWDzDuebbviI=
+google.golang.org/genproto/googleapis/rpc v0.0.0-20241015192408-796eee8c2d53 h1:X58yt85/IXCx0Y3ZwN6sEIKZzQtDEYaBWrDvErdXrRE=
+google.golang.org/genproto/googleapis/rpc v0.0.0-20241015192408-796eee8c2d53/go.mod h1:GX3210XPVPUjJbTUbvwI8f2IpZDMZuPJWDzDuebbviI=
 google.golang.org/grpc v1.67.1 h1:zWnc1Vrcno+lHZCOofnIMvycFcc0QRGIzm9dhnDX68E=
 google.golang.org/grpc v1.67.1/go.mod h1:1gLDyUQU7CTLJI90u3nXZ9ekeghjeM7pTDZlqFNg2AA=
 google.golang.org/protobuf v1.35.1 h1:m3LfL6/Ca+fqnjnlqQXNpFPABW1UD7mjh8KO2mKFytA=

makefiles/darwin.mk

@@ -6,11 +6,12 @@
 
 SENZING_DIR ?= /opt/senzing/er
 SENZING_TOOLS_SENZING_DIRECTORY ?= $(SENZING_DIR)
-
 LD_LIBRARY_PATH ?= $(SENZING_TOOLS_SENZING_DIRECTORY)/lib:$(SENZING_TOOLS_SENZING_DIRECTORY)/lib/macos
+
+CGO_LDFLAGS := "-Wl,-no_warn_duplicate_libraries"
 DYLD_LIBRARY_PATH := $(LD_LIBRARY_PATH)
-SENZING_TOOLS_DATABASE_URL ?= sqlite3://na:na@nowhere/tmp/sqlite/G2C.db
 PATH := $(MAKEFILE_DIRECTORY)/bin:/$(HOME)/go/bin:$(PATH)
+SENZING_TOOLS_DATABASE_URL ?= sqlite3://na:na@nowhere/tmp/sqlite/G2C.db
 
 # -----------------------------------------------------------------------------
 # OS specific targets