v0.9.1 (#186)

* improve error messages, #184 (#185)

* improve error messages, #184

* force pin soc

* increase RetrieveTimeout

* reduce RetrieveTimeout to 1s

* cli doc commands fixed

* Major Refactor and Improvements (#187)

* remove ResponseWriter from logout

* remove ResponseWriter from delete user

* remove ResponseWriter from user apis

* use utils lib

* revert dependency versions

* move deps back

* move deps back

* inmem fs for wasm

* fix tests

* minor changes

* Feature/bee gateway proxy (#204)

* remove debug api reference, #192 fixed

* check health for bee-gateway-proxy

* kv_export api added

* Storing User Credentials -  fairOS improvement proposal (#196)

* connecting with blockchain

* login working

* reading ens configs from config file

* fund account, setResolver, setAll

* login working with SLI

* padding SOC address before encryption

* fix delete

* move ens logic before storing into swarm

* fix responses for v2 authentication

* fix lint

* feature: account migration 

* Remove vendor, update deps (#203)

* chore: bring changes from #201

* chore: update deps

* fix: lint

* suppress unpin error

* comment out username availability check in logout

* fixes (#205)

* fix: text and responses

* update openapi yml /w /v2 apis

* bringing in #191 changes to fix #189

* allow for new user_name while migration

* check connection of eth-client

* wait for transaction confirmation

* update solidity bindings

* v2 endpoints added in REPL client. docs updated (#206)

* bump version

* no need of postageId while using gateway-proxy

* build: update dockerfile

add optional override of config as arg at build time

* fix: #195 (#207)

* fix: #195

* fix: remove ens provider private key

* fix: increase defaultRetrieveTimeout

* integrate gorelease (#208)

* feat: goreleaser

* gorelase docker & docker manifest

* fix: dockerhub login

* ens based portable login (#210)

* unpinning fixed on bee

* updated contract binding, code refactored (#213)=

* use seed for registration and generate pod accounts

* fixing account and pod tests

* log network info

* chore: bump bee v1.7.0

* fix kv test

* fix: dockerfile

* update testnet ens addresses

* Http test (#214)

* api tests
* fix: code style issues (#215)
* fix: verify chainID of rpc
* feature: #74, share pod with new name (#217)
* fix: insufficient funds error message

* fix: ignore deepsource docker err (#219)

* fix: deepsource code style errs

* feat: add badges

* fix: #60, dont include code in response (#220)

* fix: potential fix for #221 (#222)

* fix: increase test coverage

* fix: #234 (#237)

* fix: #234

* fix: #235 (#238)

* fix: #236 (#239)

* fix: #240 (#242)

* fix: #240

* fix: #241 (#243)

* fix: #244 (#246)

* feat: #249 (#250)

* feat: #249

* fix: #247, goreleaser with cgo

* fix: comment out unpinning code, described in #265 (#266)

* fix: comment out unpinning code, described in #265

* fix: #255 (#268)

* fix #257, remove linkmode from ldflags (#269)

* fix: add cli build in goreleaser

* feat: #287 (#288)

* v0.9.0 (#258) (#309)

* feat: added taskmanager to speedup loading metadata

* feature: added `pprof` flag to disable running pprof server always

* feat: writeAt feature on files, fix #259 (#260)

* feat: implement #170 (file/rename)

* feat: implement #262 (dir/rename) (#263) 

* feat: rename with move feature

* feat: add dir & file rename REST apis (#264)

* feat: add rest api tests for rename (#267)

* feat: add file seek api, #271 (#272)

* feat: #273, writeAt with truncate (#274)

* fix: allow pod to open if any file metadata gets corrupted

* feat: windows tests (#283)

* fix: #285  (broken ws server)

* feat: #229, #230 (v2 login support and use dfs.API)

* fix: kv `/present` moved to `/entry/present`

* feat: add pod/open-async api (#291)

* feat: metadata & content encryption (#294)

* feat: swagger integration

* fix: allow passing version to download.sh

* feat: remove unnecessary metadata fields, json tags changed to camelCase #298, #303

* fix: remove password from pod requests (#306)

* fix: ReceiveInfo does not require podName now #281 

* feat: `make swagger` added

* fix: swagger notations

* feat: add dependabot

* fix: #310, use handleMeta in rename (#311)

* staging (#314)

* fix: json tags (#313)

* Staging (#320)

* v0.9.0 (#258)

* feat: added taskmanager to speedup loading metadata

* feature: added `pprof` flag to disable running pprof server always

* feat: writeAt feature on files, fix #259 (#260)

* feat: implement #170 (file/rename)

* feat: implement #262 (dir/rename) (#263)

* feat: rename with move feature

* feat: add dir & file rename REST apis (#264)

* feat: add rest api tests for rename (#267)

* feat: add file seek api, #271 (#272)

* feat: #273, writeAt with truncate (#274)

* fix: allow pod to open if any file metadata gets corrupted

* feat: windows tests (#283)

* fix: #285  (broken ws server)

* feat: #229, #230 (v2 login support and use dfs.API)

* fix: kv `/present` moved to `/entry/present`

* feat: add pod/open-async api (#291)

* feat: metadata & content encryption (#294)

* feat: swagger integration

* fix: allow passing version to download.sh

* feat: remove unnecessary metadata fields, json tags changed to camelCase #298, #303

* fix: remove password from pod requests (#306)

* fix: ReceiveInfo does not require podName now #281

* feat: `make swagger` added

* fix: swagger notations

* feat: add dependabot

* Remove content encryption.0 (#316)

* feat: #317, allow 0 batchId (#318)

* Staging (#321)

* fix: add dev fairos url in swagger host

* Staging (#322)

* fix: swagger url

* Staging (#323)

* fix: url scheme

* Staging (#324)

* fix: pod ls response

* fix: chunk download url

* Staging (#331)

* v0.9.0 (#258)

* feat: added taskmanager to speedup loading metadata

* feature: added `pprof` flag to disable running pprof server always

* feat: writeAt feature on files, fix #259 (#260)

* feat: implement #170 (file/rename)

* feat: implement #262 (dir/rename) (#263)

* feat: rename with move feature

* feat: add dir & file rename REST apis (#264)

* feat: add rest api tests for rename (#267)

* feat: add file seek api, #271 (#272)

* feat: #273, writeAt with truncate (#274)

* fix: allow pod to open if any file metadata gets corrupted

* feat: windows tests (#283)

* fix: #285  (broken ws server)

* feat: #229, #230 (v2 login support and use dfs.API)

* fix: kv `/present` moved to `/entry/present`

* feat: add pod/open-async api (#291)

* feat: metadata & content encryption (#294)

* feat: swagger integration

* fix: allow passing version to download.sh

* feat: remove unnecessary metadata fields, json tags changed to camelCase #298, #303

* fix: remove password from pod requests (#306)

* fix: ReceiveInfo does not require podName now #281

* feat: `make swagger` added

* fix: swagger notations

* feat: add dependabot

* add contact

* fix: swagger url

* fix: url scheme

* fix: pod ls response

* fix: chunk download url

* feat: #325, return podInfo, if pod already open (#326)

* feat: #325, return podInfo, if pod already open

* fix: #328, remove migrate export and other v1 api references (#329)

* fix: #328, remove migrate export and other v1 api references from repl client

* fix: #330

* fix: minor fixes

* Revert "fix: minor fixes"

This reverts commit 2bc06f4.

* Staging (#332)

* Fix task with same name (#336)

* fix: #335, overwrite

* add uniqueness to the dir tasks name

* added overwrite param for OpenAPI specs (#334)

* Staging (#337)

* Staging (#339)

* chore: add disclaimer

Co-authored-by: darkobas2 <[email protected]>
Co-authored-by: Tadej Fius <[email protected]>

.github/dependabot.yml

@@ -0,0 +1,7 @@
+version: 2
+updates:
+  - package-ecosystem: "gomod"
+    directory: "/"
+    schedule:
+      interval: weekly
+      day: sunday

.github/workflows/coverge.yml

@@ -15,15 +15,15 @@ jobs:
       - name: Setup Go
         uses: actions/setup-go@v1
         with:
-          go-version: 1.14
+          go-version: 1.17
       - name: Checkout
         uses: actions/checkout@v2
         with:
           ref: ${{ github.event.pull_request.head.sha }}
       - name: Report results to DeepSource
+        env:
+          DEEPSOURCE_DSN: ${{ secrets.DEEPSOURCE_DSN }}
         run: |
           go test -coverprofile=cover.out ./...
           curl https://deepsource.io/cli | sh
-          ./bin/deepsource report --analyzer test-coverage --key go --value-file ./cover.out
-        env:
-          DEEPSOURCE_DSN: ${{ secrets.DEEPSOURCE_DSN }}
+          ./bin/deepsource report --analyzer test-coverage --key go --value-file ./cover.out

.github/workflows/go.yml

@@ -14,7 +14,7 @@ jobs:
     runs-on: ${{ matrix.os }}
     strategy:
       matrix:
-        go: [1.15]
+        go: [1.17]
         os: [ubuntu-latest, macos-latest, windows-latest]
     steps:
     - name: Setup Go
@@ -48,5 +48,4 @@ jobs:
       if: matrix.os == 'ubuntu-latest'
       run: make test-race
     - name: Test
-      if: matrix.os != 'windows-latest'
       run: make test

.github/workflows/release.yaml

@@ -0,0 +1,40 @@
+name: Release
+
+defaults:
+  run:
+    shell: bash
+
+on:
+  push:
+    branches-ignore:
+      - '**'
+    tags:
+      - 'v*.*.*'
+
+jobs:
+  goreleaser:
+    runs-on: ubuntu-latest
+    steps:
+      - name: Setup Go
+        uses: actions/setup-go@v2
+        with:
+          go-version: 1.18
+      - name: Checkout
+        uses: actions/checkout@v2
+        with:
+          fetch-depth: 0
+      - name: Fetch all tags
+        run: git fetch --force --tags
+      - name: Set up QEMU
+        uses: docker/setup-qemu-action@v1
+      - name: Set up Docker Buildx
+        uses: docker/setup-buildx-action@v1
+      - name: setup release environment
+        run: |-
+          echo '${{secrets.DOCKERHUB_USERNAME}}:${{secrets.DOCKERHUB_TOKEN}}:docker.io' > .docker-creds
+          echo 'DOCKER_CREDS_FILE=.docker-creds'                                        > .release-env
+          echo 'GITHUB_TOKEN=${{secrets.GITHUB_TOKEN}}'                                >> .release-env
+      - name: Run GoReleaser
+        run: |-
+          sudo rm -rf dist
+          make release

.gitignore

@@ -27,3 +27,9 @@ _cgo_export.*
 *.prof
 
 .DS_Store
+cover.html
+cover.out
+
+# goreleaser environment resources
+.release-env
+.docker-creds

.goreleaser.yaml

@@ -0,0 +1,211 @@
+project_name: dfs
+
+release:
+  prerelease: auto
+env:
+  - GO111MODULE=on
+  - CGO_ENABLED=1
+before:
+  hooks:
+    - go mod download
+builds:
+  - id: dfs-darwin-amd64
+    main: ./cmd/dfs
+    binary: dfs
+    goos:
+      - darwin
+    goarch:
+      - amd64
+    env:
+      - CC=o64-clang
+      - CXX=o64-clang++
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+  - id: dfs-darwin-arm64
+    main: ./cmd/dfs
+    binary: dfs
+    goos:
+      - darwin
+    goarch:
+      - arm64
+    env:
+      - CC=oa64-clang
+      - CXX=oa64-clang++
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+  - id: dfs-linux-amd64
+    main: ./cmd/dfs
+    binary: dfs
+    goos:
+      - linux
+    goarch:
+      - amd64
+    env:
+      - CC=x86_64-linux-gnu-gcc
+      - CXX=x86_64-linux-gnu-g++
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+  - id: dfs-linux-arm64
+    main: ./cmd/dfs
+    binary: dfs
+    goos:
+      - linux
+    goarch:
+      - arm64
+    env:
+      - CC=aarch64-linux-gnu-gcc
+      - CXX=aarch64-linux-gnu-g++
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+  - id: dfs-windows-amd64
+    main: ./cmd/dfs
+    binary: dfs
+    goos:
+      - windows
+    goarch:
+      - amd64
+    env:
+      - CC=x86_64-w64-mingw32-gcc
+      - CXX=x86_64-w64-mingw32-g++
+    flags:
+      - -v
+      - -trimpath
+      - -buildmode=exe
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+
+  - id: dfs-cli-linux
+    main: ./cmd/dfs-cli
+    binary: dfs_cli
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+    env:
+      - CGO_ENABLED=0
+    goos:
+      - linux
+    goarch:
+      - amd64
+      - arm64
+  - id: dfs-cli-darwin
+    main: ./cmd/dfs-cli
+    binary: dfs_cli
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+    env:
+      - CGO_ENABLED=0
+    goos:
+      - darwin
+    goarch:
+      - amd64
+      - arm64
+  - id: dfs-cli-windows
+    main: ./cmd/dfs-cli
+    binary: dfs_cli
+    flags:
+      - -v
+      - -trimpath
+    ldflags:
+      - -s -w
+      - -X github.com/fairdatasociety/fairOS-dfs.commit={{ .ShortCommit }}
+      - -X github.com/fairdatasociety/fairOS-dfs.version={{ .Version }}
+    env:
+      - CGO_ENABLED=0
+    goos:
+      - windows
+    goarch:
+      - amd64
+
+archives:
+  - id: binary-version
+    name_template: '{{ .Binary }}_v{{ .Version }}_{{ .Os }}_{{ .Arch }}{{ with .Arm }}v{{ . }}{{ end }}{{ with .Mips }}_{{ . }}{{ end }}{{ if not (eq .Amd64 "v1") }}{{ .Amd64 }}{{ end }}'
+    format: binary
+  - id: binary
+    name_template: '{{ .Binary }}_{{ .Os }}_{{ .Arch }}'
+    format: binary
+  - id: zip
+    name_template: '{{ .Binary }}_v{{ .Version }}_{{ .Os }}_{{ .Arch }}{{ with .Arm }}v{{ . }}{{ end }}{{ with .Mips }}_{{ . }}{{ end }}{{ if not (eq .Amd64 "v1") }}{{ .Amd64 }}{{ end }}'
+    format: zip
+checksum:
+  name_template: 'checksums.txt'
+snapshot:
+  name_template: "{{ incpatch .Version }}-snapshot"
+dockers:
+  - image_templates:
+      - "fairdatasociety/fairos-dfs:v{{ .Version }}-amd64"
+    use: buildx
+    ids:
+      - dfs-linux-amd64
+    goarch: amd64
+    dockerfile: Dockerfile.goreleaser
+    build_flag_templates:
+      - "--platform=linux/amd64"
+      - "--pull"
+      - "--label=org.opencontainers.image.created={{.Date}}"
+      - "--label=org.opencontainers.image.title={{.ProjectName}}"
+      - "--label=org.opencontainers.image.revision={{.FullCommit}}"
+      - "--label=org.opencontainers.image.version={{.Version}}"
+  - image_templates:
+      - "fairdatasociety/fairos-dfs:v{{ .Version }}-arm64"
+    use: buildx
+    ids:
+      - dfs-linux-arm64
+    goarch: arm64
+    dockerfile: Dockerfile.goreleaser
+    build_flag_templates:
+      - "--platform=linux/arm64"
+      - "--pull"
+      - "--label=org.opencontainers.image.created={{.Date}}"
+      - "--label=org.opencontainers.image.title={{.ProjectName}}"
+      - "--label=org.opencontainers.image.revision={{.FullCommit}}"
+      - "--label=org.opencontainers.image.version={{.Version}}"
+docker_manifests:
+  - name_template: fairdatasociety/fairos-dfs:v{{ .Major }}
+    image_templates:
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-amd64
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-arm64
+    skip_push: auto
+  - name_template: fairdatasociety/fairos-dfs:v{{ .Major }}.{{ .Minor }}
+    image_templates:
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-amd64
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-arm64
+    skip_push: auto
+  - name_template: fairdatasociety/fairos-dfs:v{{ .Major }}.{{ .Minor }}.{{ .Patch }}{{ with .Prerelease }}-{{ . }}{{ end }}
+    image_templates:
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-amd64
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-arm64
+  - name_template: fairdatasociety/fairos-dfs:latest
+    image_templates:
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-amd64
+      - fairdatasociety/fairos-dfs:v{{ .Version }}-arm64

DISCLAIMER

@@ -0,0 +1,31 @@
+# DISCLAIMER
+Account integrity persistence and security are not assured. Expect that funds
+used for account might be lost, as well as any data the account uses.
+
+Use of this service is limited only to **non-sensitive and publicly available
+data**. Users must not use, share, or store any kind of sensitive data like
+health status, provision or payment of healthcare, Personally Identifiable
+Information (PII) and/or Protected Health Information (PHI), etc. under **ANY**
+circumstance.
+
+Administrators for this service can not moderate any information
+used, shared, or stored with this service at any time. Any user that cannot
+abide by this disclaimer and Code of Conduct must refrain from using this service.
+
+The material embodied in this software is provided to you "as-is" and without
+warranty of any kind, express, implied or otherwise, including without
+limitation, any warranty of fitness for a particular purpose. In no event shall
+the any government be liable to you or anyone else for any direct, special, incidental,
+indirect or consequential damages of any kind, or any damages whatsoever,
+including without limitation, loss of profit, loss of use, savings or revenue,
+or the claims of third parties, whether or not any government has
+been advised of the possibility of such loss, however caused and on any theory
+of liability, arising out of or in connection with the possession, use or
+performance of this software.
+
+
+# Disclaimer of Endorsement
+Reference herein to any specific commercial product, process, or service by trade
+name, trademark, manufacturer, or otherwise, in this Work does not constitute an
+endorsement, recommendation, or favoring by the any Government and
+shall not be used for advertising or product endorsement purposes.

Dockerfile

@@ -1,13 +1,23 @@
-FROM golang:1.16 AS build
+FROM golang:alpine3.15 AS build
 
 WORKDIR /usr/fairos
 COPY go.mod go.sum /usr/fairos/
 RUN go mod download
 COPY . /usr/fairos/
-RUN make binary
 
-FROM debian:10.9-slim
+#skipcq: DOK-DL3018
+RUN apk add --update --no-cache make gcc git musl-dev libc-dev linux-headers bash \
+    && make binary
 
+FROM alpine:3.15
+
+ARG CONFIG
+ENV CONFIG=$CONFIG
+
+RUN addgroup -g 10000 fds \
+    && adduser -u 10000 -G fds -h /home/fds -D fds
+USER fds
+RUN if [ -n "$CONFIG" ]; then  echo -e "$CONFIG" > ~/.dfs.yaml; fi
 EXPOSE 9090
 
 COPY --from=build /usr/fairos/dist/dfs /usr/local/bin/dfs

Dockerfile.goreleaser

@@ -0,0 +1,11 @@
+FROM debian:bullseye
+
+RUN apt-get update
+RUN apt-get install -y ca-certificates
+RUN update-ca-certificates
+
+EXPOSE 9090
+
+COPY dfs /usr/local/bin/dfs
+
+ENTRYPOINT ["dfs"]