Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TestNames test flaky #250

Closed
KyleMaas opened this issue Dec 10, 2022 · 19 comments · Fixed by #308
Closed

TestNames test flaky #250

KyleMaas opened this issue Dec 10, 2022 · 19 comments · Fixed by #308
Labels
testing

Comments

@KyleMaas
Copy link
Contributor 

cd ~/go-ssb/sbot
watch 'LIBRARIAN_WRITEALL=0 go test -v ./ -run TestNames | tee -a ~/testlog.txt'

Lots of PASSes. But here's a FAIL:

2022/12/10 16:28:46 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 16:28:46 saved identity @0CRrYbmaGxNBVRF3yPuLd0xQQyDIAT9GmIh+g/G9JSI=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 16:28:46 saved identity ssb:feed/gabbygrove-v1/YwZiHuC-3rhxLLg6jgHDe0u4E9r09La5NqcxQfMWghE= to testrun/TestNames/secrets/bert
2022/12/10 16:28:46 saved identity @izag8812GcTGDYE9ZkCbWo0M3HzcsxyeScsP/yDc0pU=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 16:28:46 saved identity @YB33dgT4LHB97m7Du24bmiccAC1cX1MeMXofcCMU4kk=.ed25519 to testrun/TestNames/secret
    names_test.go:122: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:122
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "i'm arny!"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+i'm arny!
        	Test:       	TestNames
        	Messages:   	did not the right name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=114.536µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0022f0000, 0x1, 0xc00231a7e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0022f0000, 0x2, 0xc00231a7e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0022f0000, 0x3, 0xc00231a7e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 13 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0000d5200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc00221ccc0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0000d5200, 0xc00231a8a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 16 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0000d53f8, 0xc00225c390?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 23 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 24 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0000e4500)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 25 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe9e40c9218, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000ef100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0000ef100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0000ef100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc0021fbb60)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc3b0, 0xc0021fb7d0}, {0xff5ca0, 0xc0021f3d50}, {0xffb0a0, 0xc0021fbb60}, {0x0, 0x0, 0x0}, {0xc0021fbb90, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000090480, {0xffc3b0, 0xc0021fb7d0}, {0x7fe9e4084558?, 0xc0000102a8?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9e4084558?, 0xc0000102a8?}, {0xff5ba0, 0xc000090480})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00225c3c0, 0xc00225c390)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00225c3f0, 0xc00225c390)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc00000f5f0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00221cd40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0000ef580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0000d5200, 0xc00231a660)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0000d5200, 0xc00231a7b0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc00225c4b0, 0xc00231a900)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001221e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001222d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000122370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000122410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000033320, {0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbc9878?, 0xc00000e468?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbc9878?, 0xc00000e468?}, {0xff5ba0, 0xc000033320})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001227d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00232e120, {0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbcb198?, 0xc0000c0000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbcb198?, 0xc0000c0000?}, {0xff5ba0, 0xc00232e120})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e48c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0000be5d0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0000be5d0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000c85d0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbc9878?, 0xc00000ed38?}, {0xff5680, 0xc0000c85d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4a00)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0000beff0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0000beff0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000c8768, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbc9878?, 0xc00000edc8?}, {0xff5680, 0xc0000c8768})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4be0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0000bf2f0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0000bf2f0, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000c8840, {0xffc3b0, 0xc0021fb7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0x7fe9ddbc9878?, 0xc00000ee88?}, {0xff5680, 0xc0000c8840})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 66 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc3b0, 0xc0021fb7d0}, 0xb2d05e00, {0xff9f90, 0xc00221ca00}, 0xc000091860)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 67 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00232e960, {0xffc3b0, 0xc0021fb7d0}, {0xff9350?, 0xc00008b060?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc3b0, 0xc0021fb7d0}, {0xff9350?, 0xc00008b060?}, {0xff5ba0, 0xc00232e960})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc00220e3f0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 9 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0022f0000, 0x0, 0xc00231a7e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 92 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe9e40c9128, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc00232d480?, 0xc00220b580?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc00232d480, {0xc00220b580, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc00232d480, {0xc00220b580?, 0x10000005423fc?, 0x7fe9e40bd318?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000cc520, {0xc00220b580?, 0xc00233faf8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6400, 0xc0000cc520}, {0xc00220b580, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6400, 0xc0000cc520}, {0xfff1c8, 0x15972e8}, {0xd3a9e0?, 0xc00220b574})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6400?, 0xc0000cc520?}}, 0xc00220b574)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00232ff20, {0xffc030, 0xc00227e580}, 0xc00220b574)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc000109ba0, 0xffc030?, 0xc00233fef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc000109ba0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 93 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00228e240?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc3b0, 0xc0021fb7d0}, {0xff5ca0, 0xc0021f3d50}, {0xffb0a0, 0xc0021fbb60}, {0x0, 0x0, 0x0}, {0xc0021fbb90, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 94 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 96 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe9e40c9038, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc00232d880?, 0xc0022987e0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc00232d880, {0xc0022987e0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc00232d880, {0xc0022987e0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000cc538, {0xc0022987e0?, 0x7fea0b6ed5b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fe9ddbcfd18, 0xc0000752c0}, {0xc0022987e0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fe9ddbcfd18, 0xc0000752c0}, {0xfff1c8, 0x15972e8}, {0xd3a9e0?, 0xc0022987d0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fe9ddbcfd18?, 0xc0000752c0?}}, 0xc0022987d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00228e240, {0xffc030, 0xc00227e680}, 0xc0022987d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc002234000, 0xffc030?, 0xc002345ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc002234000)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 99 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00017b7d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.09s)
FAIL
@KyleMaas
Copy link
Contributor Author

Related to #237. Keep forgetting to mention that.

@KyleMaas
Copy link
Contributor Author

Interesting: the PASSes complete very quickly. The FAILs take more than 10 seconds.

@KyleMaas
Copy link
Contributor Author

With these changes to try to narrow down where it's failing:

diff --git a/sbot/names_test.go b/sbot/names_test.go
index 842258b..2897fee 100644
--- a/sbot/names_test.go
+++ b/sbot/names_test.go
@@ -18,15 +18,15 @@ import (
        refs "github.com/ssbc/go-ssb-refs"
        "github.com/ssbc/go-ssb/client"
        "github.com/ssbc/go-ssb/internal/leakcheck"
-       "github.com/ssbc/go-ssb/internal/testutils"
+       //"github.com/ssbc/go-ssb/internal/testutils"
        "github.com/ssbc/go-ssb/repo"
 )
 
 func TestNames(t *testing.T) {
-       if testutils.SkipOnCI(t) {
+       /*if testutils.SkipOnCI(t) {
                // https://github.com/ssbc/go-ssb/pull/170
                return
-       }
+       }*/
 
        if os.Getenv("LIBRARIAN_WRITEALL") != "0" {
                t.Fatal("please 'export LIBRARIAN_WRITEALL=0' for this test to pass")
@@ -118,14 +118,14 @@ func TestNames(t *testing.T) {
 
        for who, wantName := range want {
                name, ok := all.GetCommonName(n2kp[who].ID())
-               r.True(ok, "did not get a name for %s", who)
-               r.Equal(wantName, name, "did not the right name for %s", who)
+               r.True(ok, "did not get a common name for %s", who)
+               r.Equal(wantName, name, "did not the right common name for %s", who)
        }
 
        for who, wantName := range want {
                name2, err := c.NamesSignifier(n2kp[who].ID())
-               r.NoError(err, "did not get a name for %s", who)
-               r.Equal(wantName, name2, "did not the right name for %s", who)
+               r.NoError(err, "did not get a name signifier for %s", who)
+               r.Equal(wantName, name2, "did not the right name signifier for %s", who)
        }
 
        r.NoError(c.Close())

Some more failures:

2022/12/10 16:43:44 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 16:43:44 saved identity @w5ijcbXGbgr+T94trW52OlPbSFG2pn65CGdQBeU8kGQ=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 16:43:44 saved identity ssb:feed/gabbygrove-v1/jQw4Ntm_UJtN74Yiz6ScinegbNSuDXkhx8qdzsUYW7s= to testrun/TestNames/secrets/bert
2022/12/10 16:43:44 saved identity @Y+XXeMO6nqedav3qXPLbkuX22OZ25jdPTn7gRvcBxlI=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 16:43:44 saved identity @Vmd+s71z5Hd17VvPGMesKM0JfPyCHWW54e2XxyQtorU=.ed25519 to testrun/TestNames/secret
    names_test.go:117: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:117
        	Error:      	"map[]" should have 3 item(s), but has 0
        	Test:       	TestNames
        	Messages:   	expected entries for all three keypairs
level=debug event=update-replicate feed-want-count=0 hops=0 took=128.488µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022534d0, 0xc0022534a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc002253500, 0xc0022534a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc0000b3668)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00008ff00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0021a7580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc002193200, 0xc00232f770)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc002193200, 0xc00232f8c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021f5490, 0x0, 0xc00232f7a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021f5490, 0x1, 0xc00232f7a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021f5490, 0x2, 0xc00232f7a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021f5490, 0x3, 0xc00232f7a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 30 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc002193200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc00008fe80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc002193200, 0xc00232fa70)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 33 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0021933f8, 0xc00224ed90?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc0022535c0, 0xc00232fad0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0000921e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0000923c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092460)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0021f6280)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00228da40, {0xffc430, 0xc002252900}, {0x7fe1a00d81d8?, 0xc0000b2498?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a00d81d8?, 0xc0000b2498?}, {0xff5c20, 0xc00228da40})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0021f65a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00228df20, {0xffc430, 0xc002252900}, {0x7fe1a00d9ad8?, 0xc000122000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a00d9ad8?, 0xc000122000?}, {0xff5c20, 0xc00228df20})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0021f6640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00229ea50, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00229ea50, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00234b9c8, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a00d81d8?, 0xc0000b2d68?}, {0xff5700, 0xc00234b9c8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0021f6780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00229e930, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00229e930, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00234b8f0, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a00d81d8?, 0xc0000b2df8?}, {0xff5700, 0xc00234b8f0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0021f6960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00229fb30, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00229fb30, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0022ae5e8, {0xffc430, 0xc002252900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a00d81d8?, 0xc0000b2eb8?}, {0xff5700, 0xc0022ae5e8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc430, 0xc002252900}, 0xb2d05e00, {0xffa010, 0xc00008fbc0}, 0xc002322e40)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000032c00, {0xffc430, 0xc002252900}, {0xff93d0?, 0xc000131760?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0xff93d0?, 0xc000131760?}, {0xff5c20, 0xc000032c00})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc0021f43f0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 6 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 67 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1a1e009a8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc002354180?, 0xc000035330?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc002354180, {0xc000035330, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc002354180, {0xc000035330?, 0x10000005423fc?, 0x7fe1c93ec2b0?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010008, {0xc000035330?, 0xc002379af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6480, 0xc000010008}, {0xc000035330, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6480, 0xc000010008}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc000035320})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6480?, 0xc000010008?}}, 0xc000035320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc000090c60, {0xffc0b0, 0xc00235a580}, 0xc000035320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0000a4680, 0xffc0b0?, 0xc002379ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0000a4680)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 68 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc000090f60?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc430, 0xc002252900}, {0xff5d20, 0xc00224ed70}, {0xffb120, 0xc002252c90}, {0x0, 0x0, 0x0}, {0xc002252cc0, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 69 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 7 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0021f63c0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 71 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1a1e008b8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc002354580?, 0xc0000351c0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc002354580, {0xc0000351c0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc002354580, {0xc0000351c0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010088, {0xc0000351c0?, 0x7fe1c93e3108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fe1a00cbf48, 0xc000074220}, {0xc0000351c0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fe1a00cbf48, 0xc000074220}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc0000351b0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fe1a00cbf48?, 0xc000074220?}}, 0xc0000351b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc000090f60, {0xffc0b0, 0xc00235a680}, 0xc0000351b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0000a49c0, 0xffc0b0?, 0xc002377ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0000a49c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 74 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0001577d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
    leakcheck.go:113: Leaked goroutine: goroutine 8 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1a1e00a98, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0021a7100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0021a7100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0021a7100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc002252c90)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc430, 0xc002252900}, {0xff5d20, 0xc00224ed70}, {0xffb120, 0xc002252c90}, {0x0, 0x0, 0x0}, {0xc002252cc0, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 9 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000321e0, {0xffc430, 0xc002252900}, {0x7fe1a0572c98?, 0xc0000a82f0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc002252900}, {0x7fe1a0572c98?, 0xc0000a82f0?}, {0xff5c20, 0xc0000321e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
--- FAIL: TestNames (10.10s)
FAIL

2022/12/10 16:45:54 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 16:45:54 saved identity @IsigFu/cKk/lHxju0zKLkpZdmQsNQ0pwJczJe5Twlks=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 16:45:54 saved identity ssb:feed/gabbygrove-v1/YFOch4RR7_hgC7ytiXgqYDOZd2gdfMUCsVvTKSIvOek= to testrun/TestNames/secrets/bert
2022/12/10 16:45:54 saved identity @AhZC+AS6p1G3lbiBkYRfaXBa3mapYyFa0AyEpdnl2bE=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 16:45:54 saved identity @88ij7dugUMGnNzGm3AQxXAmNHuLSJRtNcfloiEuP7bg=.ed25519 to testrun/TestNames/secret
    names_test.go:117: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:117
        	Error:      	"map[@IsigFu/cKk/lHxju0zKLkpZdmQsNQ0pwJczJe5Twlks=.ed25519:map[@IsigFu/cKk/lHxju0zKLkpZdmQsNQ0pwJczJe5Twlks=.ed25519:i'm arny!]]" should have 3 item(s), but has 1
        	Test:       	TestNames
        	Messages:   	expected entries for all three keypairs
level=debug event=update-replicate feed-want-count=0 hops=0 took=135.723µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00230ec90, 0xc00230ec60)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00230ecc0, 0xc00230ec60)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 117 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xa29985?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc0000b3950)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000154000, 0x0, 0xc00230ee40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000154000, 0x1, 0xc00230ee40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000154000, 0x2, 0xc00230ee40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000154000, 0x3, 0xc00230ee40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00008f680)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000120100)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc000101200, 0xc0001369f0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc000101200, 0xc000136b40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 31 [IO wait]:
        internal/poll.runtime_pollWait(0x7fbf4cbf1668, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc007958e80?, 0xc00225ee70?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc007958e80, {0xc00225ee70, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc007958e80, {0xc00225ee70?, 0x10000005423fc?, 0x7fbf4c38c758?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000a8020, {0xc00225ee70?, 0xc0079c9af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6480, 0xc0000a8020}, {0xc00225ee70, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6480, 0xc0000a8020}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc00225ee60})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6480?, 0xc0000a8020?}}, 0xc00225ee60)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0079ae420, {0xffc0b0, 0xc00008fb40}, 0xc00225ee60)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc00234dd40, 0xffc0b0?, 0xc0079c9ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc00234dd40)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 34 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc000101200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc00008f600)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc000101200, 0xc00230ef00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 37 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0001013f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc00230ed80, 0xc00230ef60)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001109b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000110a50)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000110af0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000110b90)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000113860)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0079e2960, {0xffc430, 0xc00230e0c0}, {0x7fbf4654ce58?, 0xc0000b3b00?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf4654ce58?, 0xc0000b3b00?}, {0xff5c20, 0xc0079e2960})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000113900)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000110e10)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0079e2720, {0xffc430, 0xc00230e0c0}, {0x7fbf46563898?, 0xc002190480?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf46563898?, 0xc002190480?}, {0xff5c20, 0xc0079e2720})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0001139a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc000136d20, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc000136d20, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e258, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf4654ce58?, 0xc0000b3bd8?}, {0xff5700, 0xc00000e258})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000113ae0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc000136e40, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc000136e40, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e378, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf4654ce58?, 0xc0000b3c68?}, {0xff5700, 0xc00000e378})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000113cc0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc000136f60, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc000136f60, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e450, {0xffc430, 0xc00230e0c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf4654ce58?, 0xc0000b3d28?}, {0xff5700, 0xc00000e450})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc430, 0xc00230e0c0}, 0xb2d05e00, {0xffa010, 0xc000089780}, 0xc00234ac60)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0079ae120, {0xffc430, 0xc00230e0c0}, {0xff93d0?, 0xc00795f7b0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0xff93d0?, 0xc00795f7b0?}, {0xff5c20, 0xc0079ae120})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc0022e57a0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 6 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 66 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc000090960?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc430, 0xc00230e0c0}, {0xff5d20, 0xc0023080f0}, {0xffb120, 0xc00230e450}, {0x0, 0x0, 0x0}, {0xc00230e480, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 67 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 69 [IO wait]:
        internal/poll.runtime_pollWait(0x7fbf4cbf1578, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000120680?, 0xc0079a4a20?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc000120680, {0xc0079a4a20, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc000120680, {0xc0079a4a20?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000103d8, {0xc0079a4a20?, 0x7fbf741bd5b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fbf46561a48, 0xc000074880}, {0xc0079a4a20, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fbf46561a48, 0xc000074880}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc0079a4a10})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fbf46561a48?, 0xc000074880?}}, 0xc0079a4a10)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc000090960, {0xffc0b0, 0xc007969080}, 0xc0079a4a10)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0001460d0, 0xffc0b0?, 0xc0079c7ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0001460d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 7 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0001135e0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 8 [IO wait]:
        internal/poll.runtime_pollWait(0x7fbf4cbf1758, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000dd080?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0000dd080)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0000dd080)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc00230e450)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc430, 0xc00230e0c0}, {0xff5d20, 0xc0023080f0}, {0xffb120, 0xc00230e450}, {0x0, 0x0, 0x0}, {0xc00230e480, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 9 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000032240, {0xffc430, 0xc00230e0c0}, {0x7fbf4c3c8a58?, 0xc0000a83e0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc00230e0c0}, {0x7fbf4c3c8a58?, 0xc0000a83e0?}, {0xff5c20, 0xc000032240})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
--- FAIL: TestNames (10.05s)
FAIL

2022/12/10 16:48:17 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 16:48:17 saved identity @03Ixcnk53JENUHKdAPFu+GLClM26KEHvTrKMfk4YnTk=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 16:48:17 saved identity ssb:feed/gabbygrove-v1/zXY_mATL_V1hXlerfZtm3YvGsaiDcVaLQLybQUebwfc= to testrun/TestNames/secrets/bert
2022/12/10 16:48:17 saved identity @RsMr6rKKlg6+f7dRWLFkOzYT0k4OypTuB92FSvd/ue8=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 16:48:17 saved identity @QLNwXwPdc3MatoUqp3JvTJcoTc/F9EPa4LsxFR4uKbo=.ed25519 to testrun/TestNames/secret
    names_test.go:117: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:117
        	Error:      	"map[@03Ixcnk53JENUHKdAPFu+GLClM26KEHvTrKMfk4YnTk=.ed25519:map[@03Ixcnk53JENUHKdAPFu+GLClM26KEHvTrKMfk4YnTk=.ed25519:i'm arny!] @zXY/mATL/V1hXlerfZtm3YvGsaiDcVaLQLybQUebwfc=.gabbygrove-v1:map[@zXY/mATL/V1hXlerfZtm3YvGsaiDcVaLQLybQUebwfc=.gabbygrove-v1:i'm bert!]]" should have 3 item(s), but has 2
        	Test:       	TestNames
        	Messages:   	expected entries for all three keypairs
level=debug event=update-replicate feed-want-count=0 hops=0 took=104.25µs
    leakcheck.go:113: Leaked goroutine: goroutine 11 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0022ec000?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc430, 0xc0001719b0}, {0xff5d20, 0xc0021e7e90}, {0xffb120, 0xc000171d40}, {0x0, 0x0, 0x0}, {0xc000171d70, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 14 [IO wait]:
        internal/poll.runtime_pollWait(0x7fdd597f9f38, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0022e6080?, 0xc00222e730?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0022e6080, {0xc00222e730, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0022e6080, {0xc00222e730?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc00013c090, {0xc00222e730?, 0x7fdd81e20108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fdd587cc248, 0xc0000740c0}, {0xc00222e730, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fdd587cc248, 0xc0000740c0}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc00222e720})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fdd587cc248?, 0xc0000740c0?}}, 0xc00222e720)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0022ec000, {0xffc0b0, 0xc0022f6040}, 0xc00222e720)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0000980d0, 0xffc0b0?, 0xc0021dfef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0000980d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 21 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 22 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0000abf40)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 23 [IO wait]:
        internal/poll.runtime_pollWait(0x7fdd597fa118, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000165100?, 0x7fdd81e2a108?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc000165100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc000165100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc000171d40)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc430, 0xc0001719b0}, {0xff5d20, 0xc0021e7e90}, {0xffb120, 0xc000171d40}, {0x0, 0x0, 0x0}, {0xc000171d70, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 24 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000325a0, {0xffc430, 0xc0001719b0}, {0x7fdd587b4d98?, 0xc00013c748?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd587b4d98?, 0xc00013c748?}, {0xff5c20, 0xc0000325a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00223c5a0, 0xc00223c570)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00223c5d0, 0xc00223c570)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc000137860)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000081c00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000165580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc000145200, 0xc002516840)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc000145200, 0xc002516990)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00219b490, 0x0, 0xc000096ea0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00219b490, 0x1, 0xc000096ea0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00219b490, 0x2, 0xc000096ea0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00219b490, 0x3, 0xc000096ea0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 36 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc000145200, 0xc00223c570?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000081b80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc000145200, 0xc000096ff0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 39 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0001453f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc00223c690, 0xc000097050)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000160190)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000160370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000160410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001604b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0001546e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0021bc7e0, {0xffc430, 0xc0001719b0}, {0x7fdd583144d8?, 0xc00000e3f0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd583144d8?, 0xc00000e3f0?}, {0xff5c20, 0xc0021bc7e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000154780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000160730)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0021bccc0, {0xffc430, 0xc0001719b0}, {0x7fdd58317658?, 0xc00012e000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd58317658?, 0xc00012e000?}, {0xff5c20, 0xc0021bccc0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000154820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc002188840, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc002188840, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc000137cf8, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd583144d8?, 0xc00000e4c8?}, {0xff5700, 0xc000137cf8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000154960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc002188720, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc002188720, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc000137c38, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd583144d8?, 0xc00000e558?}, {0xff5700, 0xc000137c38})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000154b40)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0021882d0, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0021882d0, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0001379f8, {0xffc430, 0xc0001719b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0x7fdd583144d8?, 0xc00000e618?}, {0xff5700, 0xc0001379f8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc430, 0xc0001719b0}, 0xb2d05e00, {0xffa010, 0xc0000818c0}, 0xc000033500)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0021bcf00, {0xffc430, 0xc0001719b0}, {0xff93d0?, 0xc0021e7c50?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc430, 0xc0001719b0}, {0xff93d0?, 0xc0021e7c50?}, {0xff5c20, 0xc0021bcf00})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc00219a3f0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 59 [IO wait]:
        internal/poll.runtime_pollWait(0x7fdd597fa028, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000165f80?, 0xc00222e7b0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc000165f80, {0xc00222e7b0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc000165f80, {0xc00222e7b0?, 0x10000005423fc?, 0x7fdd81e29888?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000101d8, {0xc00222e7b0?, 0xc0021e1af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6480, 0xc0000101d8}, {0xc00222e7b0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6480, 0xc0000101d8}, {0xfff248, 0x15972e8}, {0xd3a9e0?, 0xc00222e7a0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6480?, 0xc0000101d8?}}, 0xc00222e7a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00252ef00, {0xffc0b0, 0xc00256bf40}, 0xc00222e7a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc002524000, 0xffc0b0?, 0xc0021e1ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc002524000)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 98 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00221a7d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.04s)
FAIL

So...my changes seemed to make no difference at all, because in all three of these cases, it failed for a different reason than the first one I posted.

@KyleMaas
Copy link
Contributor Author

So, after making this change:

@@ -114,18 +114,18 @@ func TestNames(t *testing.T) {
                "cloe": "i'm cloe!",
        }
 
-       r.Len(all, len(want), "expected entries for all three keypairs")
+       r.Len(all, len(want), "expected entries for all three keypairs but received %#v", all)

I get:

2022/12/10 17:09:02 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 17:09:02 saved identity @4rgZC2P3Swg9bpPu1/dJ6DCnYVPoJrf/knuFuhUx4dw=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 17:09:02 saved identity ssb:feed/gabbygrove-v1/Sl9TMhc_enkCdCxabZ6IcP96iVTqAQtv9czosAeFLc0= to testrun/TestNames/secrets/bert
2022/12/10 17:09:02 saved identity @xR+INBvqdeR1wJf4F6B6TPXLIi3kxc0sJxRFxNK+IvE=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 17:09:02 saved identity @h5cuxpsVLvnj9fA3JYz9APSMEmCu6IXP7ERVL7OpqhI=.ed25519 to testrun/TestNames/secret
    names_test.go:117: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:117
        	Error:      	"map[@4rgZC2P3Swg9bpPu1/dJ6DCnYVPoJrf/knuFuhUx4dw=.ed25519:map[@4rgZC2P3Swg9bpPu1/dJ6DCnYVPoJrf/knuFuhUx4dw=.ed25519:i'm arny!]]" should have 3 item(s), but has 1
        	Test:       	TestNames
        	Messages:   	expected entries for all three keypairs but received client.NamesGetResult{"@4rgZC2P3Swg9bpPu1/dJ6DCnYVPoJrf/knuFuhUx4dw=.ed25519":map[string]string{"@4rgZC2P3Swg9bpPu1/dJ6DCnYVPoJrf/knuFuhUx4dw=.ed25519":"i'm arny!"}}
level=debug event=update-replicate feed-want-count=0 hops=0 took=210.415µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 11 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc00014bae0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 12 [IO wait]:
        internal/poll.runtime_pollWait(0x7fac09550f58, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000159100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc000159100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc000159100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc0000fdce0)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc450, 0xc0000fd950}, {0xff5d40, 0xc0021f3ea0}, {0xffb140, 0xc0000fdce0}, {0x0, 0x0, 0x0}, {0xc0000fdd10, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000324e0, {0xffc450, 0xc0000fd950}, {0x7fac10554a18?, 0xc000130748?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac10554a18?, 0xc000130748?}, {0xff5c40, 0xc0000324e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00224e540, 0xc00224e510)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00224e570, 0xc00224e510)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc00012b890)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 22 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002210070, 0x0, 0xc0025009c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 23 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002210070, 0x1, 0xc0025009c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 24 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002210070, 0x2, 0xc0025009c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002210070, 0x3, 0xc0025009c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 26 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0000e7200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000081bc0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0000e7200, 0xc002500a80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 29 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0000e73f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc00224e630, 0xc002500ae0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000154190)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000154280)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000154320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000081c40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000159580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0000e7200, 0xc0025007e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0000e7200, 0xc002500930)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001543c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc00014a8c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0022ac060, {0xffc450, 0xc0000fd950}, {0x7fac1002dbb8?, 0xc00012a600?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac1002dbb8?, 0xc00012a600?}, {0xff5c40, 0xc0022ac060})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc00014ab40)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000154780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0025134a0, {0xffc450, 0xc0000fd950}, {0x7fac1002dc60?, 0xc000122000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac1002dc60?, 0xc000122000?}, {0xff5c40, 0xc0025134a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc00014abe0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00223a270, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00223a270, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000f788, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac1002dbb8?, 0xc00012a6d8?}, {0xff5720, 0xc00000f788})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 58 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc00014ae60)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 59 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00223a390, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00223a390, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000f860, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac1002dbb8?, 0xc00012aed0?}, {0xff5720, 0xc00000f860})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 60 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc00014b220)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 61 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00223a4b0, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00223a4b0, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000f938, {0xffc450, 0xc0000fd950})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0x7fac1002dbb8?, 0xc00012b020?}, {0xff5720, 0xc00000f938})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 62 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc450, 0xc0000fd950}, 0xb2d05e00, {0xffa030, 0xc000081900}, 0xc000033800)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 63 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002513800, {0xffc450, 0xc0000fd950}, {0xff93f0?, 0xc0021f2750?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc450, 0xc0000fd950}, {0xff93f0?, 0xc0021f2750?}, {0xff5c40, 0xc002513800})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc002210460)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 65 [IO wait]:
        internal/poll.runtime_pollWait(0x7fac09550e68, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc002258000?, 0xc00220c8f0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc002258000, {0xc00220c8f0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc002258000, {0xc00220c8f0?, 0x10000005423fc?, 0x7fac1051eed8?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0001306f8, {0xc00220c8f0?, 0xc002533af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff64a0, 0xc0001306f8}, {0xc00220c8f0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff64a0, 0xc0001306f8}, {0xfff268, 0x15972e8}, {0xd3a9e0?, 0xc00220c8e0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff64a0?, 0xc0001306f8?}}, 0xc00220c8e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0001018c0, {0xffc0d0, 0xc0021c3f40}, 0xc00220c8e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0001324e0, 0xffc0d0?, 0xc002533ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0001324e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 77 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc002268cc0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc450, 0xc0000fd950}, {0xff5d40, 0xc0021f3ea0}, {0xffb140, 0xc0000fdce0}, {0x0, 0x0, 0x0}, {0xc0000fdd10, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 78 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 80 [IO wait]:
        internal/poll.runtime_pollWait(0x7fac09550d78, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc002258900?, 0xc00227e6e0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc002258900, {0xc00227e6e0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc002258900, {0xc00227e6e0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000130810, {0xc00227e6e0?, 0x7fac38b115b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fac0aed14b8, 0xc000141da0}, {0xc00227e6e0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fac0aed14b8, 0xc000141da0}, {0xfff268, 0x15972e8}, {0xd3a9e0?, 0xc00227e6d0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fac0aed14b8?, 0xc000141da0?}}, 0xc00227e6d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc002268cc0, {0xffc0d0, 0xc00226a280}, 0xc00227e6d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc000132680, 0xffc0d0?, 0xc002531ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc000132680)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 83 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0001057d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.09s)
FAIL

So...it was the first one published that worked. Maybe the TODO: flush indexes line has something to do with it?

@KyleMaas
Copy link
Contributor Author

After adding some logging statements in:

2022/12/10 22:13:08 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 22:13:08 saved identity @8ozzaLJFihgAWLLCvI603RMcbDet9P0Hcf7UhI2edpQ=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 22:13:08 saved identity ssb:feed/gabbygrove-v1/KEjqhTG7P00RefFNeT8et1NdVIn0u7zEVps-RrBrf6M= to testrun/TestNames/secrets/bert
2022/12/10 22:13:08 saved identity @6wQOgjwJ5RwbxPD3j/tUuUG3xS8j0VxkpNMQwU9lyYs=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 22:13:08 saved identity @ER5ndKPJWHzjJWSt+cBPABFJw4I+0LPfviVfukN8g84=.ed25519 to testrun/TestNames/secret
2022/12/10 22:13:08 created bot
2022/12/10 22:13:08 published messages
2022/12/10 22:13:08 TODO: flush indexes
2022/12/10 22:13:08 client joined socket
2022/12/10 22:13:08 got names
    names_test.go:128: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:128
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "that cloe"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+that cloe
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=136.521µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [IO wait]:
        internal/poll.runtime_pollWait(0x7f3ac20e6658, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc00008f000?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc00008f000)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc00008f000)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc002240f30)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc490, 0xc002240ba0}, {0xff5d80, 0xc002242cf0}, {0xffb180, 0xc002240f30}, {0x0, 0x0, 0x0}, {0xc002240f60, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00011a600, {0xffc490, 0xc002240ba0}, {0x7f3ac0034998?, 0xc000010298?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3ac0034998?, 0xc000010298?}, {0xff5c80, 0xc00011a600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc002241770, 0xc002241740)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022417a0, 0xc002241740)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc00000f3f8)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000081a80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00008f480)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0000b3200, 0xc002327a10)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0000b3200, 0xc002327b60)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0001de000, 0x0, 0xc002327a40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0001de000, 0x1, 0xc002327a40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0001de000, 0x2, 0xc002327a40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0001de000, 0x3, 0xc002327a40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 40 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0000b3200, 0xc002241740?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000081a00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0000b3200, 0xc002327bc0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 43 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0000b33f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc002241860, 0xc002327c20)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00008a0f0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00008a230)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00008a2d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00008a370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000186280)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0001e3b00, {0xffc490, 0xc002240ba0}, {0x7f3ac0045e38?, 0xc00000e228?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3ac0045e38?, 0xc00000e228?}, {0xff5c80, 0xc0001e3b00})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0001865a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00008a690)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000d2900, {0xffc490, 0xc002240ba0}, {0x7f3aa3225a98?, 0xc0001a0000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3aa3225a98?, 0xc0001a0000?}, {0xff5c80, 0xc0000d2900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000186640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc002379e30, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc002379e30, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0001256b0, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3ac0045e38?, 0xc00000eaf8?}, {0xff5760, 0xc0001256b0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000186780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0001eae10, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0001eae10, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0001e47e0, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3ac0045e38?, 0xc00000eb88?}, {0xff5760, 0xc0001e47e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 58 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000186960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 59 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0001eacf0, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0001eacf0, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0001e4708, {0xffc490, 0xc002240ba0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0x7f3ac0045e38?, 0xc00000ec48?}, {0xff5760, 0xc0001e4708})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 60 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc490, 0xc002240ba0}, 0xb2d05e00, {0xffa070, 0xc000081740}, 0xc000032e40)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 61 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000d2240, {0xffc490, 0xc002240ba0}, {0xff9430?, 0xc0000437b0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc002240ba0}, {0xff9430?, 0xc0000437b0?}, {0xff5c80, 0xc0000d2240})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc00017e3f0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 76 [IO wait]:
        internal/poll.runtime_pollWait(0x7f3ac20e6568, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001e8c00?, 0xc002244390?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001e8c00, {0xc002244390, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001e8c00, {0xc002244390?, 0x10000005423fc?, 0x7f3ac1081d20?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000118128, {0xc002244390?, 0xc00222faf8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff64e0, 0xc000118128}, {0xc002244390, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff64e0, 0xc000118128}, {0xfff2a8, 0x15972e8}, {0xd3a9e0?, 0xc002244384})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff64e0?, 0xc000118128?}}, 0xc002244384)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0022220c0, {0xffc110, 0xc0001f6a40}, 0xc002244384)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0001cedd0, 0xffc110?, 0xc00222fef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0001cedd0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 77 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc002222240?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc490, 0xc002240ba0}, {0xff5d80, 0xc002242cf0}, {0xffb180, 0xc002240f30}, {0x0, 0x0, 0x0}, {0xc002240f60, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 78 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 8 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 80 [IO wait]:
        internal/poll.runtime_pollWait(0x7f3ac20e6478, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001e9000?, 0xc002244200?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001e9000, {0xc002244200, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001e9000, {0xc002244200?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000118378, {0xc002244200?, 0x7f3ae96b25b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7f3ac0045f80, 0xc0001b6be0}, {0xc002244200, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7f3ac0045f80, 0xc0001b6be0}, {0xfff2a8, 0x15972e8}, {0xd3a9e0?, 0xc0022441f0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7f3ac0045f80?, 0xc0001b6be0?}}, 0xc0022441f0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc002222240, {0xffc110, 0xc0001f6b40}, 0xc0022441f0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0001cef70, 0xffc110?, 0xc0001ffef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0001cef70)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 9 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0001863c0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 99 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc002344fd0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.05s)
FAIL

Wherever the 10 second delay's happening, it appears it's after the test has failed out.

@KyleMaas
Copy link
Contributor Author

WaitUntilIndexesAreSynced didn't fix it:

2022/12/10 22:28:32 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 22:28:32 saved identity @7YOLr65pmqedwFLvsKM9/ia8CR7Z2OtRiZSu5AAXTLc=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 22:28:32 saved identity ssb:feed/gabbygrove-v1/k03MOKWBMNO0Bng5lYnm69HT1gW6c-3mbWaHmkjKxjw= to testrun/TestNames/secrets/bert
2022/12/10 22:28:32 saved identity @TQHIiQY4kn+bQzLuwDBDPzVM+IPsdQHFoHva1edUBec=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 22:28:32 saved identity @MMxUhgkePVVEF1yMbi8lwk1d/q9vEYizV14HTrofSG4=.ed25519 to testrun/TestNames/secret
2022/12/10 22:28:32 created bot
2022/12/10 22:28:32 published messages
2022/12/10 22:28:32 TODO: flush indexes
2022/12/10 22:28:32 client joined socket
2022/12/10 22:28:32 got names
    names_test.go:129: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:129
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "iditot"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+iditot
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=128.157µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe6fc1ee458, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000ef100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0000ef100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0000ef100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc0021dfb30)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc490, 0xc0021df7a0}, {0xff5d80, 0xc0021c7e40}, {0xffb180, 0xc0021dfb30}, {0x0, 0x0, 0x0}, {0xc0021dfb60, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 101 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0078cffd0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000032600, {0xffc490, 0xc0021df7a0}, {0x7fe6fca32218?, 0xc0000cc728?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fca32218?, 0xc0000cc728?}, {0xff5c80, 0xc000032600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022ce390, 0xc0022ce360)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022ce3c0, 0xc0022ce360)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc0000c9860)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000133c00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0000ef580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 24 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00227a070, 0x0, 0xc0022e8810)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00227a070, 0x1, 0xc0022e8810)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00227a070, 0x2, 0xc0022e8810)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc00227a070, 0x3, 0xc0022e8810)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 28 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0000d5200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000133b80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0000d5200, 0xc0022e88d0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 31 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0000d53f8, 0xc0022ce360?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc0022ce480, 0xc0022e8930)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00011a1e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0000d5200, 0xc0022e8630)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0000d5200, 0xc0022e8780)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00011a2d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00011a370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00011a410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e46e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000033920, {0xffc490, 0xc0021df7a0}, {0x7fe6fc17fa78?, 0xc0000c85e8?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fc17fa78?, 0xc0000c85e8?}, {0xff5c80, 0xc000033920})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00011a7d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000033ce0, {0xffc490, 0xc0021df7a0}, {0x7fe6fc17fb20?, 0xc0000c0000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fc17fb20?, 0xc0000c0000?}, {0xff5c80, 0xc000033ce0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 58 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 59 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00007f3e0, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00007f3e0, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e4e0, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fc17fa78?, 0xc0000c86c0?}, {0xff5760, 0xc00000e4e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 60 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 61 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00007f500, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00007f500, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e5b8, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fc17fa78?, 0xc0000c8eb8?}, {0xff5760, 0xc00000e5b8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 62 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0000e4b40)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 63 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00007f620, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00007f620, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e690, {0xffc490, 0xc0021df7a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0x7fe6fc17fa78?, 0xc0000c9008?}, {0xff5760, 0xc00000e690})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:202 +0xa05
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 64 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc490, 0xc0021df7a0}, 0xb2d05e00, {0xffa070, 0xc0001338c0}, 0xc000091380)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 65 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0022fe6c0, {0xffc490, 0xc0021df7a0}, {0xff9430?, 0xc000043130?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc490, 0xc0021df7a0}, {0xff9430?, 0xc000043130?}, {0xff5c80, 0xc0022fe6c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc00227a460)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 78 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe6fc1ee368, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0022fb480?, 0xc00790cbd0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0022fb480, {0xc00790cbd0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0022fb480, {0xc00790cbd0?, 0x10000005423fc?, 0x7fe6fc20a878?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010100, {0xc00790cbd0?, 0xc002181af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff64e0, 0xc000010100}, {0xc00790cbd0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff64e0, 0xc000010100}, {0xfff2a8, 0x15972e8}, {0xd3a9e0?, 0xc00790cbc0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff64e0?, 0xc000010100?}}, 0xc00790cbc0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0022ffc80, {0xffc110, 0xc0021dd640}, 0xc00790cbc0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc000101e10, 0xffc110?, 0xc002181ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc000101e10)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 79 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0022fff80?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc490, 0xc0021df7a0}, {0xff5d80, 0xc0021c7e40}, {0xffb180, 0xc0021dfb30}, {0x0, 0x0, 0x0}, {0xc0021dfb60, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 8 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 80 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 9 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc000113f40)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 98 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe6fc1ee278, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0022fb880?, 0xc00790ca80?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0022fb880, {0xc00790ca80, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0022fb880, {0xc00790ca80?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010118, {0xc00790ca80?, 0x7fe725059108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fe6fc006998, 0xc0000751e0}, {0xc00790ca80, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fe6fc006998, 0xc0000751e0}, {0xfff2a8, 0x15972e8}, {0xd3a9e0?, 0xc00790ca70})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fe6fc006998?, 0xc0000751e0?}}, 0xc00790ca70)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0022fff80, {0xffc110, 0xc0021dd740}, 0xc00790ca70)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0022a4000, 0xffc110?, 0xc002187ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0022a4000)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
--- FAIL: TestNames (10.09s)
FAIL

@KyleMaas
Copy link
Contributor Author

WaitUntilIndexesAreSynced did seem to make a difference. The failures are now consistently wrong rather than not having all the messages:

2022/12/10 23:18:33 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/10 23:18:33 saved identity @RuQuXm8h4PR7q0laeFjFAJJzPY7IgzFbeml+uzRGjwc=.ed25519 to testrun/TestNames/secrets/arny
2022/12/10 23:18:33 saved identity ssb:feed/gabbygrove-v1/pPqPDTasasq0_P9Ea04wlNMeeydpc0eanMQIx6ln814= to testrun/TestNames/secrets/bert
2022/12/10 23:18:33 saved identity @VyR7ZLwpoKKS55O4KrQgP2nObbKPfktdaD1CY0SQBWI=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/10 23:18:33 saved identity @fCpnmxPRkQAo25+47OWu3J4PCOfTTpF1mzCJdm0YKr0=.ed25519 to testrun/TestNames/secret
2022/12/10 23:18:33 created bot
2022/12/10 23:18:33 published messages
2022/12/10 23:18:33 TODO: flush indexes
2022/12/10 23:18:33 index states: map[string]string{"abouts":"live", "combined":"live", "contacts":"live", "get":"live", "group-members":"live", "timestamps":"live"}
2022/12/10 23:18:33 client joined socket
2022/12/10 23:18:33 got names
    names_test.go:130: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:130
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "i'm arny!"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+i'm arny!
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=123.195µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000323c0, {0xffc4d0, 0xc0022e25a0}, {0x7f9df52e9658?, 0xc00011a758?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df52e9658?, 0xc00011a758?}, {0xff5cc0, 0xc0000323c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022e3170, 0xc0022e3140)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0001da000, 0xc0022e3290)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022e31a0, 0xc0022e3140)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc00000e0a8)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000159780)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0001c4080)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0001da000, 0xc0001e4630)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000187490, 0x0, 0xc0022e2000)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000187490, 0x1, 0xc0022e2000)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000187490, 0x2, 0xc0022e2000)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000187490, 0x3, 0xc0022e2000)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 34 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0001da000, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000159700)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0001da000, 0xc0022e2150)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 37 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0001da1f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc000094480, 0xc0022e21b0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00013e140)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00013e2d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00013e370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00013e410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000188140)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc00223e660, {0xffc4d0, 0xc0022e25a0}, {0x7f9df44e01f8?, 0xc00012c6c0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df44e01f8?, 0xc00012c6c0?}, {0xff5cc0, 0xc00223e660})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000188320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc00013e730)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000101aa0, {0xffc4d0, 0xc0022e25a0}, {0x7f9df44e32f8?, 0xc0001a0000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df44e32f8?, 0xc0001a0000?}, {0xff5cc0, 0xc000101aa0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000188640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00233e240, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00233e240, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00233a198, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df44e01f8?, 0xc00012c858?}, {0xff57a0, 0xc00233a198})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000188780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0022680c0, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0022680c0, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000f8c0, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df44e01f8?, 0xc00012c8e8?}, {0xff57a0, 0xc00000f8c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000188960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc0000a3f50, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc0000a3f50, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000f7d0, {0xffc4d0, 0xc0022e25a0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0x7f9df44e01f8?, 0xc00012d1a0?}, {0xff57a0, 0xc00000f7d0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc4d0, 0xc0022e25a0}, 0xb2d05e00, {0xffa0b0, 0xc000081700}, 0xc002322ae0)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002323e60, {0xffc4d0, 0xc0022e25a0}, {0xff9470?, 0xc0000437b0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0022e25a0}, {0xff9470?, 0xc0000437b0?}, {0xff5cc0, 0xc002323e60})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc0001863f0)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 7 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 8 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc000188460)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 87 [IO wait]:
        internal/poll.runtime_pollWait(0x7f9deffcf8a8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001c4880?, 0xc002324eb0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001c4880, {0xc002324eb0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001c4880, {0xc002324eb0?, 0x10000005423fc?, 0x7f9e1e119218?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010048, {0xc002324eb0?, 0xc002263af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6520, 0xc000010048}, {0xc002324eb0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6520, 0xc000010048}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc002324ea0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6520?, 0xc000010048?}}, 0xc002324ea0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc000101e00, {0xffc150, 0xc002348700}, 0xc002324ea0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc000116410, 0xffc150?, 0xc002263ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc000116410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 88 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00236a240?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc4d0, 0xc0022e25a0}, {0xff5dc0, 0xc00224ccb0}, {0xffb1c0, 0xc0022e2930}, {0x0, 0x0, 0x0}, {0xc0022e2960, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 89 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 9 [IO wait]:
        internal/poll.runtime_pollWait(0x7f9deffcf998, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc00015b100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc00015b100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc00015b100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc0022e2930)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc4d0, 0xc0022e25a0}, {0xff5dc0, 0xc00224ccb0}, {0xffb1c0, 0xc0022e2930}, {0x0, 0x0, 0x0}, {0xc0022e2960, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 91 [IO wait]:
        internal/poll.runtime_pollWait(0x7f9deffcf7b8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001c4c80?, 0xc002324d90?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001c4c80, {0xc002324d90, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001c4c80, {0xc002324d90?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010060, {0xc002324d90?, 0x7f9e1e10f108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7f9df4631618, 0xc0001547e0}, {0xc002324d90, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7f9df4631618, 0xc0001547e0}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc002324d80})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7f9df4631618?, 0xc0001547e0?}}, 0xc002324d80)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00236a240, {0xffc150, 0xc002348800}, 0xc002324d80)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0001165b0, 0xffc150?, 0xc002261ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0001165b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 94 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0001bafd0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.07s)
FAIL

@KyleMaas
Copy link
Contributor Author

Some more failures, this time with logging the results we get back from the name check:

2022/12/11 01:21:29 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/11 01:21:29 saved identity @OwGyRwFFTPFaE7fA6NbDL12EmzSwXFQeS+khAT4PVcw=.ed25519 to testrun/TestNames/secrets/arny
2022/12/11 01:21:29 saved identity ssb:feed/gabbygrove-v1/KUf_-b6mFH6ALYo62FfhEXJJt2QX7kXwaVqSLQDdlYA= to testrun/TestNames/secrets/bert
2022/12/11 01:21:29 saved identity @Isy+HAaHFKcTm+bIB9UcXhu4EMkeUtm/FLZP0SBe760=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/11 01:21:29 saved identity @YresiToaDKrHpqUXKftRoIZmOIUDJg5IpcT7yW7BMNU=.ed25519 to testrun/TestNames/secret
2022/12/11 01:21:29 created bot
2022/12/11 01:21:29 published messages
2022/12/11 01:21:29 TODO: flush indexes
2022/12/11 01:21:29 index states: map[string]string{"abouts":"live", "combined":"live", "contacts":"live", "get":"live", "group-members":"live", "timestamps":"live"}
2022/12/11 01:21:29 client joined socket
2022/12/11 01:21:29 got names
2022/12/11 01:21:29 names to check: client.NamesGetResult{"@Isy+HAaHFKcTm+bIB9UcXhu4EMkeUtm/FLZP0SBe760=.ed25519":map[string]string{"@KUf/+b6mFH6ALYo62FfhEXJJt2QX7kXwaVqSLQDdlYA=.gabbygrove-v1":"that cloe"}, "@KUf/+b6mFH6ALYo62FfhEXJJt2QX7kXwaVqSLQDdlYA=.gabbygrove-v1":map[string]string{"@Isy+HAaHFKcTm+bIB9UcXhu4EMkeUtm/FLZP0SBe760=.ed25519":"iditot", "@KUf/+b6mFH6ALYo62FfhEXJJt2QX7kXwaVqSLQDdlYA=.gabbygrove-v1":"i'm bert!"}, "@OwGyRwFFTPFaE7fA6NbDL12EmzSwXFQeS+khAT4PVcw=.ed25519":map[string]string{"@OwGyRwFFTPFaE7fA6NbDL12EmzSwXFQeS+khAT4PVcw=.ed25519":"i'm arny!"}}
    names_test.go:132: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:132
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "that cloe"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+that cloe
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=146.134µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022551d0, 0xc0022551a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc002255200, 0xc0022551a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc0000b3a28)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc002236fc0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0000dd580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc000107200, 0xc00231b470)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc000107200, 0xc00231b5c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000164000, 0x0, 0xc00007e300)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000164000, 0x1, 0xc00007e300)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000164000, 0x2, 0xc00007e300)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc000164000, 0x3, 0xc00007e300)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 38 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc000107200, 0xc0022551a0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc002236f40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc000107200, 0xc00007e4e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 41 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0001073f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc0022552c0, 0xc00007e540)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092190)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0000923c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092460)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002220140)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002328960, {0xffc4d0, 0xc002254600}, {0x7fe1c81423f8?, 0xc00000e258?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c81423f8?, 0xc00000e258?}, {0xff5cc0, 0xc002328960})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002220280)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000092780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002329260, {0xffc4d0, 0xc002254600}, {0x7fe1c81424c0?, 0xc00012a000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c81424c0?, 0xc00012a000?}, {0xff5cc0, 0xc002329260})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002220460)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00231b770, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00231b770, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000b26c0, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c81423f8?, 0xc00000e330?}, {0xff57a0, 0xc0000b26c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002220820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00231b920, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00231b920, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000b3080, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c81423f8?, 0xc00000e3c0?}, {0xff57a0, 0xc0000b3080})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002220a00)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00231ba40, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00231ba40, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc0000b31e8, {0xffc4d0, 0xc002254600})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c81423f8?, 0xc00000e480?}, {0xff57a0, 0xc0000b31e8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 58 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc4d0, 0xc002254600}, 0xb2d05e00, {0xffa0b0, 0xc002236c80}, 0xc000033620)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 59 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002329aa0, {0xffc4d0, 0xc002254600}, {0xff9470?, 0xc002234240?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0xff9470?, 0xc002234240?}, {0xff5cc0, 0xc002329aa0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc000164380)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 6 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 7 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0022205a0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 8 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1c842e998, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000dd100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0000dd100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0000dd100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc002254990)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc4d0, 0xc002254600}, {0xff5dc0, 0xc002234cd0}, {0xffb1c0, 0xc002254990}, {0x0, 0x0, 0x0}, {0xc0022549c0, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 86 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1c842e8a8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000171a00?, 0xc002284830?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc000171a00, {0xc002284830, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc000171a00, {0xc002284830?, 0x10000005423fc?, 0x7fe1c83e2b00?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000a85b8, {0xc002284830?, 0xc000111af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6520, 0xc0000a85b8}, {0xc002284830, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6520, 0xc0000a85b8}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc002284820})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6520?, 0xc0000a85b8?}}, 0xc002284820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00218d620, {0xffc150, 0xc0021dd580}, 0xc002284820)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc00232b040, 0xffc150?, 0xc000111ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc00232b040)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 87 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00218d8c0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc4d0, 0xc002254600}, {0xff5dc0, 0xc002234cd0}, {0xffb1c0, 0xc002254990}, {0x0, 0x0, 0x0}, {0xc0022549c0, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 88 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 9 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000032360, {0xffc4d0, 0xc002254600}, {0x7fe1c83ae658?, 0xc0000a8750?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002254600}, {0x7fe1c83ae658?, 0xc0000a8750?}, {0xff5cc0, 0xc000032360})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 90 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe1c842e7b8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc000171e00?, 0xc0022846e0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc000171e00, {0xc0022846e0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc000171e00, {0xc0022846e0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000a85d8, {0xc0022846e0?, 0x7fe1efa115b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fe1c814d018, 0xc0000d98e0}, {0xc0022846e0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fe1c814d018, 0xc0000d98e0}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc0022846d0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fe1c814d018?, 0xc0000d98e0?}}, 0xc0022846d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00218d8c0, {0xffc150, 0xc0021dd680}, 0xc0022846d0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc00232b1e0, 0xffc150?, 0xc000117ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc00232b1e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 93 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc002334fd0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.09s)
FAIL

2022/12/11 01:23:31 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/11 01:23:31 saved identity @EOp7NvlL04agiuuvVb6O4pMg2MW/5RStHxFWqieO91M=.ed25519 to testrun/TestNames/secrets/arny
2022/12/11 01:23:31 saved identity ssb:feed/gabbygrove-v1/_fGc9Wokpn1-lXFIqSHWiBqN5pVQp6pjdiqYeqgPpRY= to testrun/TestNames/secrets/bert
2022/12/11 01:23:31 saved identity @6bXgWYYkIjAaHCPG3G1KnuwEmfN6Om4fHvZq/HM36aM=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/11 01:23:31 saved identity @XY2jQagp3GoSYNbu14XRyZrWMcm94okiEFmp3jd8Btg=.ed25519 to testrun/TestNames/secret
2022/12/11 01:23:31 created bot
2022/12/11 01:23:31 published messages
2022/12/11 01:23:31 TODO: flush indexes
2022/12/11 01:23:31 index states: map[string]string{"abouts":"live", "combined":"live", "contacts":"live", "get":"live", "group-members":"live", "timestamps":"live"}
2022/12/11 01:23:31 client joined socket
2022/12/11 01:23:31 got names
    names_test.go:125: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:125
        	Error:      	"map[]" should have 3 item(s), but has 0
        	Test:       	TestNames
        	Messages:   	expected entries for all three keypairs but received client.NamesGetResult{}
level=debug event=update-replicate feed-want-count=0 hops=0 took=148.539µs
    leakcheck.go:113: Leaked goroutine: goroutine 10 [IO wait]:
        internal/poll.runtime_pollWait(0x7f6d2ee65e98, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000ad100?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0000ad100)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0000ad100)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc002268c90)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc4d0, 0xc002268900}, {0xff5dc0, 0xc002264d70}, {0xffb1c0, 0xc002268c90}, {0x0, 0x0, 0x0}, {0xc002268cc0, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000124360, {0xffc4d0, 0xc002268900}, {0x7f6d2de37a18?, 0xc000010758?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2de37a18?, 0xc000010758?}, {0xff5cc0, 0xc000124360})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0022694d0, 0xc0022694a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc002269500, 0xc0022694a0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc00000f8a8)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 15 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000159000)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0000ad580)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0000dd200, 0xc002343770)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0000dd200, 0xc0023438c0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002250070, 0x0, 0xc0001aa150)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002250070, 0x1, 0xc0001aa150)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002250070, 0x2, 0xc0001aa150)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc002250070, 0x3, 0xc0001aa150)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 40 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0000dd200, 0xc0022694a0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc000158f80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0000dd200, 0xc0001aa210)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 43 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0000dd3f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc0022695c0, 0xc0001aa270)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001a8140)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001a8320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001a83c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001a8460)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002252140)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002246360, {0xffc4d0, 0xc002268900}, {0x7f6d2c15bef8?, 0xc00012e408?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2c15bef8?, 0xc00012e408?}, {0xff5cc0, 0xc002246360})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002252320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001a86e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002246300, {0xffc4d0, 0xc002268900}, {0x7f6d2c131e18?, 0xc0000a4000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2c131e18?, 0xc0000a4000?}, {0xff5cc0, 0xc002246300})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 54 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002252640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 55 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00011d560, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00011d560, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e6d8, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2c15bef8?, 0xc00012e4e0?}, {0xff57a0, 0xc00000e6d8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 56 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002252780)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 57 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00011d290, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00011d290, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000e528, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2c15bef8?, 0xc00012e570?}, {0xff57a0, 0xc00000e528})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 58 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc002252960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 59 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00011de90, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00011de90, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000efa8, {0xffc4d0, 0xc002268900})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0x7f6d2c15bef8?, 0xc00012e630?}, {0xff57a0, 0xc00000efa8})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 60 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc4d0, 0xc002268900}, 0xb2d05e00, {0xffa0b0, 0xc000158cc0}, 0xc000125740)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 61 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc002350de0, {0xffc4d0, 0xc002268900}, {0xff9470?, 0xc00011b9a0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc002268900}, {0xff9470?, 0xc00011b9a0?}, {0xff5cc0, 0xc002350de0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc002250460)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 8 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 84 [IO wait]:
        internal/poll.runtime_pollWait(0x7f6d2ee65da8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001c8700?, 0xc00234ddd0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001c8700, {0xc00234ddd0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001c8700, {0xc00234ddd0?, 0x10000005423fc?, 0x7f6d2ddfd438?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000010408, {0xc00234ddd0?, 0xc00223daf8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6520, 0xc000010408}, {0xc00234ddd0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6520, 0xc000010408}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc00234ddc0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6520?, 0xc000010408?}}, 0xc00234ddc0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0001d07e0, {0xffc150, 0xc0001c6380}, 0xc00234ddc0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc00011e1a0, 0xffc150?, 0xc00223def8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc00011e1a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 85 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0001d09c0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc4d0, 0xc002268900}, {0xff5dc0, 0xc002264d70}, {0xffb1c0, 0xc002268c90}, {0x0, 0x0, 0x0}, {0xc002268cc0, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 86 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 88 [IO wait]:
        internal/poll.runtime_pollWait(0x7f6d2ee65cb8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0001c8b00?, 0xc00234dcf0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0001c8b00, {0xc00234dcf0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0001c8b00, {0xc00234dcf0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000104b8, {0xc00234dcf0?, 0x7f6d564305b8?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7f6d2c15c040, 0xc000154ae0}, {0xc00234dcf0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7f6d2c15c040, 0xc000154ae0}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc00234dce0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7f6d2c15c040?, 0xc000154ae0?}}, 0xc00234dce0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0001d09c0, {0xffc150, 0xc0001c6480}, 0xc00234dce0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc00011e340, 0xffc150?, 0xc00223bef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc00011e340)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 9 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc002252460)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 91 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00235c7d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
--- FAIL: TestNames (10.08s)
FAIL

2022/12/11 01:26:03 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/11 01:26:03 saved identity @ZODI5cUiNw8v4il2bRHgvvzCFzc5XBCoeYlwnndWYm0=.ed25519 to testrun/TestNames/secrets/arny
2022/12/11 01:26:03 saved identity ssb:feed/gabbygrove-v1/iqCCnKKhUcVOz2lebJD9YsMi-6Nc66ZUIAOkSXm7CCw= to testrun/TestNames/secrets/bert
2022/12/11 01:26:03 saved identity @rhajSxw1XKmInaMD3eAP9U0tWOXT0ugmXp9Mlchggn8=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/11 01:26:03 saved identity @+UGHXxVzvfzkHKeray7lahi6jaVz4+MPE9Sw6IyloN0=.ed25519 to testrun/TestNames/secret
2022/12/11 01:26:03 created bot
2022/12/11 01:26:03 published messages
2022/12/11 01:26:03 TODO: flush indexes
2022/12/11 01:26:03 index states: map[string]string{"abouts":"live", "combined":"live", "contacts":"live", "get":"live", "group-members":"live", "timestamps":"live"}
2022/12/11 01:26:03 client joined socket
2022/12/11 01:26:03 got names
2022/12/11 01:26:03 names to check: client.NamesGetResult{"@ZODI5cUiNw8v4il2bRHgvvzCFzc5XBCoeYlwnndWYm0=.ed25519":map[string]string{"@ZODI5cUiNw8v4il2bRHgvvzCFzc5XBCoeYlwnndWYm0=.ed25519":"i'm arny!"}, "@iqCCnKKhUcVOz2lebJD9YsMi+6Nc66ZUIAOkSXm7CCw=.gabbygrove-v1":map[string]string{"@iqCCnKKhUcVOz2lebJD9YsMi+6Nc66ZUIAOkSXm7CCw=.gabbygrove-v1":"i'm bert!", "@rhajSxw1XKmInaMD3eAP9U0tWOXT0ugmXp9Mlchggn8=.ed25519":"iditot"}, "@rhajSxw1XKmInaMD3eAP9U0tWOXT0ugmXp9Mlchggn8=.ed25519":map[string]string{"@iqCCnKKhUcVOz2lebJD9YsMi+6Nc66ZUIAOkSXm7CCw=.gabbygrove-v1":"that cloe"}}
    names_test.go:132: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:132
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "i'm arny!"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+i'm arny!
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=371.929µs
    leakcheck.go:113: Leaked goroutine: goroutine 100 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc00016e960?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc4d0, 0xc0000f57d0}, {0xff5dc0, 0xc000089d50}, {0xffb1c0, 0xc0000f5b60}, {0x0, 0x0, 0x0}, {0xc0000f5b90, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 101 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 103 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe7003360f8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0021b7c80?, 0xc0022ac8c0?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0021b7c80, {0xc0022ac8c0, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0021b7c80, {0xc0022ac8c0?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000a81a8, {0xc0022ac8c0?, 0x7fe7279a7108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7fe7003ebd18, 0xc0000d9020}, {0xc0022ac8c0, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7fe7003ebd18, 0xc0000d9020}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc0022ac8b0})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7fe7003ebd18?, 0xc0000d9020?}}, 0xc0022ac8b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc00016e960, {0xffc150, 0xc000157640}, 0xc0022ac8b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc0023351e0, 0xffc150?, 0xc000153ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc0023351e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 106 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0022a67d0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 26 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0021a85a0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 27 [IO wait]:
        internal/poll.runtime_pollWait(0x7fe7003362d8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0021b7080?, 0x203000?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc0021b7080)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc0021b7080)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc0000f5b60)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc4d0, 0xc0000f57d0}, {0xff5dc0, 0xc000089d50}, {0xffb1c0, 0xc0000f5b60}, {0x0, 0x0, 0x0}, {0xc0000f5b90, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0000324e0, {0xffc4d0, 0xc0000f57d0}, {0x7fe7003c9b98?, 0xc0000a8298?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc0000f57d0}, {0x7fe7003c9b98?, 0xc0000a8298?}, {0xff5cc0, 0xc0000324e0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0023083c0, 0xc002308390)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc0023083f0, 0xc002308390)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc0000b3590)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 32 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00008fbc0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0021b7500)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc00219d200, 0xc002324660)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 35 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc00219d200, 0xc0023247b0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021ce000, 0x0, 0xc00007e120)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021ce000, 0x1, 0xc00007e120)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021ce000, 0x2, 0xc00007e120)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0021ce000, 0x3, 0xc00007e120)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 40 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc00219d200, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc00008fb40)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc00219d200, 0xc00007e480)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 43 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc00219d3f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc0023084b0, 0xc00007e540)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0021b2190)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0021b2370)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0021b2410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0021b24b0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6

2022/12/11 01:29:48 [margaret/indexes/badger] overwrote batch limit 0
=== RUN   TestNames
2022/12/11 01:29:48 saved identity @yss30LmlOvXaYXMT9ucsTNeTRLDgrGmIrwuNyJ1aKfk=.ed25519 to testrun/TestNames/secrets/arny
2022/12/11 01:29:48 saved identity ssb:feed/gabbygrove-v1/Dc_ZUmb4Vg6o9rRqpCOvRyPTo76HMuqLdMa-uXTgESg= to testrun/TestNames/secrets/bert
2022/12/11 01:29:48 saved identity @Kmue3owXe9TFG/i30wosh52AJgCpJ3XR2bK/q4PwYMs=.ed25519 to testrun/TestNames/secrets/cloe
2022/12/11 01:29:48 saved identity @QjneCCMf/3HdY/T/+ybXylVfUpeBWSSx4e6iVTY/fK0=.ed25519 to testrun/TestNames/secret
2022/12/11 01:29:48 created bot
2022/12/11 01:29:48 published messages
2022/12/11 01:29:48 TODO: flush indexes
2022/12/11 01:29:48 index states: map[string]string{"abouts":"live", "combined":"live", "contacts":"live", "get":"live", "group-members":"live", "timestamps":"live"}
2022/12/11 01:29:48 client joined socket
2022/12/11 01:29:48 got names
2022/12/11 01:29:48 names to check: client.NamesGetResult{"@Dc/ZUmb4Vg6o9rRqpCOvRyPTo76HMuqLdMa+uXTgESg=.gabbygrove-v1":map[string]string{"@Dc/ZUmb4Vg6o9rRqpCOvRyPTo76HMuqLdMa+uXTgESg=.gabbygrove-v1":"i'm bert!", "@Kmue3owXe9TFG/i30wosh52AJgCpJ3XR2bK/q4PwYMs=.ed25519":"iditot"}, "@Kmue3owXe9TFG/i30wosh52AJgCpJ3XR2bK/q4PwYMs=.ed25519":map[string]string{"@Dc/ZUmb4Vg6o9rRqpCOvRyPTo76HMuqLdMa+uXTgESg=.gabbygrove-v1":"that cloe"}, "@yss30LmlOvXaYXMT9ucsTNeTRLDgrGmIrwuNyJ1aKfk=.ed25519":map[string]string{"@yss30LmlOvXaYXMT9ucsTNeTRLDgrGmIrwuNyJ1aKfk=.ed25519":"i'm arny!"}}
    names_test.go:132: 
        	Error Trace:	/home/go-ssb/go-ssb/sbot/names_test.go:132
        	Error:      	Not equal: 
        	            	expected: "i'm cloe!"
        	            	actual  : "iditot"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-i'm cloe!
        	            	+iditot
        	Test:       	TestNames
        	Messages:   	did not the right common name for cloe
level=debug event=update-replicate feed-want-count=0 hops=0 took=179.668µs
    leakcheck.go:113: Leaked goroutine: goroutine 11 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0000c4150, 0x0, 0xc0022efa10)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 12 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0000c4150, 0x1, 0xc0022efa10)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 13 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0000c4150, 0x2, 0xc0022efa10)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 14 [select]:
        github.com/dgraph-io/badger/v3.(*levelsController).runCompactor(0xc0000c4150, 0x3, 0xc0022efa10)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:508 +0x30d
        created by github.com/dgraph-io/badger/v3.(*levelsController).startCompact
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/levels.go:354 +0x4e
    leakcheck.go:113: Leaked goroutine: goroutine 15 [chan receive]:
        github.com/dgraph-io/badger/v3.(*DB).flushMemtable(0xc0022e8000, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1078 +0xb2
        github.com/dgraph-io/badger/v3.Open.func5()
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:357 +0x25
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:356 +0x107c
    leakcheck.go:113: Leaked goroutine: goroutine 151 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0x1?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/client.NewUnix.func1()
        	/home/go-ssb/go-ssb/client/client.go:169 +0x4f
        created by github.com/ssbc/go-ssb/client.NewUnix
        	/home/go-ssb/go-ssb/client/client.go:168 +0x425
    leakcheck.go:113: Leaked goroutine: goroutine 16 [select]:
        github.com/dgraph-io/badger/v3.(*vlogThreshold).listenForValueThresholdUpdate(0xc00011ba00)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1172 +0x11a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:380 +0x16dc
    leakcheck.go:113: Leaked goroutine: goroutine 21 [select]:
        github.com/ssbc/go-ssb/internal/ctxutils.WithError.func2()
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:31 +0x92
        created by github.com/ssbc/go-ssb/internal/ctxutils.WithError
        	/home/go-ssb/go-ssb/internal/ctxutils/withErr.go:30 +0x1df
    leakcheck.go:113: Leaked goroutine: goroutine 22 [chan receive]:
        github.com/ssbc/go-ssb/blobstore.(*WantManager).replicateLoop(0xc0001295e0)
        	/home/go-ssb/go-ssb/blobstore/wants.go:94 +0x57
        created by github.com/ssbc/go-ssb/blobstore.NewWantManager
        	/home/go-ssb/go-ssb/blobstore/wants.go:60 +0x30a
    leakcheck.go:113: Leaked goroutine: goroutine 23 [IO wait]:
        internal/poll.runtime_pollWait(0x7f84b9ee69d8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc00011d080?, 0x203001?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Accept(0xc00011d080)
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:614 +0x22c
        net.(*netFD).accept(0xc00011d080)
        	/usr/lib/go-1.18/src/net/fd_unix.go:172 +0x35
        net.(*UnixListener).accept(0x4433c0?)
        	/usr/lib/go-1.18/src/net/unixsock_posix.go:166 +0x1c
        net.(*UnixListener).Accept(0xc00228ef00)
        	/usr/lib/go-1.18/src/net/unixsock.go:260 +0x3d
        github.com/ssbc/go-ssb/sbot.unixSockServer.accept({{0xffc4d0, 0xc00228eb70}, {0xff5dc0, 0xc00228cf20}, {0xffb1c0, 0xc00228ef00}, {0x0, 0x0, 0x0}, {0xc00228ef30, ...}, ...})
        	/home/go-ssb/go-ssb/sbot/options.go:175 +0x64
        created by github.com/ssbc/go-ssb/sbot.WithUNIXSocket.func1
        	/home/go-ssb/go-ssb/sbot/options.go:153 +0x33b
    leakcheck.go:113: Leaked goroutine: goroutine 24 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0001003c0, {0xffc4d0, 0xc00228eb70}, {0x7f84b96a2458?, 0xc000114290?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b96a2458?, 0xc000114290?}, {0xff5cc0, 0xc0001003c0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 25 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00228f740, 0xc00228f710)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 26 [select]:
        github.com/dgraph-io/badger/v3/y.(*WaterMark).process(0xc00228f770, 0xc00228f710)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:214 +0x285
        created by github.com/dgraph-io/badger/v3/y.(*WaterMark).Init
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/y/watermark.go:72 +0xaa
    leakcheck.go:113: Leaked goroutine: goroutine 27 [select]:
        github.com/dgraph-io/ristretto/z.(*AllocatorPool).freeupAllocators(0xc000111428)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:385 +0x150
        created by github.com/dgraph-io/ristretto/z.NewAllocatorPool
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/z/allocator.go:324 +0xc5
    leakcheck.go:113: Leaked goroutine: goroutine 28 [select]:
        github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00011ba80)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x91
        created by github.com/dgraph-io/ristretto.newDefaultPolicy
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x156
    leakcheck.go:113: Leaked goroutine: goroutine 29 [select]:
        github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00011d500)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x15e
        created by github.com/dgraph-io/ristretto.NewCache
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x696
    leakcheck.go:113: Leaked goroutine: goroutine 30 [select]:
        github.com/dgraph-io/badger/v3.(*DB).monitorCache(0xc0022e8000, 0xc0022ef9e0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:469 +0x18a
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:311 +0xc8b
    leakcheck.go:113: Leaked goroutine: goroutine 31 [select]:
        github.com/dgraph-io/badger/v3.(*DB).updateSize(0xc0022e8000, 0xc0022efb30)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:1171 +0x158
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:331 +0xe8c
    leakcheck.go:113: Leaked goroutine: goroutine 32 [chan receive]:
        github.com/ssbc/go-muxrpc/v2.(*rpc).Serve(0xc0001004e0?)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:336 +0x2b
        github.com/ssbc/go-ssb/sbot.unixSockServer.serve({{0xffc4d0, 0xc00228eb70}, {0xff5dc0, 0xc00228cf20}, {0xffb1c0, 0xc00228ef00}, {0x0, 0x0, 0x0}, {0xc00228ef30, ...}, ...}, ...)
        	/home/go-ssb/go-ssb/sbot/options.go:228 +0x4f9
        created by github.com/ssbc/go-ssb/sbot.unixSockServer.accept
        	/home/go-ssb/go-ssb/sbot/options.go:205 +0x51f
    leakcheck.go:113: Leaked goroutine: goroutine 33 [select]:
        context.propagateCancel.func1()
        	/usr/lib/go-1.18/src/context/context.go:279 +0x9e
        created by context.propagateCancel
        	/usr/lib/go-1.18/src/context/context.go:278 +0x1cb
    leakcheck.go:113: Leaked goroutine: goroutine 34 [select]:
        github.com/dgraph-io/badger/v3.(*DB).doWrites(0xc0022e8000, 0xc0022efb90)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:900 +0x236
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:387 +0x179c
    leakcheck.go:113: Leaked goroutine: goroutine 35 [chan receive]:
        github.com/dgraph-io/badger/v3.(*valueLog).waitOnGC(0xc0022e81f8, 0x0?)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/value.go:1079 +0x7d
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:391 +0x185b
    leakcheck.go:113: Leaked goroutine: goroutine 36 [select]:
        github.com/dgraph-io/badger/v3.(*publisher).listenForUpdates(0xc00228f830, 0xc0022efbf0)
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/publisher.go:73 +0x150
        created by github.com/dgraph-io/badger/v3.Open
        	/home/go-ssb/go/pkg/mod/github.com/dgraph-io/badger/v3@v3.2103.4/db.go:395 +0x190a
    leakcheck.go:113: Leaked goroutine: goroutine 37 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001260a0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 38 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc0001261e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 39 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000126280)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 40 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000126320)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 41 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0001283c0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 42 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000161560, {0xffc4d0, 0xc00228eb70}, {0x7f84b96c37b8?, 0xc000110210?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b96c37b8?, 0xc000110210?}, {0xff5cc0, 0xc000161560})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 43 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000128640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 44 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*MultiLog).writeBatches(0xc000126640)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:46 +0x8e
        created by github.com/ssbc/margaret/multilog/roaring.NewStore
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/multilog.go:40 +0x1b6
    leakcheck.go:113: Leaked goroutine: goroutine 45 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc000161a40, {0xffc4d0, 0xc00228eb70}, {0x7f84b8897058?, 0xc00013c000?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b8897058?, 0xc00013c000?}, {0xff5cc0, 0xc000161a40})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 46 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc0001286e0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 47 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00015e750, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00015e750, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000fd10, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b96c37b8?, 0xc000110b10?}, {0xff57a0, 0xc00000fd10})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 48 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000128960)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 49 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00015e630, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00015e630, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000fc50, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b96c37b8?, 0xc000110ba0?}, {0xff57a0, 0xc00000fc50})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 50 [select]:
        github.com/ssbc/margaret/indexes/badger.(*index).writeBatches(0xc000128d20)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:178 +0xa7
        created by github.com/ssbc/margaret/indexes/badger.newIndex
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/indexes/badger/index.go:102 +0x2a5
    leakcheck.go:113: Leaked goroutine: goroutine 51 [select]:
        github.com/ssbc/margaret/multilog/roaring.(*query).livequery(0xc00015e1e0, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:158 +0xe7
        github.com/ssbc/margaret/multilog/roaring.(*query).Next(0xc00015e1e0, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/multilog/roaring/qry.go:126 +0x328
        github.com/ssbc/go-luigi/mfr.(*srcMap).Next(0xc00000fa10, {0xffc4d0, 0xc00228eb70})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/mfr/map.go:58 +0x33
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0x7f84b96c37b8?, 0xc000110c60?}, {0xff57a0, 0xc00000fa10})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:60 +0xac
        github.com/ssbc/go-ssb/sbot.(*Sbot).serveIndexFrom.func1()
        	/home/go-ssb/go-ssb/sbot/indexes.go:204 +0xa07
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:75 +0x64
        created by golang.org/x/sync/errgroup.(*Group).Go
        	/home/go-ssb/go/pkg/mod/golang.org/x/sync@v0.1.0/errgroup/errgroup.go:72 +0xa5
    leakcheck.go:113: Leaked goroutine: goroutine 52 [select]:
        github.com/ssbc/go-ssb/sbot.debounce({0xffc4d0, 0xc00228eb70}, 0xb2d05e00, {0xffa0b0, 0xc00011b740}, 0xc0022fc7e0)
        	/home/go-ssb/go-ssb/sbot/replicate.go:135 +0x16c
        created by github.com/ssbc/go-ssb/sbot.(*Sbot).newGraphReplicator
        	/home/go-ssb/go-ssb/sbot/replicate.go:73 +0x3c5
    leakcheck.go:113: Leaked goroutine: goroutine 53 [select]:
        github.com/ssbc/margaret/offset2.(*offsetQuery).Push(0xc0022fdda0, {0xffc4d0, 0xc00228eb70}, {0xff9470?, 0xc000113dc0?})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/margaret@v0.4.4-0.20221101112304-4f5815095ef3/offset2/qry.go:202 +0xc9
        github.com/ssbc/go-luigi.Pump({0xffc4d0, 0xc00228eb70}, {0xff9470?, 0xc000113dc0?}, {0xff5cc0, 0xc0022fdda0})
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-luigi@v0.3.7-0.20221019204020-324065b9a7c6/stream.go:56 +0x82
        github.com/ssbc/go-ssb/plugins/gossip.(*FeedManager).serveLiveFeeds(0xc002282460)
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:106 +0x168
        created by github.com/ssbc/go-ssb/plugins/gossip.NewFeedManager
        	/home/go-ssb/go-ssb/plugins/gossip/feed_manager.go:69 +0x1ea
    leakcheck.go:113: Leaked goroutine: goroutine 80 [IO wait]:
        internal/poll.runtime_pollWait(0x7f84b9ee67f8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc0000ed200?, 0xc0021ea570?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc0000ed200, {0xc0021ea570, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc0000ed200, {0xc0021ea570?, 0x10000005423fc?, 0x7f84b9f03248?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc000114430, {0xc0021ea570?, 0xc0021a3af8?, 0x44fef2?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0xff6520, 0xc000114430}, {0xc0021ea570, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0xff6520, 0xc000114430}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc0021ea564})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0xff6520?, 0xc000114430?}}, 0xc0021ea564)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc000161b00, {0xffc150, 0xc0000ef700}, 0xc0021ea564)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc002316ea0, 0xffc150?, 0xc0021a3ef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc002316ea0)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
    leakcheck.go:113: Leaked goroutine: goroutine 83 [IO wait]:
        internal/poll.runtime_pollWait(0x7f84b9ee68e8, 0x72)
        	/usr/lib/go-1.18/src/runtime/netpoll.go:302 +0x89
        internal/poll.(*pollDesc).wait(0xc007940080?, 0xc0021ea420?, 0x0)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:83 +0x32
        internal/poll.(*pollDesc).waitRead(...)
        	/usr/lib/go-1.18/src/internal/poll/fd_poll_runtime.go:88
        internal/poll.(*FD).Read(0xc007940080, {0xc0021ea420, 0x9, 0x9})
        	/usr/lib/go-1.18/src/internal/poll/fd_unix.go:167 +0x25a
        net.(*netFD).Read(0xc007940080, {0xc0021ea420?, 0x38?, 0x40f845?})
        	/usr/lib/go-1.18/src/net/fd_posix.go:55 +0x29
        net.(*conn).Read(0xc0000100b8, {0xc0021ea420?, 0x7f84e24ce108?, 0x10?})
        	/usr/lib/go-1.18/src/net/net.go:183 +0x45
        io.ReadAtLeast({0x7f84b89f3d48, 0xc007942060}, {0xc0021ea420, 0x9, 0x9}, 0x9)
        	/usr/lib/go-1.18/src/io/io.go:331 +0x9a
        io.ReadFull(...)
        	/usr/lib/go-1.18/src/io/io.go:350
        encoding/binary.Read({0x7f84b89f3d48, 0xc007942060}, {0xfff2e8, 0x15972e8}, {0xd3a9e0?, 0xc0021ea410})
        	/usr/lib/go-1.18/src/encoding/binary/binary.go:256 +0xc3e
        github.com/ssbc/go-muxrpc/v2/codec.Reader.ReadHeader({{0x7f84b89f3d48?, 0xc007942060?}}, 0xc0021ea410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/codec/reader.go:48 +0x45
        github.com/ssbc/go-muxrpc/v2.(*Packer).NextHeader(0xc0001004e0, {0xffc150, 0xc007958040}, 0xc0021ea410)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/packer.go:49 +0xcb
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve.func2(0xc000124000, 0xffc150?, 0xc0021ddef8)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:359 +0x5e
        github.com/ssbc/go-muxrpc/v2.(*rpc).serve(0xc000124000)
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:378 +0x19c
        github.com/ssbc/go-muxrpc/v2.Handle.func2()
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:128 +0x25
        created by github.com/ssbc/go-muxrpc/v2.Handle
        	/home/go-ssb/go/pkg/mod/github.com/ssbc/go-muxrpc/v2@v2.0.14-0.20221111190521-10382533750c/rpc_server.go:127 +0x536
--- FAIL: TestNames (10.09s)
FAIL

@KyleMaas
Copy link
Contributor Author

If you disable live index mode on sbot construction, the test consistently fails.

@KyleMaas
Copy link
Contributor Author

Okay, so I think I've found part of the problem. The idxInSync flag is cleared at this point in the execution, when the index is set up and before any messages have been added to it:

go-ssb/sbot/indexes.go

Line 187 in 3d08227

s.idxInSync.Done()

The problem is that when the messages are actually processed is here:

go-ssb/sbot/indexes.go

Line 202 in 3d08227

err = luigi.Pump(s.rootCtx, snk, src)

But while new messages are being processed, idxInSync is not set again, which means that there's no way to resynchronize the test with the state of the indexes. What needs to happen, I think, is for that flag to be set upon ingestion of a new message and cleared when all indexes have finished processing the message. That way, the test process could actually wait for the indexes to catch up (what WaitUntilIndexesAreSynced is supposed to do).

@KyleMaas KyleMaas mentioned this issue Dec 12, 2022
Closed
@decentral1se
Copy link
Member

Sensational Debugging Praxis @KyleMaas! Will dive into this later today 🥳

@KyleMaas KyleMaas mentioned this issue Dec 12, 2022
Closed
@KyleMaas
Copy link
Contributor Author

@decentral1se

You can take a look at the code I was working with to generate those messages, so you can see where they're coming from, here:

#255

@decentral1se decentral1se moved this from In Progress to TODO in 🚧 go-ssb maintenance 🚧 Dec 13, 2022
@decentral1se decentral1se moved this from TODO to Need Help in 🚧 go-ssb maintenance 🚧 Dec 13, 2022
@decentral1se decentral1se moved this from Need Help to In Progress in 🚧 go-ssb maintenance 🚧 Dec 13, 2022
@decentral1se decentral1se mentioned this issue Dec 18, 2022
Open
25 tasks
@decentral1se decentral1se moved this from In Progress to TODO in 🚧 go-ssb maintenance 🚧 Jan 10, 2023
@decentral1se decentral1se moved this from TODO to Prioritised in 🚧 go-ssb maintenance 🚧 Jan 10, 2023
@KyleMaas KyleMaas mentioned this issue Jan 16, 2023
Merged
@decentral1se
Copy link
Member

#301

@github-project-automation github-project-automation bot moved this from Prioritised to Done in 🚧 go-ssb maintenance 🚧 Jan 19, 2023
@decentral1se
Copy link
Member

decentral1se commented Jan 19, 2023 •
edited
Loading

@KyleMaas seems to be back on the blink https://github.com/ssbc/go-ssb/actions/runs/3962165347 🤔

@decentral1se decentral1se reopened this Jan 19, 2023
@decentral1se decentral1se moved this from Done to Prioritised in 🚧 go-ssb maintenance 🚧 Jan 19, 2023
@KyleMaas
Copy link
Contributor Author

@decentral1se Yeah, I don't think I ever actually added the line to make the test wait for the indexes to catch up.

@KyleMaas
Copy link
Contributor Author

Huh. No, the line is in there. I'll see if I can figure out what's going on.

@KyleMaas
Copy link
Contributor Author

@decentral1se So...I've run this over 1500 times now with no failures. I'm not sure what would be different between the CI system and running it locally. About the only thing I can think of is maybe it hit that race condition in Margaret I was talking about over in #293 (comment)

@decentral1se
Copy link
Member

@KyleMaas yeh I can't seem to get a failure out of it and since it seems to be the original failure I also have a hunch it is CI caching? I will bust the cache and run the build again and see what happens. Let's keep this one for now anyway pending this and the Margaret thread... this test failure is putting up a real fight 😅

@KyleMaas
Copy link
Contributor Author

@decentral1se

I think I found a way for this to still be happening. WaitGroups can stop waiting as soon as the last lock is held. Well, let's say you've got one index left that's still not done. For each message it processes, it Adds and Dones the WaitGroup. Problem is, if it's the last one left, something waiting on indexes to be synced will be allowed to proceed as soon as really any message is processed by the index. I've got a fix for it in progress.

@KyleMaas KyleMaas mentioned this issue Jan 27, 2023
Merged
@github-project-automation github-project-automation bot moved this from Prioritised to Done in 🚧 go-ssb maintenance 🚧 Jan 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
testing
Projects
🚧 go-ssb maintenance 🚧
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix multiple index concurrency issues KyleMaas/go-ssb
2 participants
@decentral1se @KyleMaas