jimzah/dendrite
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
d56a5a6509
dendrite/go.mod

50 lines
2.1 KiB
Modula-2
Raw Normal View History

use go module for dependencies (#594)
2019-05-21 21:56:55 +01:00
module github.com/matrix-org/dendrite
require (
Don't use more than 999 variables in SQLite querys. (#1425) * Don't use more than 999 variables in SQLite querys. Solve this problem in a more general and reusable way. Also fix #1369 Add some unit tests. Signed-off-by: Henrik Sölver <henrik.solver@gmail.com> * Don't rely on testify for basic assertions * Readability improvements and linting Co-authored-by: Henrik Sölver <henrik.solver@gmail.com>
2020-09-14 16:39:38 +01:00
github.com/DATA-DOG/go-sqlmock v1.5.0
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/Shopify/sarama v1.27.0
bump go-http-js-libp2p
2020-05-18 18:12:11 +01:00
github.com/codahale/hdrhistogram v0.0.0-20161010025455-3a0bb77429bd // indirect
Yggdrasil-based P2P demo (#1108) * Initial work on Yggdrasil demo * Muxing? * Yamux * Updates to yamux * Updates * Comments * Update to use monolith stuff * Update go.mod/go.sum * Set defaults * Tweaks * Update yggdrasil * Update config * MarshalIndent * Change default instance name/port * add -peer switch * gocyclo, for a change * Determinate yamux roles * Fix copyright notices * Remove HTTP API checks as always false, remove unused topic
2020-06-10 10:54:06 +01:00
github.com/gologme/log v1.2.0
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/gorilla/mux v1.8.0
Add peer-to-peer support into Dendrite via libp2p and fetch (#880) * Use a fork of pq which supports userCurrent on wasm * Use sqlite3_js driver when running in JS * Add cmd/dendritejs to pull in sqlite3_js driver for wasm only * Update to latest go-sqlite-js version * Replace prometheus with a stub. sigh * Hard-code a config and don't use opentracing * Latest go-sqlite3-js version * Generate a key for now * Listen for fetch traffic rather than HTTP * Latest hacks for js * libp2p support * More libp2p * Fork gjson to allow us to enforce auth checks as before Previously, all events would come down redacted because the hash checks would fail. They would fail because sjson.DeleteBytes didn't remove keys not used for hashing. This didn't work because of a build tag which included a file which no-oped the index returned. See https://github.com/tidwall/gjson/issues/157 When it's resolved, let's go back to mainline. * Use gjson@1.6.0 as it fixes https://github.com/tidwall/gjson/issues/157 * Use latest gomatrixserverlib for sig checks * Fix a bug which could cause exclude_from_sync to not be set Caused when sending events over federation. * Use query variadic to make lookups actually work! * Latest gomatrixserverlib * Add notes on getting p2p up and running Partly so I don't forget myself! * refactor: Move p2p specific stuff to cmd/dendritejs This is important or else the normal build of dendrite will fail because the p2p libraries depend on syscall/js which doesn't work on normal builds. Also, clean up main.go to read a bit better. * Update ho-http-js-libp2p to return errors from RoundTrip * Add an LRU cache around the key DB We actually need this for P2P because otherwise we can *segfault* with things like: "runtime: unexpected return pc for runtime.handleEvent" where the event is a `syscall/js` event, caused by spamming sql.js caused by "Checking event signatures for 14 events of room state" which hammers the key DB repeatedly in quick succession. Using a cache fixes this, though the underlying cause is probably a bug in the version of Go I'm on (1.13.7) * breaking: Add Tracing.Enabled to toggle whether we do opentracing Defaults to false, which is why this is a breaking change. We need this flag because WASM builds cannot do opentracing. * Start adding conditional builds for wasm to handle lib/pq The general idea here is to have the wasm build have a `NewXXXDatabase` that doesn't import any postgres package and hence we never import `lib/pq`, which doesn't work under WASM (undefined `userCurrent`). * Remove lib/pq for wasm for syncapi * Add conditional building to remaining storage APIs * Update build script to set env vars correctly for dendritejs * sqlite bug fixes * Docs * Add a no-op main for dendritejs when not building under wasm * Use the real prometheus, even for WASM Instead, the dendrite-sw.js must mock out `process.pid` and `fs.stat` - which must invoke the callback with an error (e.g `EINVAL`) in order for it to work: ``` global.process = { pid: 1, }; global.fs.stat = function(path, cb) { cb({ code: "EINVAL", }); } ``` * Linting
2020-03-06 10:23:55 +00:00
github.com/hashicorp/golang-lru v0.5.4
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/lib/pq v1.8.0
github.com/libp2p/go-libp2p v0.11.0
github.com/libp2p/go-libp2p-circuit v0.3.1
github.com/libp2p/go-libp2p-core v0.6.1
WIP: Add libp2p-go (#956) * Add libp2p-go * Some tweaks, tidying up (cherry picked from commit 1a5bb121f8121c4f68a27abbf25a9a35a1b7c63e) * Move p2p dockerfile (cherry picked from commit 8d3bf44ea1bf37f950034e73bcdc315afdabe79a) * Remove containsBackwardsExtremity * Fix some linter errors, update some libp2p packages/calls, other tidying up * Add -port for dendrite-p2p-demo * Use instance name as key ID * Remove P2P demo docker stuff, no longer needed now that we have SQLite * Remove Dockerfile-p2p too * Remove p2p logic from dendrite-monolith-server * Inject publicRoomsDB in publicroomsapi Inject publicRoomsDB instead of switching on base.libP2P. See: https://github.com/matrix-org/dendrite/pull/956/files?file-filters%5B%5D=.go#r406276914 * Fix lint warning * Extract mDNSListener from base.go * Extract CreateFederationClient into demo * Create P2PDendrite from BaseDendrite Extract logic specific to P2PDendrite from base.go * Set base.go to upstream/master * Move pubsub to demo cmd * Move PostgreswithDHT to cmd * Remove unstable features * Add copyrights * Move libp2pvalidator into p2pdendrite * Rename dendrite-p2p-demo -> dendrite-demo-libp2p * Update copyrights * go mod tidy Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2020-04-14 16:15:59 +01:00
github.com/libp2p/go-libp2p-gostream v0.2.1
github.com/libp2p/go-libp2p-http v0.1.5
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/libp2p/go-libp2p-kad-dht v0.9.0
github.com/libp2p/go-libp2p-pubsub v0.3.5
github.com/libp2p/go-libp2p-record v0.1.3
github.com/libp2p/go-yamux v1.3.9 // indirect
Revert "Update quic-go" This reverts commit 93c3f1a7b3f0dbd9db8118a16701d63aab17a3ed.
2020-12-02 17:03:36 +00:00
github.com/lucas-clemente/quic-go v0.17.3
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/matrix-org/dugong v0.0.0-20180820122854-51a565b5666b
bump go-http-js-libp2p
2020-05-18 18:12:11 +01:00
github.com/matrix-org/go-http-js-libp2p v0.0.0-20200518170932-783164aeeda4
dendritejs tweaks for persisting sqlite DBs (#1058) * Use uri.path so we don't have file: in the filename * New go-sqlite-js version
2020-05-22 12:28:48 +01:00
github.com/matrix-org/go-sqlite3-js v0.0.0-20200522092705-bc8506ccbcf3
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/matrix-org/gomatrix v0.0.0-20200827122206-7dd5e2a05bcd
Fix well-known lookups
2021-01-28 13:25:45 +00:00
github.com/matrix-org/gomatrixserverlib v0.0.0-20210128131744-c803b6ee2b68
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/matrix-org/naffka v0.0.0-20200901083833-bcdd62999a91
Tweak log levels of some federation logging (#1248) * Tweak log levels of some federation logging * Update go.mod/go.sum for matrix-org/util#22 and matrix-org/gomatrixserverlib#215
2020-08-07 15:00:23 +01:00
github.com/matrix-org/util v0.0.0-20200807132607-55161520e1d4
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/mattn/go-sqlite3 v1.14.2
github.com/nfnt/resize v0.0.0-20180221191011-83c6a9932646
Add SQL tracing via DENDRITE_TRACE_SQL (#968) * Add SQL tracing via DENDRITE_TRACE_SQL Add this to `internal/sqlutil` in preparation for #897 * Not entirely
2020-04-16 10:06:55 +01:00
github.com/ngrok/sqlmw v0.0.0-20200129213757-d5c93a81bec6
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/opentracing/opentracing-go v1.2.0
WIP: Add libp2p-go (#956) * Add libp2p-go * Some tweaks, tidying up (cherry picked from commit 1a5bb121f8121c4f68a27abbf25a9a35a1b7c63e) * Move p2p dockerfile (cherry picked from commit 8d3bf44ea1bf37f950034e73bcdc315afdabe79a) * Remove containsBackwardsExtremity * Fix some linter errors, update some libp2p packages/calls, other tidying up * Add -port for dendrite-p2p-demo * Use instance name as key ID * Remove P2P demo docker stuff, no longer needed now that we have SQLite * Remove Dockerfile-p2p too * Remove p2p logic from dendrite-monolith-server * Inject publicRoomsDB in publicroomsapi Inject publicRoomsDB instead of switching on base.libP2P. See: https://github.com/matrix-org/dendrite/pull/956/files?file-filters%5B%5D=.go#r406276914 * Fix lint warning * Extract mDNSListener from base.go * Extract CreateFederationClient into demo * Create P2PDendrite from BaseDendrite Extract logic specific to P2PDendrite from base.go * Set base.go to upstream/master * Move pubsub to demo cmd * Move PostgreswithDHT to cmd * Remove unstable features * Add copyrights * Move libp2pvalidator into p2pdendrite * Rename dendrite-p2p-demo -> dendrite-demo-libp2p * Update copyrights * go mod tidy Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2020-04-14 16:15:59 +01:00
github.com/pkg/errors v0.9.1
Add support for database migrations (#1416) * Add support for database migrations Closes #1246 This PR does NOT add any migrations as an example. I have manually tested that the library works with SQL and Go based upgrades correctly. Documentation should be sufficient for devs to add migrations. * Clarifications * Linting
2020-09-10 15:10:32 +01:00
github.com/pressly/goose v2.7.0-rc5+incompatible
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/prometheus/client_golang v1.7.1
MSC2836 threading: part 2 (#1596) * Update GMSL * Add MSC2836EventRelationships to fedsender * Call MSC2836EventRelationships in reqCtx * auth remote servers * Extract room ID and servers from previous events; refactor a bit * initial cut of federated threading * Use the right client/fed struct in the response * Add QueryAuthChain for use with MSC2836 * Add auth chain to federated response * Fix pointers * under CI: more logging and enable mscs, nil fix * Handle direction: up * Actually send message events to the roomserver.. * Add children and children_hash to unsigned, with tests * Add logic for exploring threads and tracking children; missing storage functions * Implement storage functions for children * Add fetchUnknownEvent * Do federated hits for include_children if we have unexplored children * Use /ev_rel rather than /event as the former includes child metadata * Remove cross-room threading impl * Enable MSC2836 in the p2p demo * Namespace mscs db * Enable msc2836 for ygg Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2020-12-04 14:11:01 +00:00
github.com/sirupsen/logrus v1.7.0
Implement MSC2946 over federation (#1722) * Add fedsender dep on msc2946 * Add MSC2946Spaces to fsAPI * Add exclude_rooms impl * Implement fed spaces handler * Use stripped state not room version * Call federated spaces at the right time
2021-01-19 17:14:25 +00:00
github.com/tidwall/gjson v1.6.7
github.com/tidwall/sjson v1.1.4
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
github.com/uber/jaeger-client-go v2.25.0+incompatible
github.com/uber/jaeger-lib v2.2.0+incompatible
Yggdrasil demo tweaks
2020-10-06 10:37:52 +01:00
github.com/yggdrasil-network/yggdrasil-go v0.3.15-0.20201006093556-760d9a7fd5ee
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
go.uber.org/atomic v1.6.0
Implement MSC2946 over federation (#1722) * Add fedsender dep on msc2946 * Add MSC2946Spaces to fsAPI * Add exclude_rooms impl * Implement fed spaces handler * Use stripped state not room version * Call federated spaces at the right time
2021-01-19 17:14:25 +00:00
golang.org/x/crypto v0.0.0-20201221181555-eec23a3978ad
Revert "Update quic-go" This reverts commit 93c3f1a7b3f0dbd9db8118a16701d63aab17a3ed.
2020-12-02 17:03:36 +00:00
golang.org/x/net v0.0.0-20200528225125-3c3fba18258b
Peeking over federation via MSC2444 (#1391) * a very very WIP first cut of peeking via MSC2753. doesn't yet compile or work. needs to actually add the peeking block into the sync response. checking in now before it gets any bigger, and to gather any initial feedback on the vague shape of it. * make PeekingDeviceSet private * add server_name param * blind stab at adding a `peek` section to /sync * make it build * make it launch * add peeking to getResponseWithPDUsForCompleteSync * cancel any peeks when we join a room * spell out how to runoutside of docker if you want speed * fix SQL * remove unnecessary txn for SelectPeeks * fix s/join/peek/ cargocult fail * HACK: Track goroutine IDs to determine when we write by the wrong thread To use: set `DENDRITE_TRACE_SQL=1` then grep for `unsafe` * Track partition offsets and only log unsafe for non-selects * Put redactions in the writer goroutine * Update filters on writer goroutine * wrap peek storage in goid hack * use exclusive writer, and MarkPeeksAsOld more efficiently * don't log ascii in binary at sql trace... * strip out empty roomd deltas * re-add txn to SelectPeeks * re-add accidentally deleted field * reject peeks for non-worldreadable rooms * move perform_peek * fix package * correctly refactor perform_peek * WIP of implementing MSC2444 * typo * Revert "Merge branch 'kegan/HACK-goid-sqlite-db-is-locked' into matthew/peeking" This reverts commit 3cebd8dbfbccdf82b7930b7b6eda92095ca6ef41, reversing changes made to ed4b3a58a7855acc43530693cc855b439edf9c7c. * (almost) make it build * clean up bad merge * support SendEventWithState with optional event * fix build & lint * fix build & lint * reinstate federated peeks in the roomserver (doh) * fix sql thinko * todo for authenticating state returned by /peek * support returning current state from QueryStateAndAuthChain * handle SS /peek * reimplement SS /peek to prod the RS to tell the FS about the peek * rename RemotePeeks as OutboundPeeks * rename remote_peeks_table as outbound_peeks_table * add perform_handle_remote_peek.go * flesh out federation doc * add inbound peeks table and hook it up * rename ambiguous RemotePeek as InboundPeek * rename FSAPI's PerformPeek as PerformOutboundPeek * setup inbound peeks db correctly * fix api.SendEventWithState with no event * track latestevent on /peek * go fmt * document the peek send stream race better * fix SendEventWithRewrite not to bail if handed a non-state event * add fixme * switch SS /peek to use SendEventWithRewrite * fix comment * use reverse topo ordering to find latest extrem * support postgres for federated peeking * go fmt * back out bogus go.mod change * Fix performOutboundPeekUsingServer * Fix getAuthChain -> GetAuthChain * Fix build issues * Fix build again * Fix getAuthChain -> GetAuthChain * Don't repeat outbound peeks for the same room ID to the same servers * Fix lint * Don't omitempty to appease sytest Co-authored-by: Kegan Dougal <kegan@matrix.org> Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2021-01-22 14:55:08 +00:00
golang.org/x/sys v0.0.0-20210119212857-b64e53b001e4 // indirect
Update dependencies (#1372) * Other updates * Update naffka * naffka not indirect * Revert quic-go
2020-09-01 10:20:31 +01:00
gopkg.in/h2non/bimg.v1 v1.1.4
Configuration format v1 (#1230) * Initial pass at refactoring config (not finished) * Don't forget current state and EDU servers * More shifting around * Update server key API tests * Fix roomserver test * Fix more tests * Further tweaks * Fix current state server test (sort of) * Maybe fix appservices * Fix client API test * Include database connection string in database options * Fix sync API build * Update config test * Fix unit tests * Fix federation sender build * Fix gobind build * Set Listen address for all services in HTTP monolith mode * Validate config, reinstate appservice derived in directory, tweaks * Tweak federation API test * Set MaxOpenConnections/MaxIdleConnections to previous values * Update generate-config
2020-08-10 14:18:04 +01:00
gopkg.in/yaml.v2 v2.3.0
use go module for dependencies (#594)
2019-05-21 21:56:55 +01:00
)
Replace deprecated prometheus.InstrumentHandler and unsafe time.Ticker
2019-12-17 16:47:45 +00:00
go 1.13
Reference in New Issue Copy Permalink