]> git.bitcoin.ninja Git - rapid-gossip-sync-server/log
rapid-gossip-sync-server
16 months agoBuild reminder updates with correct SCID field
Matt Corallo [Sun, 2 Jul 2023 17:17:07 +0000 (17:17 +0000)]
Build reminder updates with correct SCID field

When the reminder updates were added, a dummy `ChannelUpdate` with
a number of zero'd fields were created under the assumption that
the zero'd fields would be ignored downstream when building
serialized updates. However, the SCID field was `assert`'ed on (and
serialized in the update), causing any reminder updates to cause an
assertion panic.

Instead, we do it the Right Way (tm) here and move the
only-sometimes-available fields into the update type enum, ensuring
we can't access "poison" fields downstream.

16 months agoLet postgres filter timestamps rather than doing it in Rust
Matt Corallo [Sun, 2 Jul 2023 16:12:25 +0000 (16:12 +0000)]
Let postgres filter timestamps rather than doing it in Rust

16 months agoFix query compat with Postgres 13
Matt Corallo [Sun, 2 Jul 2023 16:13:26 +0000 (16:13 +0000)]
Fix query compat with Postgres 13

...which requires DISTINCT ON to match the start of ORDER BY.

16 months agoClean up SQL query formatting to make them somewhat more readable
Matt Corallo [Sun, 2 Jul 2023 17:39:35 +0000 (17:39 +0000)]
Clean up SQL query formatting to make them somewhat more readable

16 months agoReduce data loaded from the `channel_update` table when not needed
Matt Corallo [Sun, 2 Jul 2023 16:02:11 +0000 (16:02 +0000)]
Reduce data loaded from the `channel_update` table when not needed

16 months agoMerge pull request #39 from arik-so/2023-06-announcement_inclusion_fixes
Matt Corallo [Sun, 2 Jul 2023 15:52:53 +0000 (15:52 +0000)]
Merge pull request #39 from arik-so/2023-06-announcement_inclusion_fixes

Announcement inclusion fixes & reminders

16 months agoMerge pull request #40 from arik-so/2023-06-0.0.115
Matt Corallo [Wed, 28 Jun 2023 15:03:27 +0000 (15:03 +0000)]
Merge pull request #40 from arik-so/2023-06-0.0.115

Update lightning to 0.0.115

16 months agoOmit reminders for channels with incomplete data.
Arik Sosman [Tue, 27 Jun 2023 20:56:56 +0000 (16:56 -0400)]
Omit reminders for channels with incomplete data.

16 months agoCreate dummy flags without secondary lookup query.
Arik Sosman [Tue, 27 Jun 2023 20:51:56 +0000 (16:51 -0400)]
Create dummy flags without secondary lookup query.

16 months agoSend reminders for stale-ish channels.
Arik Sosman [Tue, 27 Jun 2023 19:58:12 +0000 (15:58 -0400)]
Send reminders for stale-ish channels.

16 months agoFix first update lookup.
Arik Sosman [Tue, 27 Jun 2023 19:57:37 +0000 (15:57 -0400)]
Fix first update lookup.

16 months agoUpdate to 0.0.115.
Arik Sosman [Tue, 27 Jun 2023 20:26:15 +0000 (16:26 -0400)]
Update to 0.0.115.

17 months agoMerge pull request #38 from TheBlueMatt/main
Matt Corallo [Mon, 12 Jun 2023 18:19:58 +0000 (18:19 +0000)]
Merge pull request #38 from TheBlueMatt/main

Removed unused_mut rejection and fix some unused `mut`s

17 months agoRemoved unused_mut rejection and fix some unused `mut`s
Matt Corallo [Mon, 5 Jun 2023 23:26:38 +0000 (23:26 +0000)]
Removed unused_mut rejection and fix some unused `mut`s

Making warnings a hard failure is generally bad practice as it can
result in new compiler versions failing to compile
otherwise-totally-acceptable code, which in this case is happening
on rustc beta, which is now warning for new cases of unused mut.

17 months agoMerge pull request #37 from marctyndel/configurable-caches-path
Matt Corallo [Mon, 5 Jun 2023 23:24:38 +0000 (23:24 +0000)]
Merge pull request #37 from marctyndel/configurable-caches-path

optionally set path for caches from env

17 months agoquick fix to be able to set the caches path via env variables like we do for the...
Marc Tyndel [Mon, 5 Jun 2023 17:54:51 +0000 (13:54 -0400)]
quick fix to be able to set the caches path via env variables like we do for the DB and bitcoind configuration

18 months agoMerge pull request #35 from andrei-21/fix/dummy-symlink
Matt Corallo [Tue, 16 May 2023 19:34:20 +0000 (19:34 +0000)]
Merge pull request #35 from andrei-21/fix/dummy-symlink

Fix dummy symlink

18 months agoFix dummy symlink
Andrei [Tue, 16 May 2023 00:00:00 +0000 (00:00 +0000)]
Fix dummy symlink

The commit changes the symlink for the snapshot for the current date
from `./res/snapshots_pending/empty_delta.lngossip` to
`../snapshots/empty_delta.lngossip` such that nginx does not
retrun 404, but 200 with the dummy snapshot

18 months agoMerge pull request #29 from arik-so/2023-04-empty-blob-generator
Matt Corallo [Sat, 6 May 2023 23:57:09 +0000 (23:57 +0000)]
Merge pull request #29 from arik-so/2023-04-empty-blob-generator

Create a utility method to generate noöp RGS blobs.

18 months agoCreate a utility method to generate noöp RGS blobs.
Arik Sosman [Tue, 4 Apr 2023 23:20:58 +0000 (16:20 -0700)]
Create a utility method to generate noöp RGS blobs.

18 months agoMerge pull request #31 from benthecarman/ignore-cargo-lock
Matt Corallo [Mon, 24 Apr 2023 17:34:22 +0000 (17:34 +0000)]
Merge pull request #31 from benthecarman/ignore-cargo-lock

Include Cargo.lock file

19 months agoRemove need to pin deps
benthecarman [Sat, 15 Apr 2023 19:30:31 +0000 (14:30 -0500)]
Remove need to pin deps

19 months agoMerge pull request #21 from jurvis/jurvis/2022-11-rgs-docker-compose
Matt Corallo [Mon, 3 Apr 2023 23:12:32 +0000 (23:12 +0000)]
Merge pull request #21 from jurvis/jurvis/2022-11-rgs-docker-compose

Create a docker-compose for running an RGS server

20 months agoMerge pull request #25 from TheBlueMatt/main
Arik [Sat, 18 Mar 2023 13:56:29 +0000 (06:56 -0700)]
Merge pull request #25 from TheBlueMatt/main

Update to LDK 0.0.114

20 months agoWrite an `update_time.txt` file out to make monitoring simpler
Matt Corallo [Wed, 15 Mar 2023 17:52:13 +0000 (17:52 +0000)]
Write an `update_time.txt` file out to make monitoring simpler

20 months agoDelay prior to reconnecting peers that have disconnected
Matt Corallo [Tue, 28 Feb 2023 18:14:22 +0000 (18:14 +0000)]
Delay prior to reconnecting peers that have disconnected

20 months agoCall `PeerManager::timer_tick_occurred` regularly to ping peers
Matt Corallo [Wed, 8 Feb 2023 16:59:09 +0000 (16:59 +0000)]
Call `PeerManager::timer_tick_occurred` regularly to ping peers

20 months agoUpgrade to latest lightning crate, switching to async chain resolution
Matt Corallo [Wed, 8 Feb 2023 16:58:06 +0000 (16:58 +0000)]
Upgrade to latest lightning crate, switching to async chain resolution

20 months agoStop pruning the network graph on startup
Matt Corallo [Wed, 8 Feb 2023 16:55:23 +0000 (16:55 +0000)]
Stop pruning the network graph on startup

There's not a lot of reason for this and better to keep things
around until we go to build the gossip output

21 months agoMerge pull request #26 from andrei-21/feature/configure-network
Matt Corallo [Thu, 9 Feb 2023 00:08:30 +0000 (00:08 +0000)]
Merge pull request #26 from andrei-21/feature/configure-network

21 months agoMerge pull request #24 from andrei-21/feature/configure-peers
Arik [Wed, 8 Feb 2023 17:27:52 +0000 (09:27 -0800)]
Merge pull request #24 from andrei-21/feature/configure-peers

Make ln peers configurable

21 months agoLowercase network values
Andrei [Wed, 8 Feb 2023 00:00:00 +0000 (00:00 +0000)]
Lowercase network values

21 months agoMake ln peers configurable
Andrei [Wed, 8 Feb 2023 00:00:00 +0000 (00:00 +0000)]
Make ln peers configurable

21 months agoConfigure network
Andrei [Wed, 8 Feb 2023 00:00:00 +0000 (00:00 +0000)]
Configure network

2 years agoCreate simple docker-compose for testnet
Jurvis Tan [Tue, 15 Nov 2022 03:59:17 +0000 (19:59 -0800)]
Create simple docker-compose for testnet

2 years agoMerge pull request #19 from TheBlueMatt/main
Matt Corallo [Tue, 8 Nov 2022 19:00:42 +0000 (19:00 +0000)]
Merge pull request #19 from TheBlueMatt/main

Update LDK to 0.0.112 and workaround Postgres being broken

2 years agoPin once_cell to 1.14 to fix MSRV
Matt Corallo [Tue, 8 Nov 2022 01:06:51 +0000 (01:06 +0000)]
Pin once_cell to 1.14 to fix MSRV

2 years agoSet per-table autovacuum thresholds low
Matt Corallo [Tue, 8 Nov 2022 00:53:41 +0000 (00:53 +0000)]
Set per-table autovacuum thresholds low

Fixes #20

2 years agoPrune the network graph immediately prior to generating updates
Matt Corallo [Thu, 27 Oct 2022 18:01:44 +0000 (18:01 +0000)]
Prune the network graph immediately prior to generating updates

2 years agoUpdate LDK to 0.0.112
Matt Corallo [Thu, 27 Oct 2022 18:01:37 +0000 (18:01 +0000)]
Update LDK to 0.0.112

2 years agoMerge pull request #14 from TheBlueMatt/main
Arik [Wed, 14 Sep 2022 20:32:19 +0000 (13:32 -0700)]
Merge pull request #14 from TheBlueMatt/main

Upgrade to LDK 0.0.111, Improve SQL Types

2 years agoAdd one additional index which postgres prefers as the DB fills
Matt Corallo [Wed, 14 Sep 2022 20:12:17 +0000 (20:12 +0000)]
Add one additional index which postgres prefers as the DB fills

If postgres decides walking the full `channel_updates_scid_dir_seen`
index and removing old `seen` values is slower than just walking
the full table (or this new index) it does so. Sadly this causes
re-sorting (usually on-disk), but there doesn't seem to be a way to
avoid this.

2 years agoDrop useless indexes, add (very) useful indxes after benchmarking
Matt Corallo [Wed, 14 Sep 2022 19:22:49 +0000 (19:22 +0000)]
Drop useless indexes, add (very) useful indxes after benchmarking

2 years agoDrop unused columns from SELECT queries
Matt Corallo [Tue, 13 Sep 2022 15:48:31 +0000 (15:48 +0000)]
Drop unused columns from SELECT queries

2 years agoDrop the composite_index in favor of a multi-column unique index
Matt Corallo [Tue, 13 Sep 2022 15:43:53 +0000 (15:43 +0000)]
Drop the composite_index in favor of a multi-column unique index

Also set all the channel_update fields to NOT NULL, because they
should be non-null always.

2 years agoAdd some further indexes on channel_updates to match queries
Matt Corallo [Tue, 13 Sep 2022 00:07:49 +0000 (00:07 +0000)]
Add some further indexes on channel_updates to match queries

2 years agoDrop redundant block_height column on announcements, use i16 for flags
Matt Corallo [Tue, 13 Sep 2022 15:33:41 +0000 (15:33 +0000)]
Drop redundant block_height column on announcements, use i16 for flags

2 years agoSimplify composite index construction somewhat
Matt Corallo [Mon, 12 Sep 2022 04:21:24 +0000 (04:21 +0000)]
Simplify composite index construction somewhat

2 years agoUpdate to LDK 0.0.111, rust-bitcoin 0.29
Matt Corallo [Sun, 11 Sep 2022 22:39:59 +0000 (22:39 +0000)]
Update to LDK 0.0.111, rust-bitcoin 0.29

2 years agoUse more appropriate data types for SCIDs, direction, composite_index
Matt Corallo [Sun, 11 Sep 2022 21:06:34 +0000 (21:06 +0000)]
Use more appropriate data types for SCIDs, direction, composite_index

2 years agoDrop the chain_hash column
Matt Corallo [Sun, 11 Sep 2022 21:07:57 +0000 (21:07 +0000)]
Drop the chain_hash column

2 years agoAdd upgrade query support
Matt Corallo [Sun, 11 Sep 2022 16:41:12 +0000 (16:41 +0000)]
Add upgrade query support

2 years agoDrop several unused dependencies
Matt Corallo [Sun, 11 Sep 2022 18:14:32 +0000 (18:14 +0000)]
Drop several unused dependencies

2 years agoMerge pull request #13 from arik-so/2022-08-envvar-renaming
Matt Corallo [Tue, 23 Aug 2022 04:07:31 +0000 (04:07 +0000)]
Merge pull request #13 from arik-so/2022-08-envvar-renaming

2 years agoChange bitcoin REST endpoint default port to the standard mainnet default.
Arik Sosman [Tue, 23 Aug 2022 03:21:11 +0000 (20:21 -0700)]
Change bitcoin REST endpoint default port to the standard mainnet default.

2 years agoMerge pull request #11 from arik-so/2022-08-envvar-renaming
Matt Corallo [Tue, 23 Aug 2022 03:08:12 +0000 (03:08 +0000)]
Merge pull request #11 from arik-so/2022-08-envvar-renaming

Rename environment variables to reflect the name of this project.

2 years agoRename environment variables to reflect the name of this project.
Arik Sosman [Tue, 23 Aug 2022 00:46:14 +0000 (17:46 -0700)]
Rename environment variables to reflect the name of this project.

2 years agoMerge pull request #10 from TheBlueMatt/2022-08-no-pin-cpufeatures
Arik [Tue, 23 Aug 2022 00:37:53 +0000 (17:37 -0700)]
Merge pull request #10 from TheBlueMatt/2022-08-no-pin-cpufeatures

Skip pinning cpufeatures, which has fixed its MSRV

2 years agoMerge pull request #7 from TheBlueMatt/2022-08-fix-deadlock
Arik [Tue, 23 Aug 2022 00:36:53 +0000 (17:36 -0700)]
Merge pull request #7 from TheBlueMatt/2022-08-fix-deadlock

Fix Counter Lock Deadlock, Further Cleanups

2 years agoDrop spurious comments 2022-08-fix-deadlock
Matt Corallo [Mon, 22 Aug 2022 04:19:52 +0000 (04:19 +0000)]
Drop spurious comments

2 years agoDon't hold the counter lock while verifying gossip/waiting on DB
Matt Corallo [Mon, 22 Aug 2022 04:14:24 +0000 (04:14 +0000)]
Don't hold the counter lock while verifying gossip/waiting on DB

This resolves a deadlock if we block on the DB where we have one
thread blocked waiting on DB in a blocking thread, and the tokio
reactor blocked waiting on the counter lock which the blocking
thread holds.

2 years agoRemove unused fields and function in lib.rs
Matt Corallo [Mon, 22 Aug 2022 03:46:49 +0000 (03:46 +0000)]
Remove unused fields and function in lib.rs

2 years agoRemove indirection in initial sync completion
Matt Corallo [Mon, 22 Aug 2022 03:37:49 +0000 (03:37 +0000)]
Remove indirection in initial sync completion

Rather than sending a GossipMessage::InitialSyncComplete, which
causes the persistence logic to push to another queue to wake the
snapshoter, we can simply wake the snapshoter directly.

2 years agoSkip pinning cpufeatures, which has fixed its MSRV 2022-08-no-pin-cpufeatures
Matt Corallo [Tue, 23 Aug 2022 00:03:34 +0000 (00:03 +0000)]
Skip pinning cpufeatures, which has fixed its MSRV

2 years agoMerge pull request #9 from arik-so/2022-08-snapshot-timestamp-fix
Matt Corallo [Tue, 23 Aug 2022 00:02:03 +0000 (00:02 +0000)]
Merge pull request #9 from arik-so/2022-08-snapshot-timestamp-fix

Reference canonical timestamps when generating snapshots.

2 years agoAlways pin dependencies for 1.48.0.
Arik Sosman [Mon, 22 Aug 2022 23:48:49 +0000 (16:48 -0700)]
Always pin dependencies for 1.48.0.

2 years agoReference canonical timestamps when generating snapshots.
Arik Sosman [Mon, 22 Aug 2022 23:42:20 +0000 (16:42 -0700)]
Reference canonical timestamps when generating snapshots.

2 years agoMerge pull request #8 from arik-so/2022-08-add-0-symlink
Matt Corallo [Mon, 22 Aug 2022 23:12:37 +0000 (23:12 +0000)]
Merge pull request #8 from arik-so/2022-08-add-0-symlink

Add 0.bin symlink for clients requiring an initial rapid sync.

2 years agoMerge pull request #6 from TheBlueMatt/2022-08-cleanups
Arik [Mon, 22 Aug 2022 22:48:44 +0000 (15:48 -0700)]
Merge pull request #6 from TheBlueMatt/2022-08-cleanups

Various Code Cleanups

2 years agoAdd 0.bin symlink for clients requiring an initial rapid sync.
Arik Sosman [Mon, 22 Aug 2022 21:39:02 +0000 (14:39 -0700)]
Add 0.bin symlink for clients requiring an initial rapid sync.

2 years agoCleanup network graph persisting and ensure write succeeds 2022-08-cleanups
Matt Corallo [Mon, 22 Aug 2022 03:30:35 +0000 (03:30 +0000)]
Cleanup network graph persisting and ensure write succeeds

2 years agoTrivial cleanups in lookup.rs
Matt Corallo [Mon, 22 Aug 2022 03:27:50 +0000 (03:27 +0000)]
Trivial cleanups in lookup.rs

2 years agoCorrect error-matching in downloader
Matt Corallo [Mon, 22 Aug 2022 03:24:27 +0000 (03:24 +0000)]
Correct error-matching in downloader

2 years agoDrop Arcs around the TestLogger, as its an empty struct anyway
Matt Corallo [Mon, 22 Aug 2022 03:22:09 +0000 (03:22 +0000)]
Drop Arcs around the TestLogger, as its an empty struct anyway

2 years agoSubstantially reduce boilerplate and Arcs in download_gossip
Matt Corallo [Mon, 22 Aug 2022 03:17:09 +0000 (03:17 +0000)]
Substantially reduce boilerplate and Arcs in download_gossip

2 years agoRemove unnecessary Arcs in verifier.rs
Matt Corallo [Mon, 22 Aug 2022 03:04:41 +0000 (03:04 +0000)]
Remove unnecessary Arcs in verifier.rs

2 years agoClean up the flow and variables in lib.rs and main.rs
Matt Corallo [Mon, 22 Aug 2022 02:39:26 +0000 (02:39 +0000)]
Clean up the flow and variables in lib.rs and main.rs

2 years agoMerge pull request #5 from TheBlueMatt/2022-08-block-on-slow-db
Arik [Mon, 22 Aug 2022 03:03:03 +0000 (20:03 -0700)]
Merge pull request #5 from TheBlueMatt/2022-08-block-on-slow-db

Block tasks if the DB writes get behind, rather than growing the queue.

2 years agoBlock tasks if the DB writes get behind, rather than growing the queue 2022-08-block-on-slow-db
Matt Corallo [Mon, 22 Aug 2022 02:40:23 +0000 (02:40 +0000)]
Block tasks if the DB writes get behind, rather than growing the queue

2 years agoMerge pull request #4 from TheBlueMatt/2022-08-fix-executors
Arik [Mon, 22 Aug 2022 02:43:03 +0000 (19:43 -0700)]
Merge pull request #4 from TheBlueMatt/2022-08-fix-executors

Don't spawn new single-threaded executors, stay inside tokio

2 years agoDon't spawn new single-threaded executors, stay inside tokio 2022-08-fix-executors
Matt Corallo [Mon, 22 Aug 2022 02:18:30 +0000 (02:18 +0000)]
Don't spawn new single-threaded executors, stay inside tokio

2 years agoMerge pull request #3 from lightningdevkit/readme_fixups
Arik [Mon, 22 Aug 2022 02:13:45 +0000 (19:13 -0700)]
Merge pull request #3 from lightningdevkit/readme_fixups

Fix readme links.

2 years agoFix readme links.
Arik Sosman [Mon, 22 Aug 2022 02:13:10 +0000 (19:13 -0700)]
Fix readme links.

2 years agoMerge pull request #2 from lightningdevkit/readme_fixups
Arik [Mon, 22 Aug 2022 02:10:45 +0000 (19:10 -0700)]
Merge pull request #2 from lightningdevkit/readme_fixups

Fix readme.

2 years agoFix readme.
Arik Sosman [Mon, 22 Aug 2022 02:10:23 +0000 (19:10 -0700)]
Fix readme.

2 years agoInitial commit.
Arik Sosman [Mon, 22 Aug 2022 01:18:35 +0000 (18:18 -0700)]
Initial commit.

2 years agoInitial commit
Arik Sosman [Fri, 20 May 2022 03:02:48 +0000 (20:02 -0700)]
Initial commit