Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Early Draft] Splicing prototype #3274

Draft
wants to merge 108 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
108 commits
Select commit Hold shift + click to select a range
de78627
Splicing happy-path proto 3
optout21 Oct 11, 2023
2f6d619
Splicing happy-path proto 4
optout21 Nov 21, 2023
04df7b7
Move committing to new splice transaction only upon confirmation
optout21 Nov 23, 2023
03978ed
Extra check to splice test case (no change before locking)
optout21 Nov 23, 2023
a23d7dd
Reduce redundancy in pre+post+diff storage, check for overflows
optout21 Nov 25, 2023
15176d0
Add V2 constructors to `ChannelId`
dunxen Sep 12, 2023
1b8f177
f use-only Hash trait
dunxen Dec 7, 2023
fcd399d
Test builds with #[cfg(dual_funding)] enabled
dunxen Dec 4, 2023
476f6cb
Add `DualFundingChannelContext` struct
dunxen Sep 12, 2023
2e66dc5
Create ChannelContext constructor for inbound channels
dunxen Nov 24, 2023
2ee04b0
Add `InboundV2Channel` struct
dunxen Sep 12, 2023
2f1fcb7
Create ChannelContext constructor for outbound channels
dunxen Nov 24, 2023
5c68d10
Add `OutboundV2Channel` struct
dunxen Sep 12, 2023
23febee
Add V2 `ChannelPhase` variants
dunxen Sep 13, 2023
3739aff
Initial `InteractiveTxConstructor` design
dunxen Mar 21, 2023
906e01e
Add more docs and tests
jurvis Nov 11, 2023
6591432
Add comment on spec clarification
jurvis Nov 12, 2023
d3659fa
Add interactive tx constructor to `ChannelContext`
dunxen Oct 6, 2023
4b9f03a
Add FundingInputsContributionReady event
dunxen Oct 24, 2023
29e396c
Implement support for accepting V2 channels
dunxen Sep 15, 2023
7689e00
Handle initial commitment_signed for V2 channels
dunxen Oct 19, 2023
d7b69d9
Handle interactive signing sessions
dunxen Oct 19, 2023
0ac3d9a
Add `option_dual_fund` feature
dunxen Sep 13, 2023
a146bbe
Splice test: add checks to acceptor node as well
optout21 Dec 18, 2023
5db4b3f
Minor cleanup
optout21 Jan 8, 2024
dfe53d7
Update to main, up to Nov 23 70ea110, bitcoin 0.30.2, splice msgs in
optout21 Jan 8, 2024
d7d2f98
Update to main, up to Nov 27, 146a291
optout21 Jan 8, 2024
4131866
Update to main, up to Dec 9 0c67753, channel state refactor
optout21 Jan 9, 2024
75eff57
Merge Interactive TX construction branch (dunxen:2023-05-v2channelest…
optout21 Jan 10, 2024
e5122bf
Create test with V2 channel open; test_channel_open_v2_and_close
optout21 Jan 10, 2024
a12876b
Rework Splice proto to use Interactive transaction construction, firs…
optout21 Jan 18, 2024
704dabb
Clean up non-dual-funding provisionary splice msgs
optout21 Jan 19, 2024
c0c0832
Signature handling; provide shared signature in tx_signatures, proper…
optout21 Jan 24, 2024
e812361
Splicing proto hapa7; reworked state handling and all
optout21 Feb 14, 2024
4b7f183
Gossip change for ldk-sample building
optout21 Feb 16, 2024
9fa7f4f
Adjust resetting the interactive signing session
optout21 Mar 15, 2024
c604471
Massive update, merge recent interactive tx branch (121)
optout21 Mar 19, 2024
fc98fd2
Improve fee estimation, include witness fee
optout21 Apr 2, 2024
4c54a52
Adjust the content of SpliceAckedInputsContributionReady::holder_fund…
optout21 Apr 2, 2024
6833421
Fix for tx_signature (duplicate) handling
optout21 Apr 4, 2024
c5c9e59
Update to version v0.0.122
optout21 Apr 23, 2024
4f81562
Add fee check to v2_splice_in test
optout21 Apr 24, 2024
1aea895
Update README
optout21 Apr 24, 2024
21f8695
Update to main, at pre 0.0.123 (commit 9a438ee apr24)
optout21 Apr 25, 2024
83d9293
Post-merge fixes and improvements from V2 branch
optout21 Apr 26, 2024
8c38166
Fix discrepancy in finding the funding output in sorted/unsorted outp…
optout21 Apr 26, 2024
95c5aa3
Remove premature sending of tx_signatures
optout21 Apr 26, 2024
38a5741
Tests: use realistic-size placeholder signature throughout
optout21 Apr 26, 2024
55f326e
Fix tx i&o sorting in IATX ConstructedTransaction, keep them sorted f…
optout21 Apr 28, 2024
885c130
Adjustment to dual_funding/splicing cfg flags
optout21 Apr 29, 2024
2011f60
[TestOnly] Add unit tests for testing different order of events on Si…
optout21 May 2, 2024
f2ba543
Factor out common TxSignature decision logic into common fn get_tx_si…
optout21 May 2, 2024
46f51b4
Factor out handling of funding_transaction_signed() into a method in …
optout21 May 2, 2024
84d9838
Extend provide_holder_witnesses() to also check for fully signed fund…
optout21 May 2, 2024
ac45252
Handle all combinations of event orders, if local sigs come late, etc
optout21 May 2, 2024
a957229
Update sequence documentation in Readme
optout21 May 2, 2024
974847a
Fix missing ChannelPending and ChannelReady flags, by clearing corres…
optout21 May 5, 2024
6cd57b4
Add interactive tx constructor to `ChannelContext`
dunxen Oct 6, 2023
359bc2f
Implement support for accepting V2 channels
dunxen Sep 15, 2023
4c632af
Handle initial commitment_signed for V2 channels
dunxen Oct 19, 2023
f9aa520
Handle interactive signing sessions
dunxen Oct 19, 2023
e6bcfab
Handle re-establishment next_funding_txid
dunxen May 2, 2024
6b99234
Add `option_dual_fund` feature
dunxen Sep 13, 2023
17ed992
Extend AwaitingChannelReady state with IS_SPLICE flag
optout21 May 7, 2024
46a256c
Make check_get_channel_ready() also check for splice_locked, prepare …
optout21 May 7, 2024
73bb738
Send and handle splice_locked message (similar to channel_ready)
optout21 May 9, 2024
0fe941d
Call splice_complete() only when splice_locked was both sent and rece…
optout21 May 9, 2024
536e3b1
Update to main v0.0.123
optout21 May 9, 2024
f4f931c
Update Readme info
optout21 May 9, 2024
7061997
Add is_splice flag to ChannelPending and ChannelReady events
optout21 May 9, 2024
cb54422
More usage of is_splice_pending(), make it independent of splicing cf…
optout21 May 10, 2024
d1107da
Minor changes in preparation of merging
optout21 May 17, 2024
9e1cb63
Minor changes in interactivetx.rs, to bring it closer to dual funding…
optout21 May 17, 2024
986b66d
For splicing, don’t use contribute_funding_inputs() call, but provide…
optout21 May 17, 2024
0212c99
Rebase to latest dual funding branch (2023)
optout21 May 17, 2024
292f1e0
Minor post-merge cleanup, actual merge
optout21 May 17, 2024
f5b53bd
Purge SpliceAckedInputsContributionReady
optout21 May 17, 2024
670a87d
Work on test_v2_payment_splice_in_payment() unit test (still fails)
optout21 May 21, 2024
8ba5012
New channel context creation for spliced channel (new_for_splice)
optout21 Jun 3, 2024
b382424
Refine balance updating logic, checks
optout21 Jun 3, 2024
81a02a3
Calculate interactive funding values correctly from the deltas
optout21 Jun 4, 2024
6571da3
Minor test touches
optout21 Jun 11, 2024
b47ba51
During splicing negotiation, don’t advance to next commitment point. …
optout21 Jun 12, 2024
671c3ba
Compile fix for ‘dual_funding’ cfg
optout21 Jun 14, 2024
86ff19e
Update splice messages according to new spec draft
optout21 Jun 14, 2024
d2cfcf3
Update splice messages according to new spec draft
optout21 Jun 15, 2024
1165377
Update splice messages according to new spec draft
optout21 Jun 15, 2024
138574c
Refactor splice contribution handling (splice_init and splice_ack con…
optout21 Jun 15, 2024
eb6d4d3
Remove channel IDs from Pre/Post info, not needed
optout21 Jun 19, 2024
3d3a305
Add new Renegotiating phase for splicing
optout21 Jun 25, 2024
ce42a96
Rearrange complex test case to test for out-of-order splice_locked sc…
optout21 Jul 5, 2024
feca615
Minor refactor: factor out set_channel_ready() method
optout21 Jul 5, 2024
26029c4
Call splice_complete() with set_channel_ready(), handle both splice_l…
optout21 Jul 5, 2024
be8ff11
Update doc in Readme
optout21 Jul 5, 2024
9ebe1b6
Make ChannelContext::new_for_splice() take reference, clone it; plus …
optout21 Aug 16, 2024
90eb001
RenegotiatingFundingInbound and Outbound: add pre-splice channel to i…
optout21 Aug 16, 2024
0a2fb0c
Use new RenegotiatingFundingPending state (instead of Funded) for fun…
optout21 Aug 23, 2024
05adf97
Make splice tests generic, with payments optional
optout21 Aug 23, 2024
d8198d2
Remove redeem_script from signing utility, it can derive it
optout21 Sep 17, 2024
3fa228b
Minor channel cloning touches
optout21 Sep 19, 2024
7628d00
Rename (RenegotiatingV2 to RenegotiatingV2
optout21 Sep 23, 2024
522340d
Add V2Channel, merge RenegotiatingChannel into V2Channel
optout21 Sep 23, 2024
02ac3f1
RenegotiatingV2 contains now Channel and ChannelVariants (instead of …
optout21 Sep 23, 2024
bb7cbd0
Merge RenegotiatingFundingOutbound, -Inbound and RenegotiatingV2 pha…
optout21 Sep 25, 2024
e781ca3
Adapt channel cloning, as in 3332
optout21 Sep 25, 2024
2bfd08f
Rename state to RefundingV2
optout21 Oct 1, 2024
4980a99
Channel context for splicing pending: use post if funded, pre otherwi…
optout21 Oct 2, 2024
6895e92
Add test for payment while splice pending (failing)
optout21 Oct 2, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
159 changes: 159 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,160 @@
# 0.0.123 - May 08, 2024 - "BOLT12 Dust Sweeping"

## API Updates

* To reduce risk of force-closures and improve HTLC reliability the default
dust exposure limit has been increased to
`MaxDustHTLCExposure::FeeRateMultiplier(10_000)`. Users with existing
channels might want to consider using
`ChannelManager::update_channel_config` to apply the new default (#3045).
* `ChainMonitor::archive_fully_resolved_channel_monitors` is now provided to
remove from memory `ChannelMonitor`s that have been fully resolved on-chain
and are now not needed. It uses the new `Persist::archive_persisted_channel`
to inform the storage layer that such a monitor should be archived (#2964).
* An `OutputSweeper` is now provided which will automatically sweep
`SpendableOutputDescriptor`s, retrying until the sweep confirms (#2825).
* After initiating an outbound channel, a peer disconnection no longer results
in immediate channel closure. Rather, if the peer is reconnected before the
channel times out LDK will automatically retry opening it (#2725).
* `PaymentPurpose` now has separate variants for BOLT12 payments, which
include fields from the `invoice_request` as well as the `OfferId` (#2970).
* `ChannelDetails` now includes a list of in-flight HTLCs (#2442).
* `Event::PaymentForwarded` now includes `skimmed_fee_msat` (#2858).
* The `hashbrown` dependency has been upgraded and the use of `ahash` as the
no-std hash table hash function has been removed. As a consequence, LDK's
`Hash{Map,Set}`s no longer feature several constructors when LDK is built
with no-std; see the `util::hash_tables` module instead. On platforms that
`getrandom` supports, setting the `possiblyrandom/getrandom` feature flag
will ensure hash tables are resistant to HashDoS attacks, though the
`possiblyrandom` crate should detect most common platforms (#2810, #2891).
* `ChannelMonitor`-originated requests to the `ChannelSigner` can now fail and
be retried using `ChannelMonitor::signer_unblocked` (#2816).
* `SpendableOutputDescriptor::to_psbt_input` now includes the `witness_script`
where available as well as new proprietary data which can be used to
re-derive some spending keys from the base key (#2761, #3004).
* `OutPoint::to_channel_id` has been removed in favor of
`ChannelId::v1_from_funding_outpoint` in preparation for v2 channels with a
different `ChannelId` derivation scheme (#2797).
* `PeerManager::get_peer_node_ids` has been replaced with `list_peers` and
`peer_by_node_id`, which provide more details (#2905).
* `Bolt11Invoice::get_payee_pub_key` is now provided (#2909).
* `Default[Message]Router` now take an `entropy_source` argument (#2847).
* `ClosureReason::HTLCsTimedOut` has been separated out from
`ClosureReason::HolderForceClosed` as it is the most common case (#2887).
* `ClosureReason::CooperativeClosure` is now split into
`{Counterparty,Locally}Initiated` variants (#2863).
* `Event::ChannelPending::channel_type` is now provided (#2872).
* `PaymentForwarded::{prev,next}_user_channel_id` are now provided (#2924).
* Channel init messages have been refactored towards V2 channels (#2871).
* `BumpTransactionEvent` now contains the channel and counterparty (#2873).
* `util::scid_utils` is now public, with some trivial utilities to examine
short channel ids (#2694).
* `DirectedChannelInfo::{source,target}` are now public (#2870).
* Bounds in `lightning-background-processor` were simplified by using
`AChannelManager` (#2963).
* The `Persist` impl for `KVStore` no longer requires `Sized`, allowing for
the use of `dyn KVStore` as `Persist` (#2883, #2976).
* `From<PaymentPreimage>` is now implemented for `PaymentHash` (#2918).
* `NodeId::from_slice` is now provided (#2942).
* `ChannelManager` deserialization may now fail with `DangerousValue` when
LDK's persistence API was violated (#2974).

## Bug Fixes
* Excess fees on counterparty commitment transactions are now included in the
dust exposure calculation. This lines behavior up with some cases where
transaction fees can be burnt, making them effectively dust exposure (#3045).
* `Future`s used as an `std::...::Future` could grow in size unbounded if it
was never woken. For those not using async persistence and using the async
`lightning-background-processor`, this could cause a memory leak in the
`ChainMonitor` (#2894).
* Inbound channel requests that fail in
`ChannelManager::accept_inbound_channel` would previously have stalled from
the peer's perspective as no `error` message was sent (#2953).
* Blinded path construction has been tuned to select paths more likely to
succeed, improving BOLT12 payment reliability (#2911, #2912).
* After a reorg, `lightning-transaction-sync` could have failed to follow a
transaction that LDK needed information about (#2946).
* `RecipientOnionFields`' `custom_tlvs` are now propagated to recipients when
paying with blinded paths (#2975).
* `Event::ChannelClosed` is now properly generated and peers are properly
notified for all channels that as a part of a batch channel open fail to be
funded (#3029).
* In cases where user event processing is substantially delayed such that we
complete multiple round-trips with our peers before a `PaymentSent` event is
handled and then restart without persisting the `ChannelManager` after having
persisted a `ChannelMonitor[Update]`, on startup we may have `Err`d trying to
deserialize the `ChannelManager` (#3021).
* If a peer has relatively high latency, `PeerManager` may have failed to
establish a connection (#2993).
* `ChannelUpdate` messages broadcasted for our own channel closures are now
slightly more robust (#2731).
* Deserializing malformed BOLT11 invoices may have resulted in an integer
overflow panic in debug builds (#3032).
* In exceedingly rare cases (no cases of this are known), LDK may have created
an invalid serialization for a `ChannelManager` (#2998).
* Message processing latency handling BOLT12 payments has been reduced (#2881).
* Latency in processing `Event::SpendableOutputs` may be reduced (#3033).

## Node Compatibility
* LDK's blinded paths were inconsistent with other implementations in several
ways, which have been addressed (#2856, #2936, #2945).
* LDK's messaging blinded paths now support the latest features which some
nodes may begin relying on soon (#2961).
* LDK's BOLT12 structs have been updated to support some last-minute changes to
the spec (#3017, #3018).
* CLN v24.02 requires the `gossip_queries` feature for all peers, however LDK
by default does not set it for those not using a `P2PGossipSync` (e.g. those
using RGS). This change was reverted in CLN v24.02.2 however for now LDK
always sets the `gossip_queries` feature. This change is expected to be
reverted in a future LDK release (#2959).

## Security
0.0.123 fixes a denial-of-service vulnerability which we believe to be reachable
from untrusted input when parsing invalid BOLT11 invoices containing non-ASCII
characters.
* BOLT11 invoices with non-ASCII characters in the human-readable-part may
cause an out-of-bounds read attempt leading to a panic (#3054). Note that all
BOLT11 invoices containing non-ASCII characters are invalid.

In total, this release features 150 files changed, 19307 insertions, 6306
deletions in 360 commits since 0.0.121 from 17 authors, in alphabetical order:

* Arik Sosman
* Duncan Dean
* Elias Rohrer
* Evan Feenstra
* Jeffrey Czyz
* Keyue Bao
* Matt Corallo
* Orbital
* Sergi Delgado Segura
* Valentine Wallace
* Willem Van Lint
* Wilmer Paulino
* benthecarman
* jbesraa
* olegkubrakov
* optout
* shaavan


# 0.0.122 - Apr 09, 2024 - "That Which Is Untested Is Broken"

## Bug Fixes
* `Route` objects did not successfully round-trip through de/serialization
since LDK 0.0.117, which has now been fixed (#2897).
* Correct deserialization of unknown future enum variants. This ensures
downgrades from future versions of LDK do not result in read failures or
corrupt reads in cases where enums are written (#2969).
* When hitting lnd bug 6039, our workaround previously resulted in
`ChannelManager` persistences on every round-trip with our peer. These
useless persistences are now skipped (#2937).

In total, this release features 4 files changed, 99 insertions, 55
deletions in 6 commits from 1 author, in alphabetical order:
* Matt Corallo


# 0.0.121 - Jan 22, 2024 - "Unwraps are Bad"

## Bug Fixes
Expand All @@ -17,6 +174,7 @@ deletions in 4 commits from 2 authors, in alphabetical order:
* Jeffrey Czyz
* Matt Corallo


# 0.0.120 - Jan 17, 2024 - "Unblinded Fuzzers"

## API Updates
Expand Down Expand Up @@ -65,6 +223,7 @@ deletions in 79 commits from 9 authors, in alphabetical order:
* optout
* shuoer86


# 0.0.119 - Dec 15, 2023 - "Spring Cleaning for Christmas"

## API Updates
Expand Down
Loading