bug: inconsistent messages on eth-pm

[danisharora099]

Acceptance Criteria

• Follow-up on Waku fleets: separate pubsub topic for development pm#13 to have pubsub topic dedicated to development
• Use hash in meta field to avoid duplication (output of 14/WAKU2-MESSAGE: Meta attribute and deterministic hashing js-waku#1208 )

waku-org/js-waku#905 is long term solution, does not need to be tracked here.

Bug Description

Messages sent and received on eth-pm seem to be highly inconsistent.

Setup is the message starting suffixed with an iterating counter, logged every 5 seconds.
It can be seen that messages are skipped when received.

browser 1:

browser 2:

This is possibly related to an upstream bug with relay, and could also be related to waku-org/js-waku#751 waku-org/nwaku#1485 waku-org/nwaku#1485 (comment)

[danisharora099]

Update: it is also seen that some messages are received really late and some are also repeated:

[fryorcraken]

Late/repeated is something already tracked on nwaku side and due to the high traffic from Status (not sure if we have an issue for it Cc @jm-clius).

Are messages truly missing or is it the rendering? You mentioned rendering.

[danisharora099]

They are missed. Edited the original issue

[fryorcraken]

This is likely due to usage of Relay in the browser + increased traffic due to Status dogfooding.
Two actions in progress to assist:

• usage of a dev topic for development purposes: Waku fleets: separate pubsub topic for development pm#13
• Improvement of Relay in the browser: [Epic] Waku Relay scalability in the Browser js-waku#905

In the mean time, do feel free to log the exact occurrences and report to nwaku team so they can investigate the missing messages.

[fryorcraken]

For the dupe message problem. If a message with same payload is received within gossipsub window (20s), it is dropped. If outside window, it's forwarded and hence dupe.

That could be resolved by using the hash in meta field in the eth-pm example: waku-org/js-waku#1208

[weboko]

Temporarily closed PR waku-org/js-waku#1361
Waiting for other nodes to implement deterministic hashing
waku-org/js-waku#1233 (comment)