Migrate from socket.io to SSE / EventSource based EventStreams

[ottomata]

As yall know, we are planning to decomission the socket.io based RCStream service in July this year. We've built a new service called EventStreams that takes its place.

• https://blog.wikimedia.org/2017/03/20/eventstreams/
• https://wikitech.wikimedia.org/wiki/EventStreams

Switching should be pretty easy, but let me know if we can help in any way. Thanks!

[slaporte]

We're actually using wikimon to subscribe to the IRC feed, adding some geo coordinates for anons (based on their IP address) and some structure, and then rebroadcasting over websockets. I like using the IRC feed because it's stable and simple -- it's been running fine since before the Socket.io service.

My main questions about the SSE service are: is it guaranteed to be supported over the long term? does it capture identical data about recent changes events (like flags, change size, etc), or more? is there any plan to enrich the SSE stream further (eg, adding geo coords)?

[ottomata]

Oh! Didn't realize you were using your own websockets broadcast. Hm. In that case you can probably decline this issue. We are probably stuck with irc.wikimedia.org for the time being, and don't have any plan to turn it off.

is it guaranteed to be supported over the long term?

Yes, as much as I can guarantee it (which maybe isn't enough?).

does it capture identical data about recent changes events

I don't know much about the IRCFeed events, but the data in EventStreams at /v2/stream/recentchange should be identical to RCStream data.

is there any plan to enrich the SSE stream further (eg, adding geo coords)?

I don't think we'll modify the recentchange data. But, EventStreams does have the ability to expose more events than just recenchanges, and we have more process over how those events are created and evolved. If there are events or data you want that isn't satisfied by recentchanges, we want to hear about them! :)