Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

NodeBB

  1. Home
  2. Technical Support
  3. Did 4.4.1 break federation with Lemmy groups?

Did 4.4.1 break federation with Lemmy groups?

Scheduled Pinned Locked Moved Technical Support
20 Posts 5 Posters 135 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • K This user is from outside of this forum
    K This user is from outside of this forum
    [email protected]
    wrote on last edited by
    #1

    After updating from 4.3 to 4.4.1, I noticed that my remote groups stopped updating. I double checked them here, and they're even further behind the group hosts, with the last received topics dating back to 16 May.

    d31b2edc-3c5f-46a5-a650-ed39b5699870-image.png

    These are all Lemmy-hosted groups, so I'm not sure if it's a Lemmy-specific thing, or group actors more generally.

    julian@community.nodebb.orgJ S 2 Replies Last reply
    0
    • K [email protected]

      After updating from 4.3 to 4.4.1, I noticed that my remote groups stopped updating. I double checked them here, and they're even further behind the group hosts, with the last received topics dating back to 16 May.

      d31b2edc-3c5f-46a5-a650-ed39b5699870-image.png

      These are all Lemmy-hosted groups, so I'm not sure if it's a Lemmy-specific thing, or group actors more generally.

      julian@community.nodebb.orgJ This user is from outside of this forum
      julian@community.nodebb.orgJ This user is from outside of this forum
      [email protected]
      wrote on last edited by
      #2

      Kichae does the category show as having followers? (If the remote category doesn't have followers there will be a little warning note before the topic list.)

      I do have a few categories I follow here and they seem to be working, though they may not be Lemmy specifically.

      Was [email protected] one of them?

      K 1 Reply Last reply
      0
      • julian@community.nodebb.orgJ [email protected]

        Kichae does the category show as having followers? (If the remote category doesn't have followers there will be a little warning note before the topic list.)

        I do have a few categories I follow here and they seem to be working, though they may not be Lemmy specifically.

        Was [email protected] one of them?

        K This user is from outside of this forum
        K This user is from outside of this forum
        [email protected]
        wrote on last edited by
        #3

        julian No, [email protected] isn't currently being followed, and it shows the warning, but all of the ones in the screen shot above are from this forum, are being followed by me, and haven't received a new topic in 8 days. [email protected], in particular, is almost hyper active right now.

        julian@community.nodebb.orgJ 1 Reply Last reply
        0
        • K [email protected]

          julian No, [email protected] isn't currently being followed, and it shows the warning, but all of the ones in the screen shot above are from this forum, are being followed by me, and haven't received a new topic in 8 days. [email protected], in particular, is almost hyper active right now.

          julian@community.nodebb.orgJ This user is from outside of this forum
          julian@community.nodebb.orgJ This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #4

          Kichae thanks, I'll take a look ASAP

          1 Reply Last reply
          1
          • K This user is from outside of this forum
            K This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #5

            New observation: I'm still receiving notifications for up/down votes from Lemmy, but no other content.

            1 Reply Last reply
            1
            • julian@community.nodebb.orgJ This user is from outside of this forum
              julian@community.nodebb.orgJ This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #6

              Hmm... I am not sure whether it is significant, but I am still getting topics from one of my communities. That's why I was not aware that federation was broken.

              It does suggest that it's a NodeBB-specific bug though...

              1 Reply Last reply
              0
              • julian@community.nodebb.orgJ This user is from outside of this forum
                julian@community.nodebb.orgJ This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #7

                I tested on a dev instance with a lemmy test group and found nothing wrong. Two-way posts work, as do upvotes.

                I can definitely confirm that followed communities here aren't working, which is concerning. Not sure why yet.

                1 Reply Last reply
                1
                • julian@community.nodebb.orgJ This user is from outside of this forum
                  julian@community.nodebb.orgJ This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #8

                  After more debugging today I am less convinced that this is a NodeBB issue.

                  I am finding Lemmy communities where federation continues without issue, and others where there is no activity at all.

                  The sequence of events is:

                  1. NodeBB sends out a Follow
                  2. Lemmy responds with a 200 or equivalent
                  3. Lemmy later sends me an Accept
                  4. Lemmy later sends content (posts, upvotes, etc.)

                  startrek.website and ani.social both do everything ok.

                  lemmy.world and mander.xyz fail at step 3, and existing connections (where step 3 completed in the past) do not execute step 4. I literally am not seeing anything besides Like activities coming from those servers.

                  Existing PieFed and NodeBB integrations continue to work without issue.

                  arachnibotA 1 Reply Last reply
                  0
                  • julian@community.nodebb.orgJ [email protected]

                    After more debugging today I am less convinced that this is a NodeBB issue.

                    I am finding Lemmy communities where federation continues without issue, and others where there is no activity at all.

                    The sequence of events is:

                    1. NodeBB sends out a Follow
                    2. Lemmy responds with a 200 or equivalent
                    3. Lemmy later sends me an Accept
                    4. Lemmy later sends content (posts, upvotes, etc.)

                    startrek.website and ani.social both do everything ok.

                    lemmy.world and mander.xyz fail at step 3, and existing connections (where step 3 completed in the past) do not execute step 4. I literally am not seeing anything besides Like activities coming from those servers.

                    Existing PieFed and NodeBB integrations continue to work without issue.

                    arachnibotA Online
                    arachnibotA Online
                    arachnibot
                    wrote on last edited by
                    #9

                    @[email protected] I'm actually having trouble getting new ani.social posts into my instance. I'm not sure if @[email protected] is having the same problem, but it seems that it grabbed posts from up to 9 days ago, and then stopped federating them in.

                    It says Asserting 0 group(s) when I check the remote category on my instance directly though, so perhaps this is related?

                    julian@community.nodebb.orgJ 1 Reply Last reply
                    0
                    • mradcliffe@nokoto.orgM This user is from outside of this forum
                      mradcliffe@nokoto.orgM This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #10

                      @julian On my implementation, I have not received anything actionable from a lemmy instance recently, but I purge remote posts after about a week. So this may not be NodeBB related. I am following some lemmy.world and lemmy.zip communities. The last federated lemmy activity I received originated at lemmy.ca 4 days, 19 hours ago.

                      1 Reply Last reply
                      0
                      • K This user is from outside of this forum
                        K This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #11

                        Wild.
                        What's really weird is that I know I stopped receiving topics and posts from all of the Lemmy servers I follow communities on on the day I graded from 4.3 to 4.4.1, which was several days after this forum was updated to 4.4.1. Meanwhile, those communities here stopped receiving topics and posts a few days earlier than my forum did (though, I can't say for certain that that was on the day y'all updated to 4.4.1).

                        My follow relationships are rather mature at this point, so it's not like this is an issue with establishing new follow relationships. Old ones are broken, too. Very strange. And also, FWIW, very unidirectional: I can still post into these groups and have my content federated. I'm just not processing or receiving anything coming back my way.

                        I'm up to my eyeballs right now, but I'll try to look more closely into logs this weekend to see if I can identify any paradigm shifts.

                        1 Reply Last reply
                        0
                        • julian@community.nodebb.orgJ This user is from outside of this forum
                          julian@community.nodebb.orgJ This user is from outside of this forum
                          [email protected]
                          wrote on last edited by
                          #12

                          Kichae I suppose it's worth rolling back to 4.3 and figuring out what the change was...! I just wish testing federation wasn't such a long process.

                          1 Reply Last reply
                          0
                          • K This user is from outside of this forum
                            K This user is from outside of this forum
                            [email protected]
                            wrote on last edited by
                            #13

                            It is rather silly that it inter-platform federation so damn fragile. I can't wait until there's a bigger network of nodeBB sites federating.

                            1 Reply Last reply
                            0
                            • julian@community.nodebb.orgJ This user is from outside of this forum
                              julian@community.nodebb.orgJ This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #14

                              Confirming that follow-unfollow-follow-unfollow logic is working as expected against ani.social which means the plumbing actually works.

                              1 Reply Last reply
                              0
                              • arachnibotA arachnibot

                                @[email protected] I'm actually having trouble getting new ani.social posts into my instance. I'm not sure if @[email protected] is having the same problem, but it seems that it grabbed posts from up to 9 days ago, and then stopped federating them in.

                                It says Asserting 0 group(s) when I check the remote category on my instance directly though, so perhaps this is related?

                                julian@community.nodebb.orgJ This user is from outside of this forum
                                julian@community.nodebb.orgJ This user is from outside of this forum
                                [email protected]
                                wrote on last edited by
                                #15

                                [email protected] did you update NodeBB 9 days ago?

                                arachnibotA 1 Reply Last reply
                                0
                                • julian@community.nodebb.orgJ [email protected]

                                  [email protected] did you update NodeBB 9 days ago?

                                  arachnibotA Online
                                  arachnibotA Online
                                  arachnibot
                                  wrote on last edited by
                                  #16

                                  @[email protected] not to my knowledge! I actually reset my instance within the past 7 days, so it's unlikely to be that if I'd guess. It could be an upgrade related script didn't fire, but that's pure speculation

                                  1 Reply Last reply
                                  0
                                  • julian@community.nodebb.orgJ This user is from outside of this forum
                                    julian@community.nodebb.orgJ This user is from outside of this forum
                                    [email protected]
                                    wrote on last edited by
                                    #17

                                    Kichae I ended up opening up an issue on the Lemmy repo and they pointed out that there hasn't been a loss of federation with Lemmy, but that something (likely on the NodeBB end) is throwing errors and causing Lemmy to defer sending activities until after some timeout.

                                    Link Preview Image
                                    Loss of communication from Lemmy · Issue #5722 · LemmyNet/lemmy

                                    I apologize in advance because this issue is absolutely vague as hell, but I will try to be as thorough and succinct as possible. I am receiving reports that an existing NodeBB connection to Lemmy is severed or becomes unreliable after a...

                                    favicon

                                    GitHub (github.com)

                                    julian@community.nodebb.orgJ 1 Reply Last reply
                                    0
                                    • julian@community.nodebb.orgJ [email protected]

                                      Kichae I ended up opening up an issue on the Lemmy repo and they pointed out that there hasn't been a loss of federation with Lemmy, but that something (likely on the NodeBB end) is throwing errors and causing Lemmy to defer sending activities until after some timeout.

                                      Link Preview Image
                                      Loss of communication from Lemmy · Issue #5722 · LemmyNet/lemmy

                                      I apologize in advance because this issue is absolutely vague as hell, but I will try to be as thorough and succinct as possible. I am receiving reports that an existing NodeBB connection to Lemmy is severed or becomes unreliable after a...

                                      favicon

                                      GitHub (github.com)

                                      julian@community.nodebb.orgJ This user is from outside of this forum
                                      julian@community.nodebb.orgJ This user is from outside of this forum
                                      [email protected]
                                      wrote on last edited by
                                      #18

                                      With the Lemmy developers' help, we figured it out! It was NodeBB's spam protection mechanism. One of our configurable options is to limit the number of upvotes one can make per day.

                                      1. Someone (or someones) on Lemmy communities was sending lots of upvotes and running into this limitation when those activities were propagated to NodeBB.
                                      2. NodeBB dutifully noted this and sent back an HTTP 500.
                                      3. Lemmy dutifully noted this and retried sending the activity using an exponential backoff algorithm
                                      4. Eventually enough 500s were recorded that Lemmy decided that our server needed a time-out of sorts 😄

                                      I updated the code to handle this case better, and now the activities are coming in at full speed. It'll take awhile to get back up to sync though 😓

                                      1 Reply Last reply
                                      1
                                      • K [email protected]

                                        After updating from 4.3 to 4.4.1, I noticed that my remote groups stopped updating. I double checked them here, and they're even further behind the group hosts, with the last received topics dating back to 16 May.

                                        d31b2edc-3c5f-46a5-a650-ed39b5699870-image.png

                                        These are all Lemmy-hosted groups, so I'm not sure if it's a Lemmy-specific thing, or group actors more generally.

                                        S This user is from outside of this forum
                                        S This user is from outside of this forum
                                        [email protected]
                                        wrote on last edited by [email protected]
                                        #19

                                        Hello,
                                        I am trying to figure out the malfunction between my lemmy instance (0.19.2 on feddit.it) and my nodebb instance (4.4.4 on citiverse.co.uk).

                                        I am trying to follow from NodeBB some remote communities on lemmy but some work while others do not.

                                        For example: https://citiverse.it/category/[email protected] here I see posts actually made on [email protected] while here: https://citiverse.it/category/[email protected] and https://citiverse.it/category/[email protected] but on many others like https://citiverse.it/category/[email protected] etc it is all blank while communities are followed and have made posts on Lemmy.

                                        I tried following a new community and this is the log I see on NodeBB. Is this correct?

                                        138.199.xx - - [02/Jul/2025:09:35:06 +0000] "GET /category/[email protected] HTTP/1.1" 200 112488 "https://citiverse.it/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        127.0.0.1 - - [02/Jul/2025:09:35:06 +0000] "GET /assets/templates/500.js?_=1751448906900 HTTP/1.0" 200 1029 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        127.0.0.1 - - [02/Jul/2025:09:35:07 +0000] "GET /assets/templates/partials/toast.js?_=1751448906901 HTTP/1.0" 200 1703 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        io: 1 emit [ 'checkSession', 1 ]
                                        io: 1 emit [ 'setHostname', 'citiverse.it' ]
                                        io: 1 on [
                                          {
                                            type: 2,
                                            nsp: '/',
                                            id: 0,
                                            data: [
                                              'meta.rooms.enter',
                                              { enter: 'category_https://feddit.it/c/gdr' }
                                            ]
                                          }
                                        ]
                                        138.199.xx - - [02/Jul/2025:09:35:08 +0000] "PUT /api/v3/categories/https%3A%2F%2Ffeddit.it%2Fc%2Fgdr/watch HTTP/1.1" 200 91 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        io: 1 on [ { type: 2, nsp: '/', id: 14, data: [ 'admin.logs.get', null ] } ]
                                        io: 1 on [ { type: 2, nsp: '/', id: 14, data: [ 'admin.logs.get', null ] } ]
                                        io: 1 on [ { type: 2, nsp: '/', id: 14, data: [ 'admin.logs.get', null ] } ]
                                        

                                        I saw this thread and thought it was correct to answer here even though the problem seems slightly different from what I have read.

                                        Also this log is when i follow a remote community (sport@feddit) from NodeBB:

                                        xxx@citiverse:~/nodebb$ tail -f logs/output.log
                                          {
                                            type: 2,
                                            nsp: '/',
                                            id: 2,
                                            data: [
                                              'meta.rooms.enter',
                                              { enter: 'categoryhttps://poliverso.org/profile/scuola' }
                                            ]
                                          }
                                        ]
                                        66.249.65.76 - - [02/Jul/2025:09:44:05 +0000] "GET /topic/d1de69b7-2712-4b37-8e4e-672213561904/denmark-warns-eu-against-halting-green-transition/6 HTTP/1.1" 200 138470 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.7151.103 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
                                        95.217.234.174 - - [02/Jul/2025:09:44:09 +0000] "GET / HTTP/1.1" 200 163276 "-" "Uptime-Kuma/1.23.16"
                                        138.199.15.170 - - [02/Jul/2025:09:44:18 +0000] "GET /category/[email protected] HTTP/1.1" 200 112839 "https://citiverse.it/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        127.0.0.1 - - [02/Jul/2025:09:44:18 +0000] "GET /assets/templates/partials/toast.js?=1751449458515 HTTP/1.0" 200 1703 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        127.0.0.1 - - [02/Jul/2025:09:44:18 +0000] "GET /assets/templates/500.js?_=1751449458514 HTTP/1.0" 200 1029 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        io: 1 emit [ 'checkSession', 1 ]
                                        io: 1 emit [ 'setHostname', 'citiverse.it' ]
                                        io: 1 on [
                                          {
                                            type: 2,
                                            nsp: '/',
                                            id: 0,
                                            data: [
                                              'meta.rooms.enter',
                                              { enter: 'categoryhttps://feddit.it/c/sport' }
                                            ]
                                          }
                                        ]
                                        io: 2 on [
                                          {
                                            type: 2,
                                            nsp: '/',
                                            id: 3,
                                            data: [ 'meta.rooms.leaveCurrent', null ]
                                          }
                                        ]
                                        31.191.7.80 - - [02/Jul/2025:09:44:22 +0000] "GET /api/categories?=1751449323260 HTTP/1.1" 200 70211 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36"
                                        127.0.0.1 - - [02/Jul/2025:09:44:22 +0000] "GET /assets/templates/categories.js?_=1751449323261 HTTP/1.0" 200 35361 "https://citiverse.it/categories" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36"
                                        io: 2 on [
                                          {
                                            type: 2,
                                            nsp: '/',
                                            id: 4,
                                            data: [ 'meta.rooms.enter', { enter: 'categories' } ]
                                          }
                                        ]
                                        138.199.15.170 - - [02/Jul/2025:09:44:23 +0000] "PUT /api/v3/categories/https%3A%2F%2Ffeddit.it%2Fc%2Fsport/watch HTTP/1.1" 200 93 "https://citiverse.it/category/[email protected]" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0"
                                        
                                        1 Reply Last reply
                                        1
                                        • S This user is from outside of this forum
                                          S This user is from outside of this forum
                                          [email protected]
                                          wrote on last edited by
                                          #20

                                          hello,
                                          I am writing to say that I have probably figured out the federation problem between Lemmy and NodeBB that I had so if it happens to anyone else they can fix it.

                                          After going through the logs and doing several tests, the problem was the “minimum reputation to post links” activation that I had entered. This way fediverse users, who evidently have zero reputation, could not post links so any posts that came from the fediverse with a link were simply not created.

                                          I set this option to “zero” and everything seems to be working fine now.

                                          image.png

                                          Link Preview Image
                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups

                                          Looks like your connection to NodeBB was lost, please wait while we try to reconnect.