Author Topic: Anubis  (Read 61345 times)

Dave Yeo

  • Hero Member
  • *****
  • Posts: 6054
  • Karma: +167/-1
Anubis
« on: April 14, 2026, 06:43:47 pm »
See that OS2World has enabled Anubis to block bots. SeaMonkey hangs at the "Making sure you're not a bot!" stage.
By enabling cookies, restarting, Dooble-Qt6 does eventually pass and I'm posting from Dooble-Qt6, which I wish was more stable.

Kim

  • Newbie
  • *
  • Posts: 40
  • Karma: +6/-0
Re: Anubis
« Reply #1 on: April 14, 2026, 08:45:33 pm »
Yes, both the forum but specially the wiki was hammered by bots so we had to do something about it even if both the nginx proxy did block a bit but the new environment can keep up with way more loads but not enough to what the bot nets are throwing at us. Not sure who Martin manage to upset with the wiki  ;D

Dave Yeo

  • Hero Member
  • *****
  • Posts: 6054
  • Karma: +167/-1
Re: Anubis
« Reply #2 on: April 14, 2026, 10:13:23 pm »
Well, one good thing is that the forum also loads with Dooble-Qt5.
Both Doobles do fail to remember the login.

Martin Iturbide

  • OS2World NewsMaster
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 5880
  • Karma: +50/-1
  • Your Friend Wil Declares...
    • Martin's Personal Blog
Re: Anubis
« Reply #3 on: April 14, 2026, 10:17:51 pm »
Not sure who Martin manage to upset with the wiki  ;D
I have many enemies, I will prefer if they identity themself.  ;D ;D
Martin Iturbide
OS2World NewsMaster
... just share the dream.

Martin Iturbide

  • OS2World NewsMaster
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 5880
  • Karma: +50/-1
  • Your Friend Wil Declares...
    • Martin's Personal Blog
Re: Anubis
« Reply #4 on: April 14, 2026, 11:47:20 pm »
Hello Kim

Do you think that nginx may have a feature to do something like "If the Browser Agent is OS/2, go directly to the site instead of Anubis" ? 
But it depends if it has that feature, and it opens the door to the bots to use the OS/2 Agent to hammer the site.

Regards
Martin Iturbide
OS2World NewsMaster
... just share the dream.

Dariusz Piatkowski

  • Hero Member
  • *****
  • Posts: 1570
  • Karma: +44/-0
Re: Anubis
« Reply #5 on: April 15, 2026, 12:12:30 am »
...Do you think that nginx may have a feature to do something like "If the Browser Agent is OS/2, go directly to the site instead of Anubis" ? ...

Yeah, please do b/c otherwise on our good ol' FF 45.9 this is absolutely a DEAD-END..or at least for now I haven't figured out yet how to actually get through!

Kim

  • Newbie
  • *
  • Posts: 40
  • Karma: +6/-0
Re: Anubis
« Reply #6 on: April 15, 2026, 12:31:18 am »
Do you think that nginx may have a feature to do something like "If the Browser Agent is OS/2, go directly to the site instead of Anubis" ?  But it depends if it has that feature, and it opens the door to the bots to use the OS/2 Agent to hammer the site.

Problem is that the browser agent can be spoofed as well and which is used when you want to hide the true browser identity and this would then be something to add to Anubis but reluctant to add this since it would be matter of time that the bots figured out this. But we can give it a try and I just need the exact UA string for the browser to be used for the user_agent_regex to create the bypass rule.

Kim

  • Newbie
  • *
  • Posts: 40
  • Karma: +6/-0
Re: Anubis
« Reply #7 on: April 15, 2026, 12:43:07 am »
btw, here is what I wound so far with regards to user agent strings which simply mean that I can use OS/2 as the UA string; just a bit generic, ok, I'll take a look at it tomorrow.

Code: [Select]
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2022.10.15"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2024.11.17"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2025.07.04"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/6.2.6 Chrome/94.0.4606.126 Safari/537.36 Dooble/2025.11.25"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:24.0) Gecko/20100101 Firefox/24.0"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:31.0) Gecko/20100101 Firefox/31.0"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:38.0) Gecko/20100101 Firefox/38.0 SeaMonkey/2.35"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0 SeaMonkey/2.42.9esr Lightning/4.7.9"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0 SeaMonkey/2.42.9esr"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0"
"user_agent":"Mozilla/5.0 (Unknown; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36"
« Last Edit: April 15, 2026, 12:45:29 am by Kim »

Kim

  • Newbie
  • *
  • Posts: 40
  • Karma: +6/-0
Re: Anubis
« Reply #8 on: April 15, 2026, 12:50:09 am »
Well, one good thing is that the forum also loads with Dooble-Qt5.
Both Doobles do fail to remember the login.

So you can login but the session is maintained and you have to login again; does this apply to all of the sites; main site, forum and wiki? Might be able to find a solution with a bit more input.

Dave Yeo

  • Hero Member
  • *****
  • Posts: 6054
  • Karma: +167/-1
Re: Anubis
« Reply #9 on: April 15, 2026, 01:34:43 am »
Well, one good thing is that the forum also loads with Dooble-Qt5.
Both Doobles do fail to remember the login.

So you can login but the session is maintained and you have to login again; does this apply to all of the sites; main site, forum and wiki? Might be able to find a solution with a bit more input.

Hmm, seems to be finally remembering my login, perhaps due to the changes to cookie management I had to do. I'll keep an eye on it and if it fails, will post.
ps, your list of user agents looks pretty complete for what is likely to be used. The QtWebEngine ones do pass Anubis so just the Gecko ones would need an exception. I'll try Thunderbird 45.8 (Thunderbrowse) which I'm not sure of the user agent but should now be in your log.
Thanks

Dariusz Piatkowski

  • Hero Member
  • *****
  • Posts: 1570
  • Karma: +44/-0
Re: Anubis
« Reply #10 on: April 15, 2026, 02:36:47 am »
btw, here is what I wound so far with regards to user agent strings which simply mean that I can use OS/2 as the UA string; just a bit generic, ok, I'll take a look at it tomorrow.

Code: [Select]
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2022.10.15"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2024.11.17"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36 Dooble/2025.07.04"
"user_agent":"Mozilla/5.0 (OS/2; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/6.2.6 Chrome/94.0.4606.126 Safari/537.36 Dooble/2025.11.25"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:24.0) Gecko/20100101 Firefox/24.0"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:31.0) Gecko/20100101 Firefox/31.0"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:38.0) Gecko/20100101 Firefox/38.0 SeaMonkey/2.35"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0 SeaMonkey/2.42.9esr Lightning/4.7.9"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0 SeaMonkey/2.42.9esr"
"user_agent":"Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0"
"user_agent":"Mozilla/5.0 (Unknown; OS/2 i386) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.15.2 Chrome/83.0.4103.122 Safari/537.36"

Here is what my plaine-Jane FF 45.9 returns: 'Mozilla/5.0 (OS/2; Warp 4.5; rv:45.0) Gecko/20100101 Firefox/45.0', so it matches one of those in your list, but same results...are we expecting this to work now?

Dave Yeo

  • Hero Member
  • *****
  • Posts: 6054
  • Karma: +167/-1
Re: Anubis
« Reply #11 on: April 15, 2026, 04:38:54 am »
Hi Kim. If I load the recent Unread Topics page, I have to relog in. If I go directly to a topic, I don't have to log in.
@Dariusz, I think it is currently a work in progress whether to allow our Mozilla apps to directly connect.

Dariusz Piatkowski

  • Hero Member
  • *****
  • Posts: 1570
  • Karma: +44/-0
Re: Anubis
« Reply #12 on: April 15, 2026, 05:00:54 am »
You know, something else we could consider: make up an OS2World specific User Agent string that while conveying the kind of information other sites may be looking for already, does provide very specific ID confirmation to the OS2World forum that only "we would know" about, and so the risk of it being used by the 'enemy' is lower???

Steven Levine

  • Full Member
  • ***
  • Posts: 150
  • Karma: +16/-0
Re: Anubis
« Reply #13 on: April 15, 2026, 07:19:11 am »

FWIW, what I am  currently using for sites that are looking for Mozilla in the UA to trigger the proof of work is:'

  OS2zilla/5.0 (X11; Linux x86_64; rv:128.0) Gecko/20100101 SeaMonkey/2.53.23

This works here and on edm/2 and a number of other sites that use a simple match to trigger.


Dave Yeo

  • Hero Member
  • *****
  • Posts: 6054
  • Karma: +167/-1
Re: Anubis
« Reply #14 on: April 15, 2026, 08:06:50 am »
Interesting, works here with our SeaMonkey. Guess Kim implemented some UA check.