Skip to content

Commit

Permalink
Adds detection for OpenVAS, Telegram, Webex Teams and improves detect…
Browse files Browse the repository at this point in the history
…ion for Semrush bots (#7980)

* Adds detection for BacklinksExtendedBot
* Adds detection for Webex Teams
* Adds detection for Telegram
* Adds detection for OpenVAS

ref #7979
  • Loading branch information
liviuconcioiu authored Jan 30, 2025
1 parent c6a02b0 commit 2d04b69
Show file tree
Hide file tree
Showing 4 changed files with 50 additions and 0 deletions.
18 changes: 18 additions & 0 deletions Tests/Parser/Client/fixtures/mobile_app.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2333,3 +2333,21 @@
type: mobile app
name: YouTube
version: 1.92.52
-
user_agent: WebexTeams
client:
type: mobile app
name: Webex Teams
version: ""
-
user_agent: Telegram/29835 CFNetwork/1333.0.4 Darwin/21.5.0
client:
type: mobile app
name: Telegram
version: ""
-
user_agent: 'Mozilla/5.0 [en] (X11, U; OpenVAS-VT 9.0.3)'
client:
type: mobile app
name: OpenVAS
version: 9.0.3
9 changes: 9 additions & 0 deletions Tests/fixtures/bots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8448,3 +8448,12 @@
producer:
name: SiteSell Inc.
url: https://www.sitesell.com/
-
user_agent: Mozilla/5.0 (compatible; BacklinksExtendedBot)
bot:
name: BacklinksExtendedBot
category: Crawler
url: https://www.semrush.com/bot/
producer:
name: Semrush Inc.
url: https://www.semrush.com/
8 changes: 8 additions & 0 deletions regexes/bots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1462,6 +1462,14 @@
name: 'Semrush Inc.'
url: 'https://www.semrush.com/'

- regex: 'BacklinksExtendedBot'
name: 'BacklinksExtendedBot'
category: 'Crawler'
url: 'https://www.semrush.com/bot/'
producer:
name: 'Semrush Inc.'
url: 'https://www.semrush.com/'

- regex: 'SerpReputationManagementAgent/[\d.]+'
name: 'Semrush Reputation Management'
category: 'Service Agent'
Expand Down
15 changes: 15 additions & 0 deletions regexes/client/mobile_apps.yml
Original file line number Diff line number Diff line change
Expand Up @@ -248,6 +248,11 @@
name: 'AN WhatsApp'
version: '$1'

# Telegram (https://apps.apple.com/us/app/telegram-messenger/id686449807)
- regex: 'Telegram/(\d+[.\d]+) CFNetwork'
name: 'Telegram'
version: ''

# https://music.youtube.com
- regex: '(?:^com\.google\.android\.apps\.youtube\.music/|^YouTubeMusic(?:Dev)?/)([\d.]+)?'
name: 'Youtube Music'
Expand Down Expand Up @@ -550,6 +555,11 @@
name: 'Skype for Business'
version: '$1'

# Webex Teams (https://www.webex.com/)
- regex: 'WebexTeams'
name: 'Webex Teams'
version: ''

# GroupMe (https://apps.apple.com/us/app/groupme/id392796698)
- regex: 'GroupMe/([\d.]+)'
name: 'GroupMe'
Expand Down Expand Up @@ -2636,6 +2646,11 @@
name: 'HeartFocus Education'
version: '$1'

# OpenVAS (https://www.openvas.org/)
- regex: 'OpenVAS-VT ([\d.]+)'
name: 'OpenVAS'
version: '$1'

# Electron generic apps
- regex: ' (?!(?:AppleWebKit|brave|Cypress|Franz|Mailspring|Notion|Basecamp|Evernote|catalyst|ramboxpro|BlueMail|BeakerBrowser|Dezor|TweakStyle|Colibri|Polypane|Singlebox|Skye|VibeMate|(?:d|LT|Glass|Sushi|Flash|OhHai)Browser|Sizzy))([a-z0-9]*)(?:-desktop|-electron-app)?/(\d+\.[\d.]+).*Electron/'
name: '$1'
Expand Down

0 comments on commit 2d04b69

Please sign in to comment.