AliveDevil/lists
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update Crawler

Browse source
This commit is contained in:
Jöran Malek 2025-09-30 22:50:17 +02:00
parent 59f401503e
commit 61d103f1d5
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
bad_user_agents.regex.txt
View file

@ -1,6 +1,6 @@
\bbytedance\b \bbytedance\b
\bBytespider\b \bBytespider\b
\bChatGPT\b \bChatGPT-User\b
\bclaudebot\b \bclaudebot\b
\bfacebookexternalhit\b \bfacebookexternalhit\b
\bOAI-SearchBot\b \bOAI-SearchBot\b