I've been using Monito.RSS Discord bot for a few months in my personal channel with friends to have a feed of the latest deals, however since the 4th it's been returning "Cloudflare error code 403" suddenly.
Further digging says this may of been a change by the owners. Could we please get some light shining on this? Cheers!
My personal discord server. Appears someone else I know has the same issue with their personal discord as well.
MonitoRSS (https://monitorss.xyz/) is the discord bot we use to post each deal from the RSS in the channel.
The FAQ says:
Some sites use Cloudflare to block non-human visitors to their site. Unfortunately the bot cannot bypass these protections. Cloudflare protections may be placed or lifted at its discretion at any time (usually when the site is facing an attack), which may result in inconsistent failures.
and I see your discussion in the Discord but I don't see any instructions from MonitoRSS what (as in the IP address or server) site owners need to unblock.
Ah, seems I missed that in the FAQ. Thank you, I'll see what I can work out :)
Any luck? I also use MonitoRSS
There is a reply from the service as below:
you may report the bot's IP as 54.39.103.238, however -
if @MonitoRSS is the one that made 9000 requests a day, then them blocking it is justified and something needs to be corrected on my end
otherwise, a rough calculate would say @MonitoRSS would typically make roughly 3-4k requests a day which is up to the site to see if that number is acceptable.
Thanks. We have now unblocked that IP address.
Explanation:
That indeed was the IP address that we blocked. We did attempt to investigate what service was using that IP address but couldn't find any further information.
We have RSS feeds for the usual comps, deals, products/tags, brands, stores which are cached. One of the RSS feeds is for our competition filter which is not cached as it depends what is set in the filter. This filter is very expensive in terms of database query and when we blocked the IP address last week, we were having some site speed issues. We've now removed the filter from RSS and will instead just pull our normal cached competition RSS feeds.
Entire breakdown of log:
145 /brand/anker/feed
145 /brand/elgato/feed
145 /brand/lifx/feed
145 /cat/computing/deals/feed
145 /cat/computing/feed
145 /cat/dining-takeaway/deals/feed
144 /cat/dining-takeaway/feed
145 /cat/electrical-electronics/feed
144 /cat/fashion-apparel/deals/feed
145 /cat/gaming/deals/feed
145 /cat/gaming/feed
144 /cat/mobile/feed
144 /competition/all/feed
142 /competition/all/feed?filter_types=1&comp_type[]=71692&comp_type[]=71689&comp_type[]=71688&comp_type[]=71693&filter_methods=0&filter_reqmts=0&location=72354&entry_limit=&exclude_closed=1
145 /deals/aldi.com.au/feed
145 /deals/ebgames.com.au/feed
145 /deals/epicgames.com/feed
145 /deals/esteelauder.com.au/feed
860 /deals/feed
145 /deals/gog.com/feed
288 /deals/popular/feed
145 /deals/popular/feed?days=7
145 /deals/steampowered.com/feed
143 /deals/techfast.com.au/feed
145 /deals/timezonegames.com/feed
145 /deals/ubisoft.com/feed
290 /feed
288 /freebies/feed
145 /product/apple-magic-trackpad-2/feed
143 /product/asus-rt-ax86u/feed
144 /product/nvidia-shield-tv-2019/feed
144 /product/nvidia-shield-tv-pro-2019/feed
145 /product/philips-hue/feed
145 /product/playstation-4-pro/feed
145 /product/playstation-5/feed
145 /product/seagate-expansion/feed
142 /product/sonos-beam/feed
145 /product/steam-link/feed
145 /product/waterpik-wp100/feed
134 /product/xbox-elite-wireless-controller-series-2/feed
145 /product/xbox-one-elite-controller-series-2/feed
145 /product/xbox-series-x/feed
143 /tag/3d-printer/feed
145 /tag/android-app/feed
145 /tag/blu-ray/feed
142 /tag/camera-lens/feed
145 /tag/dvd/feed
145 /tag/hard-drive/feed
142 /tag/lcd-monitor/feed
145 /tag/mobile-phone/feed
145 /tag/prepaid-mobile-plan/feed
145 /tag/ps5-game/feed
142 /tag/ram/feed
290 /tag/ssd/feed
145 /tag/steam-game/feed
145 /tag/switch-game/feed
145 /tag/web-hosting/feed
So while there are probably Discords using MonitoRSS to grab our standard new deals & hot deals, there are some people pulling some specific items from OzBargain. In any case, as we technically publish all of those RSS feeds then there is no issue for RSS readers or bots to request the feeds. There shouldn't be anything that MonitoRSS needs to do and the bots should start working again shortly.
Excellent. Thankyou for the update (sorry I didn't spot this earlier). All seems to be working on this end!
Looks like its back to being blocked again. Bugger. Was running great for months!
54.39.103.238 is not blocked, 4000+ requests so far today.
Its only just come back to life in my server @ 3:11pm AEDST.
RSS feeds are working. We did block a server on the 4th for making 9000+ requests a day to our server. What is the server you are running it on?