402 Payment Required on apt update (cloudsmith)

[digitalsparky]

Hi folks,

Just FYI, looks like you're starting to hit those limits again. Getting payment-required notifications when attempting to run apt update.

Error: Failed to fetch https://dl.cloudsmith.io/public/caddy/xcaddy/deb/debian/dists/any-version/InRelease 402 Payment Required [IP: ************ 443]

Ping @BartoszBlizniak / @prinkpan / @francislavoie

Previous related ticket #100

Thanks to you both (caddyserver contribs and cloudsmith) heaps for your awesome work!

Cheers

Matt

[tonyallan]

+1

[Lloir]

@BartoszBlizniak Able to help caddy out again pleaseeeee? ;) <3

( I know I'm being cheeky ) but don't ask you don't get

[stnby]

Maybe switching away from cloudsmith could be considered? Not the first time this has happened.

[BartoszBlizniak]

Hey @digitalsparky and @Lloir - Sorry, just seeing this now! Let me check with the team on our side and get back to you ASAP.

[francislavoie]

Looks like download usage has been increasing dramatically month to month... 2 months ago we had 1TB bandwidth used, last month 1.3TB, now this month 2TB, which is our current quota setting. It would roll over on Monday.

If any of you are using the apt repo in CI, I implore you to enable caching to avoid hammering Cloudsmith.

Thanks so much @BartoszBlizniak for noticing the alert!

[BartoszBlizniak]

Hey @francislavoie (and everyone else!). We have increased the bandwidth by an additional 500gb to help users get unblocked. I've also notified our growth team to discuss what we can do to help the project grow.

We do apologise for the disruption. In the meantime, we would also recommend creating an alert based on our OSS API in order to prevent this in the future.

Wish you a good holiday from Cloudsmith 💙

[tonyallan]

Thank you very much @BartoszBlizniak for your very quick response.

[francislavoie]

Thanks @BartoszBlizniak!

I could've sworn we had usage alerts enabled on our account at some point. Did that feature go away? 😣 I can't find settings for it anymore in our account.

Is there anything you can do on your end to slow down abusive users? I don't think there's much we can do on our end, we have no control over this since it's obviously a public project. If you're able to rate limit by IP address, that would certainly make sense I think.

Also I'd like to remind everyone that you can always download the .deb from https://github.com/caddyserver/caddy/releases if this happens again. Likely a better option to pin to a specific version if you're using Caddy in your CI pipelines.

[BartoszBlizniak]

Hey @francislavoie - let's discuss this over our support portal after the holiday period and see how we can address all your concerns here.

[digitalsparky]

Awesome sauce, thanks all! Marking Closed :).

[mholt]

Appreciate the quick response while I was sleeping! 😅

We are very grateful to Cloudsmith for allowing our use of your services. Apologies for the growth 🫤

[bananer]

I'm getting a 402 response from the cloudsmith repository right now.

[mholt]

This thread has been resolved, the new error is a recurrence due to abuse, see #115