@kristinHenry @andypiper @frozencanuck @mike @anca The SFBA.social team meets IRL almost every month. Happy to have you and other #mastoadmin in the Bay Area next time we meet.
🤓🚨 16-hours after I reported the #BackBlaze US East outage/disruptions after thousands of S3 errors in SideKiq, Backblaze confirms there are ongoing issues. #MastoAdmin #BackblazeB2
Their status page is https://status.backblaze.com/
Current status for US East is, "Users may be encountering intermittent failures on uploads and downloads."
Not sure why he said EU Central...
Aside from relays and adding elastic search to a mastodon instance does anyone have any other things they do to enhance the user experience? #mastoadmin
I've received my first "report" on hugs.lgbt and I'm very confused ....
Two posts were reported ... neither were from hugs.lgbt posts ... one was a reply to one of my posts by a mutual, the other was a post by that mutual without any hugs.lgbt involvement ...
Did I receive the report because one of those was a reply to a post of mine?
But why the other one?
Also very confused as to why ... the first was a thank you reply to a post from me.
The other was a meme.
The category was "other" but no notes or any other information that I could discern 🤔 🤷♂️
Backblaze was down for me for around the last 10 minutes as of this post
Edit: It's still down. Status.backblaze.com has no issues
Sidekiq errorL Aws::S3::Errors::ServiceUnavailable: Service temporarily unavailable, please try again
Images were blank but seem back now
#Backblaze #MastoAdmin
I'm having issues they can't resolve lately. B2B doesn't play nice with Mastodon. Any good, reasonably priced alternatives? Refer-a-friend links won't insult me
I do not understand how I have almost 8 gb of status data in my database for gardenstate.social. in the last 7 days it grew 8k? at 8k a week my server would have to run for 973 weeks to get to 8 gb.
I often run the cli script that removes unreferenced statuses. I feel like this should be much smaller!
1.71 GB of EMOJI?
7.13 GB of avatars?
shouldn't the cli script that removes unreferenced statuses make this much smaller?
My server only has 70 - 100 active users a month!
Ok I should really know this but can’t find the setting for the life of me. How do I get a little icon on the bottom right hand corner of my profile picture? #mastoadmin #mastodon just like below
Yeah, I'd call this a problem somewhere. #nofiles open files of the mastodon user, which just runs mastodon.
@derek @michael
@derek @haploc
So it seems it's possibly a bug, but the odd thing is that it doesn't hit everyone.
https://github.com/mastodon/mastodon/issues/18063
Does anyone have a very detailed and comprehensive guide on how to scale up a Mastodon server?
I'm pretty noobish to Linux but I can follow guides if they have commands and stuff. Though, the only guides I could find were very light on the commands for certain steps.
My Sidekiq has been getting backed up every now and then with thousands of jobs. Of course they eventually clear out but I'd like to just mitigate it by adding more processes or whatever because I'm not even using 50% of my server resources🤷♂️
Any help would be much appreciated.
PS. My server is currently backed up so if you reply to this, I probably won't see it for a bit.😬
#Mastodon #MastoAdmin #FediAdmin #Fedi #Fediverse #ActivityPub #MastoHelp
2/ I'm sure others can add or even help me with anything I got wrong, or how I can improve this, but here is what I did today out of urgency to scale my Mastodon Sidekiq processes and jobs after getting backlogged twice this week.
#MastoAdmin
cc @trendless @shanie
https://gist.github.com/p37307/fcd57ba2bea46c2b3e6095ed21e800d1
645 days after setting up my own Mastodon instance, I finally tackled tuning my Postgres database config last wk & today setup multiple Sidekiq Processes after my queue got to 10K for the second time this wk
I read the guides multiple times over those 645 days but it never clicked in my head. I was afraid to mess with Sidekiq because I didn't want to brick my instance.
Then today, during the thunderstorm, the old grey cells clicked in and I understood.
Queue cleared up quickly
#MastoAdmin .
645 days after setting up my own Mastodon instance, I finally tackled tuning my Postgres database config last wk & today setup multiple Sidekiq Processes after my queue got to 10K for the second time this wk
I read the guides multiple times over those 645 days but it never clicked in my head. I was afraid to mess with Sidekiq because I didn't want to brick my instance.
Then today, during the thunderstorm, the old grey cells clicked in and I understood.
Queue cleared up quickly
#MastoAdmin .
2/ I'm sure others can add or even help me with anything I got wrong, or how I can improve this, but here is what I did today out of urgency to scale my Mastodon Sidekiq processes and jobs after getting backlogged twice this week.
#MastoAdmin
cc @trendless @shanie
https://gist.github.com/p37307/fcd57ba2bea46c2b3e6095ed21e800d1
So, creating a block to refuse media doesn't affect the blocked domain's ability to create Preview Cards?
I created several media blocks for instances, esp bot instances that I want to come across posts or follow a few accounts, hoping to control my media storage and stop unnecessary media downloads and SideKiq jobs on posts that will only be stored in my search database from the federated timeline, but the preview cards are still being created. #MastoAdmin #MastoDev
That feel when you tweak something on another service for a totally different product and it knocks Mastodon out but you don't notice for like a day so now you need to advise the world that, no, tails.ch is not dead, just did a oopsie. 👀
#mastoadmin
#sidekiq finally got through it's 10k backlog. #mastoadmin
There are several #MastoDev 'Help Wanted' requests from the Mastodon #developers if you are a #coder #Programmer
*Use /search for search (/search?query=something)
*Move account secrets to a dedicated table (and encrypt it?)
*Add a way for the user to select which languages they understand
*Allow admins to configure instance favicon and logo
*Allow searching for hashtags in admin UI
*Convert Redux state to Typescript #MastoAdmin #devops #Programmers #dev.
Thanks. I see a couple weeks ago, #MastoDev put out a 'Help Wanted' post to implement this.
What's the proper URL for searching through Mastodon if you were doing a search via a URL?
For example, searching 'SearchContent has: media" Google would be https://www.google.com/search?q=searchcontent+has%3A+media"
I would like to add my Mastodon instance to my browsers search engines list. Interestingly, Miskey and Sharkey and some other federated platforms I've been to are already added.
I'm getting great results for content from my Mastodon search than Google and Bing, + no ads, and tracking.
Like clockwork, on Wednesdays, my Sidekiq pull Queues jump to 3K most of the day. After a half a day or so, it comes back around.
I wonder if there is a post dump by a bot or some task my server is doing? I am thinking a weekly task must be running.
I need to dig into my logs, crons, etc.
Ugh. I have so much resentment for Fedi admins who shut down instances without doing their due diligence to make sure their users are taken care of.🤬🤦♂️
Worst, if you make an announcement about a shutdown, claiming you'll help, then proceed to delete that announcement and then your account, making getting that help impossible.🙄
Like wtf.
My only issue with the removal tasks is, if you use Elasticsearch and run 'tootctl statuses remove', does it remove statuses from the search database?
I don't run that command because I want to find posts sometimes. I'm using my instance as my primary Google Search replacement. I am getting more useful finds here than Google these days.
I've asked before to no avail. I'd really like to know if it does remove stuff from Elasticsearch. #MastoAdmin
Useless to send to .social admins. They admin and moderate the .social website. (yes, I know, there is some dev crossover, same people, two hats.😉 )
Best, if someone wants to have an issue dealt with to notify devs, is to do so on GitHub where the devs and troubleshooting community are, filed under issues or discussions.
With that said, I am doublechecking my paths, esp old config files. 😂
Thanks for the #mastoadmin tag on your post, @vga256
My Mastodon server, cyberplace.social, has received a legal threat in an attempt to have a user's thread deleted. It is styled as a cease and desist.
I have published the email here:
https://github.com/GossiTheDog/Cyberplace/blob/main/LegalThreats/Cease%20and%20Desist%20Order%20-%20Felix%20Juhl
I performed a MTR (Matt's (MY) Traceroute) on my Mastodon S3 storage ( s3.us-east-005.backblazeb2.com) , which is #BackBlaze #BackblazeB2
I used their ingress point for the test. ca005.backblaze.com resolves directly to their ingress points rather than the s3 url.
Any thoughts, #MastoAdmin #Network #IT on performance, etc. Any comments welcome. I am in a help ticket with one of their Technical Support Engineers.
I'm getting several 443 errors in my Sidekiq jobs, as well as other issues
After 9 months, I FINALLY follow enough people to have a "decent" Trending page with 6-7 posts!😅
It sucks that single user instances have to deal with this issue, but it's unfortunately how Mastodon decided to build the feature. It does leave me wondering though, if it could be changed to federate "Favorites" or, if it's too heavy on the servers, make it an option to turn on or off as wanted?
I don't know if it's possible, but I just know the Trending feature on single-user instances are almost completely useless most of the time.😩
Why can EU companies not use US-based cloud infrastructure and SaaS products?
Section 702 of the Foreign Intelligence Surveillance Act allows the US government to force US companies to share foreign customer data without a warrant or disclosure.
There is no way to reconcile US govt surveillance with the EU’s Charter of Fundamental Rights on privacy.
More on 702:
• https://www.theverge.com/2024/4/20/24135339/fisa-720-reauthorization-senate-lapse-durbin-wyden
• https://www.eff.org/pages/upstream-prism
More on EU rulings: https://en.wikipedia.org/wiki/EU%E2%80%93US_Privacy_Shield
My #SelfHosted Mastodon instance has processed 129,277,027 #SideKiq jobs since November 20, 2022. 1.77 million failed.
How many upgrades have we done since Nov 2022?
I am just thankful I haven't bricked my Mastodon instance, esp when we have to upgrade prerequisites.
🤓
Curious, where does your instance stand in SideKiq Jobs and how long.
#MastoAdmin
I came across this interesting bit about multiple Mastodon-instances on a single server, howbeit, it's from 2018 and there have been a lot of changes since then.
The author wanted to run two instances off the same base code, different databases, re-using as much existing infrastructure as it could, essentially, and appears to have done so.
I don't know why anyone, other than wanting to migrate their instance to a new one, would do this, but here it is. #MastoAdmin
https://nfgworld.com/multiple-mastodon-instances-on-a-single-server/
Urgent: PuTTY 0.81, released on 4/15/2024, fixes a critical vulnerability CVE-2024-31497 in the use of 521-bit ECDSA keys (ecdsa-sha2-nistp521). If you have used a 521-bit ECDSA private key with any previous version of PuTTY, consider the private key compromised: remove the public key from authorized_keys files, and generate a new key pair.
Should update FileZilla and other software, too, for same reason. #MastoAdmin
https://www.chiark.greenend.org.uk/~sgtatham/putty/
CVE: https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-31497
Feeds do Flipboard
Admin de instância, se você quer ver feeds do Flipboard na linha Global da sua comunidade, basta adicionar o relay deles e aguardar a aprovação:
https://flipboard.com/actor/inbox
Uma vez que autorizem (avaliam diariamente), você começará a ver posts com a curadoria do Flipboard aparecerem na linha federada.
Scheduler::VacuumScheduler and Scheduler::UserCleanupScheduler run at the time I am most active. I am sure that is why I have some weird issues when I am surfing my timeline, like when it goes blank. Is there any way to alter the time that they run in SideKiq? If they could run at like noon instead of midnight that would be great.
I've been tweaking the #nginx configuration for my #gotosocial instance. Going to run it for a bit to see that everything is fine.
There's a hashtag #mastoadmin for #mastodon admins, I think us GoToSocial admins need to make #gotosocialadmin a thing.
I've been tweaking the #nginx configuration for my #gotosocial instance. Going to run it for a bit to see that everything is fine.
There's a hashtag #mastoadmin for #mastodon admins, I think us GoToSocial admins need to make #gotosocialadmin a thing.
I'm in the middle of year two of my selfhosted Mastodon instance.
I keep having this urge to backup my database, go offline, migrate my VPS to a dedicated box instead of shared, setup the server again with more tools I need, maybe even a webhost panel so I can move my mostly static other domains and email over, reinstall Mastodon, import my db so I will have a slicker, less patchwork, less "Oh crap, I want to install this, hope it plays nice with my current setup," server setup.
Huh. Is the domain validation done on a user's home instance and the validation info is sent to each remote instance? Or is it done on each remote instance that knows of the user? It kind of seems like it is the latter.
I'm not sure if #gotosocial does domain validation since it doesn't show anything on my profile here on my home instance.
Does anyone know if there's an easy way to check whether a Mastodon instance has switched on "Authorized Fetch"?
IFTAS releases a practical guide for fediverse admins and platform creators (among others) subject to the EU’s Digital Services Act. Which would be…everyone.
Bookmark this one.
https://about.iftas.org/2024/04/09/dsa-guide-for-the-fediverse/
It's been a little while since I posted tracking updates for Mastodon CVE-2024-23832 which was released on February 2, so here we go.
Patched versions are those released on or after that date, so:
- 4.3.0-nightly.2024-02-02+
- 4.3.0-alpha.1+
- 4.2.5+
- 4.1.13+
- 4.0.13+ (EOL)
- 3.5.17+ (EOL)
13% of active servers (meaning it's responded to my queries in the last week and reports someone is still using the instance) still have still not patched over two months later.
However, these are mostly servers with a handful of users and as a result overall user coverage still looks good at 97%.
We need a better management panel for domains. Something that gives us more info about the domains without the need to open each domain up separately
It would be nice to see the amount of storage they are taking up, how many follow/followers
I've found many domains that are storing gigabytes of media files where there is no relationship
A more detailed panel would allow us to determine if we should set a "none" media block
Anyone know of a tool or db script to pull the info? #MastoAdmin .
Questions for #AskMastodon
1) Can one import and use a follow list from one account to another regardless if an account is formally "moved" or not?
2) I started with an account on mstdn.ca... is it possible to "reactivate” that account after the transfer/move so that it no longer redirects to the 'new' account?
We have now successfully upgraded to v4.3.0-alpha.3+mementomods-2024-04-06 + Mastodon Bird UI 2.0.0rc36.
The branch is now synced and up-to-date and 115 commits ahead from the last version (2024-03-22).
This version contains some fixes to both Mastodon and Mastodon Bird UI.
I love running the newest version so I can test ahead in production to the upcoming Mastodon Bird UI versions. I do have my local instance with the production db, but it is far more fun this way and it feels good to have new things.
This "testing in live" is also because it's the perfect way to make sure that I can help contributing to Mastodon and spot bugs before they end up in the final rc, beta or stable versions. There most probably will be some minor bugs, but the earlier we tackle them the better.
As usual, please tell me about any strange things you may encounter with this Mastodon version. We're running bleeding edge after all.
I hope you enjoy your time here. Feel free to send me a message if you have anything in mind. 
#MementoMoriSocial #MastoAdmin #Mastodon #MastodonBirdUI #BirdUI
HIGHLY recommend Fediblock for user '@MKULTRADiamond@bae.st' as they're tagging random users and spamming porn with no CW. Receipts attached in the screenshot.
Edit: The whole instance is Freeze Peach. Toss it in the trash.
#Fediblock #Fediverse #Fedi #FediAdmin #MastoAdmin
Recommending Fediblock for instance 'jforo.com' as it's literally just a bunch of spam bots that are spamming hashtags.
#Fediblock #Fediverse #Fedi #MastoAdmin #FediAdmin #Mastodon