Evan Prodromou's blog

Evan Prodromou's picture

Identi.ca scheduled downtime Thu 12/15 10PM EDT [CANCELED]

Update: The DNS TTL on identi.ca is far too high for this to work tonight. I'm going to dial it down and hopefully move next week.

 I'll be moving the main servers for Identi.ca to our new data centre in the Rackspace Cloud. This is going to require a lot of data copying, so there's going to be some downtime while it moves. I expect somewhere between 4 and 12 hours.

There'll be a new blog post up with status updates on Thursday.
 

Evan Prodromou's picture

Unscheduled downtime for Identi.ca

We had about 6 hours of unscheduled downtime tonight due to a bad slave server.

The site is back up now. Sorry for the disruption. 

Evan Prodromou's picture

Mark Ruddock Steps Down as StatusNet CEO

 

Mark Ruddock, CEO of StatusNet Inc., has resigned his position with the company to pursue other opportunities in the on-line financial sector. Evan Prodromou, founder and CTO, has been appointed to replace him as CEO.

Evan Prodromou's picture

Scheduled downtime for some StatusNet cloud sites 16 Nov 2011 10PM EST

Over the last month, I've been gradually moving sites on the StatusNet cloud service to our new platform on the Rackspace Cloud. Side note: we've used almost every virtual server system in existence, and I can say without qualms that Rackspace Cloud is the best by far. I'm a big fan, and I'm glad we're making this move.

Evan Prodromou's picture

Seeking international system administrators

I'm looking to hire 1-2 part-time system administrators for help with StatusNet sites, including identi.ca. One in an East Asian timezone (around GMT+8, give or take an hour or two), another in the European slice of the earth (say, around GMT).

Responsibility will be to be on-call for our hosted services in your timezone, handle relatively easy system administration issues as they arise, and escalate for things that need more work.

Evan Prodromou's picture

Further info on Identi.ca problems

I posted a few days ago about some technical problems with identi.ca. tl;dr version: our Web servers occasionally hit very high load and stop responding, hurting performance of the site. I've found out a few things in the last few days, so I thought I'd update here for those interested.

Evan Prodromou's picture

StatusNet at W3C Social Business Jam

I'm happy to say that I'll be participating this week in The W3C Social Business Jam. This world-wide online event is the first of its kind to cover issues of social networking technologies from a business perspective. Managing the process under the auspices of the W3C is exciting for those of us who are involved with standards for enterprise social networks.

Evan Prodromou's picture

Overview of technical problems with Identi.ca

(UPDATE: see Further info on Identi.ca problems for more info.)

We've been having some technical issues with identi.ca for the last few weeks, and there's been a lot of speculation about what those problems are. I'd like to outline what the problem is and let people know what I'm doing to solve it.

Evan Prodromou's picture

Scheduled downtime 30 Oct 2011 22:00 EDT

I'm scheduling some downtime for this evening to fix up our database server situation. 

2011-10-30 22:28 EDT: took identi.ca down. I need to set up replication between our master server and a slave server, which requires stopping all writes to the database.

 2011-10-30 23:04 EDT: started transferring cold backup of master database server to new slave. Looks like about an hour to get that done.

 2011-10-31 00:04 EDT: 5 more minutes.

Evan Prodromou's picture

Identi.ca down

The identi.ca master database server went off-line earlier today. I'm trying to figure out how to revive it.

It seems to be back up.