code push shortly

Feb. 22nd, 2012 01:47 am
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)
[staff profile] denise posting in [site community profile] dw_maintenance
We'll be beginning a code push in about 15-20 minutes. Please put up your seat backs and return your tray tables to the full and upright locked position. We'll update this entry when we're done!

(2:40AM EST: As always, the prep turns out to be more involved than we predicted. We'll hopefully be starting soon.)

3:10AM EST: And, we're done! Please report any issues here or to Support.

code push scheduled

Feb. 21st, 2012 01:19 am
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)
[staff profile] denise posting in [site community profile] dw_maintenance
We're currently planning to do a code push tomorrow night, tentatively scheduled for 2AM EST Wed 22 Feb/11PM PST Tue 21 Feb (7AM GMT Wed 22 Feb). Most changes scheduled for this push are minor and there shouldn't be any more than a few minutes' disruption to service.

We'll update when we begin for you to report any potential issues you notice.

database rebalancing

Feb. 14th, 2012 11:08 am
mark: Photo of Mark's face, taken in standard office fluorescent. (me), Taken in Photo Booth or something.
[staff profile] mark posting in [site community profile] dw_maintenance
A few weeks ago we deployed a new pair of databases. Now that they've broken in and I'm confident in them, I've started the process of rebalancing users to even out the database load. This involves moving users from the old database machines to the new ones.

I don't expect there to be any issues, but as always, please let me know if you see anything untoward!

problems connecting to Dreamwidth

Feb. 13th, 2012 05:55 pm
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)
[staff profile] denise posting in [site community profile] dw_maintenance
We've seen a handful of people reporting that they're having problems connecting to Dreamwidth. We're trying to narrow down the problem and figure out if it's a problem with the routing on our end or if a major ISP is having routing issues reaching us. (Right now, it's looking like the fault isn't in our network, but there may be steps we can take to fix things if we can identify what's going on.)

If you know someone who's having problems reaching DW, please get them to email support@dreamwidth.org with the results of a traceroute from their computer to dreamwidth.org. That will help us identify where the problems are.

Edit: Strike that! [staff profile] mark found something earlier today that might have explained the problem and fixed it. If you're still getting the problems after this point (6PM EST, 2/13), email us traceroutes then, but most people who were having the problem should notice it's gone away now.

Record breaking traffic day!

Feb. 9th, 2012 11:08 pm
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)
[staff profile] denise posting in [site community profile] dw_maintenance
I'll lead with the good news: we've been setting new records for traffic constantly for the past month or so, and just now we broke 30Mbps (megabits of traffic transfered per second) for the first time, which is an awesome milestone that we are totally dancing around and celebrating. People are using our baby!

So, if we're transfering record amounts of data, and if (as mentioned on our offsite status twitter) we added two new webservers today to help push out traffic, why has the site been so sluggish today?

As I mentioned in the 2 Feb dw-news post, the answer is very complex. There are a lot of underlying causes that can look to you guys (the people who are just trying to load your reading page and comment on various posts) like the site is just plain sucking, and I know it must be tempting to wonder: hey, this keeps happening, why can't they just fix it?

in which I make an extended metaphor about site traffic )

[staff profile] mark has been making a bunch of code fixes that will speed things up in the short term, and [personal profile] allen is working on the more sweeping code changes that will speed things up in the long term. The code changes Mark just made should help a lot, but high traffic periods (evenings, US time) may continue to be sluggish for a few more days.

We've also added more caching of frequently-accessed and unchanging data: CSS files, JavaScript files, images, and icons are all being cached so they load faster, and served from the fast static content frontend, which takes the burden of serving those off the webservers that are working to build pages. Meanwhile, [personal profile] alierak has been working on optimizing our server response so we can squeak every microsecond out of the servers themselves.

So, in short: We're busy! We're all really sorry about the slowdowns at peak traffic times, and we're working really hard to increase capacity and speed up site performance. Thank you all for your patience (you really are the best users a site ownership team could ask for!) and for continuing to use Dreamwidth. This is a very exciting problem to have. :)

Profile

jaye_voy

September 2011

S M T W T F S
    123
45678910
11121314151617
18192021222324
2526272829 30 

Most Popular Tags

Style Credit

Style:
Kaigou
Resources:
Circular Icons

Expand Cut Tags

No cut tags