Sept. 4, 2011, 7:18 p.m.
—
Permalink
Any site of a large size with have lots of different queries going on. If you're having performance trouble it's easy to find and fix the ones that are causing trouble. It's not so easy if you have a query that runs moderately fast but is run a lot. It's ...
Read more
Aug. 26, 2011, 4:36 p.m.
—
Permalink
I wanted to profile our system that is using eventlet. I wasn't happy with any of the existing solutions so I rolled my own: https://github.com/colinhowe/eventlet_profiler. The existing solutions have a few failures: You can't figure out how much time a specific function spends calling another function They generally use CPU ...
Read more
Aug. 24, 2011, 6:39 p.m.
—
Permalink
Whenever I'm pair-programming with someone we often hit a spot where we both want to experiment and try stuff out - different ways of approaching a problem, playing with APIs, whatever. Going back to your own computer when you hit this spot isn't great. By moving away from the other ...
Read more
Aug. 22, 2011, 5:10 p.m.
—
Permalink
In a previous post I looked at the performance hit you get in MongoDB when the working set is larger than the memory available. I thought I'd have a look to see how MySQL fares under similar conditions. The experiment was very similar experiment to the experiment for MongoDB. Setup ...
Read more
Aug. 17, 2011, 9:46 a.m.
—
Permalink
When using eventlet you typically have a lot of concurrent things all being processed at once. Trying to identify problems in highly concurrent systems can be hard. To solve a problem we had I created eventlet visualiser (on github). This allows you to see the life span of all your ...
Read more
Aug. 9, 2011, 8:17 a.m.
—
Permalink
I sometimes need to do a search and replace across lots of files. So, I made a function in my .bashrc to make it easy: function find_replace { FIND=$1 REPLACE=$2 echo "Finding $FIND and replacing with $REPLACE" grep -rl $FIND . grep -rl "$FIND" . | xargs sed -i -e ...
Read more
July 14, 2011, 11:49 a.m.
—
Permalink
We just hit a problem where the indexing performance of our Solr instance dropped massively when re-indexing the entire database. At the start it would be doing 100 docs/second but after an hour or so dropped down to 10/second and carried on falling. After looking at iostat I discovered that ...
Read more
April 7, 2011, 4:26 p.m.
—
Permalink
According to this article on Techcrunch Google have offered $150 million in stock grants vesting over four years to keep two key employees. I think that this could be a clever move by Google. Google are trying hard to get excellent engineers going to Google. There are so many companies ...
Read more
April 5, 2011, 8:24 p.m.
—
Permalink
Short answer: probably not for 80% of sites out there. But, it is right for us. To find out why, read on. For a quick guide, skip to the conclusions ;-) Question of Cost AWS: generally more expensive for hardware For the hardware, AWS is expensive compared to traditional hosting ...
Read more
April 3, 2011, 1:13 p.m.
—
Permalink
A few weeks ago we (Conversocial) migrated our infrastructure from a shared Solaris host to AWS. I'm going to talk about how we did our migration, why we chose AWS is a big enough topic for another blog post. The two goals for the migration were: Migrate a customer at ...
Read more
