Blog calendar
— or —
Blog tags
My Twitter
1282558230|%e %b, %H:%M|agohover
New blog post: Back from holidays - new challenges on the horizon bit.ly/9eRpf0
1281297211|%e %b, %H:%M|agohover
I earned the Check-in Rookie sticker on @GetGlue! bit.ly/dbpWkZ
1280993335|%e %b, %H:%M|agohover
Why is it that when I am on my holiday Wikidot servers crash? It is kind of a rule. Bad karma, shame on the unkind hardware.
1280771665|%e %b, %H:%M|agohover
I earned the Lone Wolf sticker on @GetGlue! bit.ly/aLOBKx
1280700561|%e %b, %H:%M|agohover
I earned the Couch Potato(50) sticker on @GetGlue! bit.ly/bWcP2U
1279886686|%e %b, %H:%M|agohover
I love the cloud. "Database Error: Unable to connect to the database:Could not connect to MySQL". Yeah. I'd better backup my data now!
Photos
Blogroll
Piotr Gabryjeluk's blog (Gabrys on Wikidot)
Lukasz Tarka's blog (Squark on Wikidot)
Recent posts by my friends
Me in other networks:
Welcome to my blog — place for ideas, comments, interesting hacks and boring personal stuff. Enjoy!
Redis Performance on EC2 (aka weekend project coming)
1240568763|%e %b, %H:%M (%O ago)
Weekend is coming and I have a very small pet-project for it. I would still keep the idea non-public, but it involves processing hundreds of entries per second, analyzing data from multiple sources. It would have a dead-simple web interface.
The nature of the project requires really fast data backend, capable of storing and retrieving a few thousand items per second. The dataset would be approximately 5GB, average item size: 0.5KB.
When it came to tools selection, after short considerations I have chosen Sinatra for web interface, and Redis as a memory-only (with disk dumps) key-value datastore. It should be capable of handling 100 000 requests per second and deal well with large datasets, so fits perfectly. It also differs from Memcached or MemcachedDB because it has great higher-level structures like Lists and Sets, basic sorting and selection commands.
Tags: amazon ec2 redis sinatra








