Blog calendar

RSS feed from Michal Frackowiak's blog

subscribe to the RSS feed

— or —

get my blog posts via email

michal frackowiakmichal frackowiak
SquarkSquark
anjelanjel
Killer8845Killer8845
shark797039shark797039
Watch: site | category | page

Blog tags

activity amazon android aws barcamp barcamp.pl blogging cf cloud cloudfront design dev ec2 firmware free funny gadget gadgets game gtd howto insider iphone itunes javascript kids leaks meetings mobile monetization mozilla notifications outage php picture podcast pro productivity programming rss ruby ruby1.9 tip t-mobile useless web wikidot wikipedia workplace xeon
View my profile on LinekdIn

My Twitter

1268137834|%e %b, %H:%M|agohover
bugs.wikidot.com - fixing bugs today. As many as we can. Report your own if you find one!

1268092513|%e %b, %H:%M|agohover
A Brief History of Pretty Much Everything - pretty brilliant www.youtube.com/watch?v=gNYZH9kuaYM

1268091732|%e %b, %H:%M|agohover
I have a feeling that Wikidot.com is now blazingly fast after server upgrade: blog.wikidot.com/blog:files-service-migrated

1268091379|%e %b, %H:%M|agohover
Inspiring story of Pandora - finally real revenue after 10 years: www.nytimes.com/2010/03/08/technology/08pandora.html

1267964484|%e %b, %H:%M|agohover
@antirez Switch to PostgreSQL? It has much more resonable locking mechanisms.

1267794675|%e %b, %H:%M|agohover
Power is back ;-) . Fun is over :-(

Photos

P1030704
P1030703
P1030701
P1030700
P1030699
  • 4286983115
  • 4075085409
  • 4075838354
  • 4075837308
  • 4075836050
  • 4075835170
  • userName ::: michal_frackowiak
  • size ::: square
  • perPage ::: 6
  • limitPages ::: 1

Blogroll

Piotr Gabryjeluk's blog (Gabrys on Wikidot)
Lukasz Tarka's blog (Squark on Wikidot)

Recent posts by my friends

Me in other networks:

facebook, last.fm, del.icio.us, Flickr, Flaker

Welcome to my blog — place for ideas, comments, interesting hacks and boring personal stuff. Enjoy!

Redis Performance on EC2 (aka weekend project coming)

1240568763|%e %b, %H:%M (%O ago)

Weekend is coming and I have a very small pet-project for it. I would still keep the idea non-public, but it involves processing hundreds of entries per second, analyzing data from multiple sources. It would have a dead-simple web interface.

The nature of the project requires really fast data backend, capable of storing and retrieving a few thousand items per second. The dataset would be approximately 5GB, average item size: 0.5KB.

When it came to tools selection, after short considerations I have chosen Sinatra for web interface, and Redis as a memory-only (with disk dumps) key-value datastore. It should be capable of handling 100 000 requests per second and deal well with large datasets, so fits perfectly. It also differs from Memcached or MemcachedDB because it has great higher-level structures like Lists and Sets, basic sorting and selection commands.

read more...

Tags: amazon ec2 redis sinatra

Comments: 2

asdad