As I dive into the world of datawarehousing, designing the schema for this case is much different than you would for a transactional database. In a standard transactional database you would first find all your entities and relationships, and proceed to normalize to 3NF. In a datawarhousing environment you are actually de-normalizing the tables.
The startup I had been working for went under, so I have been busy finding a new job and settling in. Got a good gig now at a new place and things are going well.
I'm not doing as much Ruby any more, but I am doing lots of datawarehousing work. There is a new engine out for mysql called 'infobright'. It has proven to be very quick when doing the kinds of queries you do when analyzing web statistics. Easily 10x as fast as MyISAM tables.
I am a big fan of the Mobwars game on facebook. It is pretty fun, but there is lots of tedious things that you have to do to start making money. One of these things is attacking various users attempting to boost your rating or steal money.
As a fun task, I decided to see what I could do with page scraping and Mechanize. Here is some examples on how to use it.
If you haven't tried uploading files in rails, you are in for a treat. Most of the time a feature is implemented that everything is done with reasonable defaults and just works. Uploading files, this is simply not the case.
An odd error happened with the blog software today. Not sure what has caused it yet, but I have fixed it. The error was:
ERROR 1016 (HY000): Can't open file: 'evo_hitlog.MYI' (errno: 145)
Executing a 'repair table evo_hitlog' seemed to fix the problem.
I recently had some hard drive issues with this machine, so it is possible that the database files got corrupted. Everything seems to be moving along now, if anyone has ideas on what else may have caused this, please comment.
Recent Comments