Today | started looking at the different MapReduce Schedulers, because I would like to be able to start the processing on a new jobs when slots became available. So I started look at the other schedulers that come with Hadoop. The Capacity Scheduler: The Capacity Scheduler is designed to run Hadoop Map-Reduce as a shared,…
Serengeti Soups Up Apache Hadoop
The primary goal of Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc…) developed by a community with a focus on the system as a whole, rather than individual projects. If you looking for in easy to…
Apache Bigtop Hadoop
The primary goal of Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc…) developed by a community with a focus on the system as a whole, rather than individual projects. If you looking for in easy to…
MySQL Cheat Sheet
Found this today. Not to bad for a quick reference sheet. MySQL Cheat Sheet
Hortonworks Releases Its (Conservative) Hadoop Platform
Check this article out. “Hortonworks sets itself apart from Cloudera and MapR by sticking with standards-based software and Apache’s proven 1.0 code line.” >>
Configuring MySQL as a Hive Metastore
Hive uses DerbyDB to store its metadata by default, if you have ever tried having more than one person, or multiple services, such as the Hive Web UI or Hive Service connect, it doesn’t work really well and can cause problems. To improve this I recommend use MySQL as the metastore_db. Install a MySQL…
Hadoop, Hive, Oh my.
Sorry, I haven’t really wrote anything in the last couple of months, but after a year or more of reading about Hadoop and poking at it. I have actually got the chance to do something with it. A year or so ago I helped build a MySQL database to help analyze user data. A large amount…
Thanksgiving Dinner!
We have traditions in our family but Thanksgiving was never one of those holidays that we were fanatic about. We always had a turkey dinner, but sometimes it was at our house, sometimes we went to other relatives or friends, we have even gone out to dinner for Thanksgiving on occasion. When I moved out…
Using Iozone for Filesystem Benchmarking
If you have been around computer systems long enough everyone knows how import disk performance is, espeacially with database systems. There’s the standard htparm -tT and dd test the everyone does, but it really does give you the whole picture. What you really want is to test read, write, re-read, re-write, read backwards, read strided, fread,…
Using Mysqldump to Backup Your Stored Procedures, Functions and Triggers
Now that MySQL has Stored Procedures, Functions and Trigger. I have found myself needing to back them up or make copies to move to a different MySQL server. It’s actually pretty easy to do with mysqldump. Here is the command line for it. shell> mysqldump –routines –no-create-info –no-data –no-create-db –skip-opt <database> > outputfile.sql Then if you…