Archive for category Announcements

Kernel testing procedures…

It has been a few days since I’ve made my last post, and that’s for good reason. I now have a new approach to testing the OC kernels! A very kind developer from droidforums.net, Kill_One, has helped me out by providing a stripped down version of the Sapphire ROM. This ROM contains only what is needed to boot up android and it even blocks all wireless connections right out of the box! Using this ROM will allow me to remove as many variables as possible when benchmarking. The goal is to have less than a .5% variation between 10 runs of a benchmarking app. That said, there may be variables in which I cannot control (think hardware). Also, due to Quadrant’s requirement for an internet connection and my lack there of (due to forced airplane mode), there will be no Quadrant benchmarks performed using the “Clean Room” Sapphire ROM.

Here is the testing procedure:

  1. Install the “Clean Room” ROM via nandroid.
  2. Restore APK’s from SD card.
    1. Benchmark PI
    2. CPU Benchmark
    3. Linpack
    4. System Panel Lite
    5. Autostarts
    6. Drocap2
    7. Battery stats
    8. aLogcat
    9. Shutdown phone, remove MicroSD card, reboot.
    10. Kill all running apps with system panel.
    11. Verify phone is near “braindead” with aLogcat and system panel.
    12. Kill system panel & aLogcat via system/applications/manage applications/running applications. Kill the above two apps and finally the system app itself.
    13. Run the first benchmark, then repeat steps 4-6 before running the next benchmark.

The results should be pretty consistent through 10 consecutive runs of the benchmark. Although I have noticed that Linpack gives the most consistant results. Let me know if you see something you would like added!!!

Advertisements

Leave a comment

More coming soon…

It has been a hectic week! My infant daughter has had two surguries in the last ten days and, as you could guess, I haven’t slept much either. That said, in the random times I’ve had to myself I managed to get some new benchmarks completed. Soon as time allows I will be posting up the benchmarks for Sapphire 1.1.0 and Liquid Frozen Yogurt. Benchmarks will mirror the setup used for the Shadow ROM. Review.

Leave a comment

The game plan…

I have seen so many forum posts asking what DROID ROM is the best. So I decided I would benchmark different DROID ROM’s using several benchmarking apps available for free on the market. I also used several different overclocking kernels so I could get a comparisons how each kernel performs with different ROM’s.

Here is my basic setup for each ROM:

  1. Wipe data & cache
  2. Install ROM
  3. Reboot and bypass sign in for Google account
  4. Turn off Google account sync
  5. Open Market and sign-in
  6. Download Setcpu, Rom Manager (Premium), Drocap2, CPU Benchmark, Linpack, & Quadrant
  7. Setup Setcpu and run each benchmark 3 times
  8. Once done benchmarking, reboot into recovery and install new kernel. I did not wipe data or cache between kernel installs.

With the exception of packaged kernels, I selected kernels that had 1ghz slot and low voltage, if available. I also did not apply/use any of the tweaks each ROM may have. I simply tested each ROM as it was installed.

If I missed the mark with my testing setup please let me know! I am not a guru of all things android! I’m simply trying to apply some common sense and structure to these benchmarks and let cards lie where they fall.

The first ROM up for benchmarks…Shadow ROM 0.0.1 Beta


Cheers,

Dustin

Leave a comment