6 ROM SPB Benchmarks - Advantage X7500, MDA Ameo ROM Development

Hello to all,
After almost 5 months, again a small contribution to our community, in a form of test od 6 different ROMs, 3x WM6 ROMs + 3x WM6.1 ROMs:
HTC_WWE_2.21.405.2
AP3 Dual by PK
WM6_TMUK_2.35.110.4
AP4 SPL 1.2 by Irus
Irus' SPL1.2 0 MB pp
MiChY's 2.14 light
3 new WM 6.1 ROMs are faster, and there is no itention to promote any of mentioned ROMs as the fastest one, or as the stablest one. Benchmarking is always a double-edged axe, so use the benchmark results only as - numbers
Testing conditions:
Device: T-Mobile Ameo
- clean ROM install, basic device configuration
- no miniSD, no SIM inserted
- SPB Benchmark(tm) DEVICE install (SPB Benchmark is a trade mark of Spb Software House)
- every ROM tested with 18 tests, 3 times x 15 minutes
Total time for installation, testing and table calculation: 6 h.
Regards,
MDA3__CRO

MDA3__CRO said:
- every ROM tested with 18 tests, 3 times x 15 minutes
Click to expand...
Click to collapse
Results seems to be very similar.
What is deviance among 3 performed tests?
(realy for statistics there need to be more than 3...)

MDA3__CRO said:
Hello to all,
After almost 5 months, again a small contribution to our community, in a form of test od 6 different ROMs, 3x WM6 ROMs + 3x WM6.1 ROMs:
HTC_WWE_2.21.405.2
AP3 Dual by PK
WM6_TMUK_2.35.110.4
AP4 SPL 1.2 by Irus
Irus' SPL1.2 0 MB pp
MiChY's 2.14 light
3 new WM 6.1 ROMs are faster, and there is no itention to promote any of mentioned ROMs as the fastest one, or as the stablest one. Benchmarking is always a double-edged axe, so use the benchmark results only as - numbers
Testing conditions:
Device: T-Mobile Ameo
- clean ROM install, basic device configuration
- no miniSD, no SIM inserted
- SPB Benchmark(tm) DEVICE install (SPB Benchmark is a trade mark of Spb Software House)
- every ROM tested with 18 tests, 3 times x 15 minutes
Total time for installation, testing and table calculation: 6 h.
Regards,
MDA3__CRO
Click to expand...
Click to collapse
AP4 by IRUS is Vanilla PP0 ????

vidmabal said:
Results seems to be very similar.
What is deviance among 3 performed tests?
(realy for statistics there need to be more than 3...)
Click to expand...
Click to collapse
Yes, results are very similar, because a half of SPB Benchmarks in Main Test is a hardware dependent.
Just for an exemplar, here is a link for a previous 3 ROM SPB Benchmarks, which contain data about all of 3 series of testing and average results:
http://forum.xda-developers.com/showthread.php?t=385810
Just because of results table size, this time I didn't include results for 3 series of testing, only average results.
If you are familiar with SPB Benchamrk, you will know that every single test is
performed 13 times as internal benchmark process. I made 3 series of 18
different tests (it took over 10 minutes per serie), every of it is repeated 13 times
as a way of how SPB Benchmark is performed. Just 1 (one) SPB Main Benchmark Test
is sufficient for a fair result, but I made 3, just for any case.
If you want a very big result table, please, let me know, and I will post it here.

Montecristo said:
AP4 by IRUS is Vanilla PP0 ????
Click to expand...
Click to collapse
Yes, it is AP4 VANILLA 4 SPL 1.2 by Irus, nbh file release date is 05/21/08
IMHO and very subjective, I tried it in a effort to find ROM without message flaw I found in the newest ROMs (http://forum.xda-developers.com/showthread.php?p=2605629#post2605629). I found it a very slow in opening applications and useless for me. But on SPB Benchmarks this ROM is slightly faster (have better results) than others.

It will be great if some mortscript guru will define a test suite script for windows mobile devices... based on REAL LIFE usage!
EG. opening office test file, opening a website, starting opera, finding a string, tom tom starting, java speed....
Real life usage tests are the best to compare ROM, and may be this is the only realistic way. IF you compare, using SPB benchmarks, DIAMOND overall with BLUEANGEL.... Diamond is rubbish!

sergiopi said:
It will be great if some mortscript guru will define a test suite script for windows mobile devices... based on REAL LIFE usage!
EG. opening office test file, opening a website, starting opera, finding a string, tom tom starting, java speed....
Real life usage tests are the best to compare ROM, and may be this is the only realistic way. IF you compare, using SPB benchmarks, DIAMOND overall with BLUEANGEL.... Diamond is rubbish!
Click to expand...
Click to collapse
I agree with you. SPB Benchmark Main test has a section "Built-in applications",
and it can also test the following:
- Pocket Word document open
- Pocket Internet Explorer HTML load
- Pocket Internet Explorer JPEG load
- File Explorer large folder list
The only problem which may appear is when tested ROM do not contain required component, for exemplar - Pocket Word.
It will take a lot of time (flashing, testing, flashing, result table building etc), but I will try to find time to test a few SPL 1.2 ROMs with mentioned method.

Related

WM6 speed compare with WM5

Do you guys think WM6 speed is slower than WM5? or just my imagination?
I have tried AKU 2.2 , 2.3, 3.2 , then WM6 pdamobiz V2, WM6 PDAVIET 4.0.0.6 touch version, I found that both wm6 version respond time are slow, is it just these 2 build, or generally , WM6 is slower?
I have to downgrade to 2.2 jester R1 again.... still find that it's a best version at the moment....
I am using now PDAVIET 4.0.0.0.6 I find it ok for my needs. Indeed the fastest for me was ASERG 3.3.13 - amazingly fast rom. Before that I used the official version from o2 - it was an AKU 2.0 and was awful.
chavdar said:
I am using now PDAVIET 4.0.0.0.6 I find it ok for my needs. Indeed the fastest for me was ASERG 3.3.13 - amazingly fast rom. Before that I used the official version from o2 - it was an AKU 2.0 and was awful.
Click to expand...
Click to collapse
same with me for both;
PDAVIET 4.0.0.0.6 &
ASERG 3.3.13
still ASERG 3.3.13 is incredibly faster and stable,
PDAVIET 4.0.0.0.6 much faster in my s200 than wm5.. but battery deployment much higher...
fireburn said:
PDAVIET 4.0.0.0.6 much faster in my s200 than wm5.. but battery deployment much higher...
Click to expand...
Click to collapse
PDaviet 4.0.0.6 touch is the fastest Os ive tried although the program memmory is less since it is 8mb pagepool...........
it isn't really faster. wm6 has some improvements like faster loading of startmenu icons after a softreset or a faster windows directory access, but the rest of the speed is the same. opera doesn't render faster and coreplayer isn't able to use higher bitrates. and performance improvements which only can be recognized with benchmarking (for example sktools) aren't important. two or three point higher scores aren't subjective improvements.
wm6 is faster but it is only a little advantage over wm5.
Try Smart1 V3. It operates at lightspeed compared to official WM5 ROM. Specially when using Batterystatus. Mine is running constantly at 286Mhz without significant heating up.
oh, my official wm5 rom from o2 was SUCH A PAIN. they forced me to use these "illegal" unofficial roms. booting the device took 5 minutes and accessing the windows directory caused a 3 minutes long loading circle...
I'm a little bit confused
WM6 is so slow on my device and few bugs, but of course newer versions and functions in the core, sure it is better but slower
I'm using WM5 2.2 witch is old but fast and stable I try every newer version of pdaviet and Prophet Touch; as I have now adsl connection at my work but no time; in my tests they are the best but go back to wm5 2.2 always waiting the final wm6 version from microsoft and ROM makers here wish that it will be good
again wm6 is slower than wm5

Which ROM is FASTER FOR YOU-WM5 or WM6?

Now that WM6 English AkU0.3 wad released, which ROM do you think is faster for you?
WM5 AKU 3.3.3
or
WM6 AKU 0.3.0..
For me testing of speed is not only depends on benchmarking. The best way to check it is to run heavy programs for each ROM and see how fast they response to the program. Like playing high resource demanding games like Azgard Defence ,Machine War ,Zio Golf Tiger woods etc..
In WM6 they run smoothly...thats it!! Which means for me, WM6 is faster..
WM6 is faster and able to handle heavy applications smoothly.. There is no jerk in between application.
generalriden said:
Now that WM6 English AkU0.3 wad released, which ROM do you think is faster for you?
WM5 AKU 3.3.3
or
WM6 AKU 0.3.0..
For me testing of speed is not only depends on benchmarking. The best way to check it is to run heavy programs for each ROM and see how fast they response to the program. Like playing high resource demanding games like Azgard Defence ,Machine War ,Zio Golf Tiger woods etc..
In WM6 they run smoothly...thats it!! Which means for me, WM6 is faster..
Click to expand...
Click to collapse
a litle bit slow on booting but faster on processing...
this is so fast and also quite stable . its worth of trying
go to www.filehippo.com, you can find a lot of application including Activesync 4.5
i tried to benchmark this ATOm w/ wm6 using sktools..
BENCHMARK i
184.11 Atom Pure WM6
while others..
172.56 HTC magician Wm2003Se px416mhz
196.64 XDA Trion WM5 samsung400mhz
216.15 HTC universal WM5 pxa270 520mhz
Benchmark defines
benchmark is the act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it. The term, benchmark, is also commonly used for specially-designed benchmarking programs themselves. Benchmarking is usually associated with assessing performance characteristics of computer hardware, for example, the floating point operation performance of a CPU, but there are circumstances when the technique is also applicable to software. Software benchmarks are, for example, run against compilers or database management systems.
Benchmarks provide a method of comparing the performance of various subsystems across different chip/system architectures. Benchmarking is helpful in understanding how the database manager responds under varying conditions. You can create scenarios that test deadlock handling, utility performance, different methods of loading data, transaction rate characteristics as more users are added, and even the effect on the application of using a new release of the product.
No fair comparing the Atom with those, riden <_<
It's already SLOWER than an O2 Mini by default >_>
Ultimate Chicken said:
No fair comparing the Atom with those, riden <_<
It's already SLOWER than an O2 Mini by default >_>
Click to expand...
Click to collapse
sorry this is the only info i got..if you can share other info ...thanks

Back to WM5

I tried hard to keep up with wm6, tried hard , all possible tweaks.So finally the other day, I thought of going back to WM5 and really it is much much stable, no soft resets, no hangups.Hard to get used to the wm5 interface as compared to the glossy wm6, but performance is what I desire, and now my apps open in seconds, memory leaks are minimal, audio in BT also goes well.
I really wonder, why WM is not fully compatible with Athena.All other devices it works like a charm, why not in Athena.
I think wm6 is quicker and more stable than wm5. I reset more often in the past.
Which wm6 ROM were you running? What applications were you using? It may be one or two applications giving you the problem.
Not much apps, I like to stick with the given apps.Use Windows Live, builtin Opera, sometimes may b NetFront, I do not play games, Skype, I use.That's it.
If u compare the speed of execution of these programms with other devices running wm6 such as Universal,Hermes, Kaiser, Blue Angel, and if we have the fastest processor 624 Mhz, it shd surpass the programe execution time.
WM6 I hv observed that, initially, it works well, but as the use goes on , it tends to slow down, and even it takes a lot of time to make a phone call, after I press "Talk".
I get 150 calls a day on an average fews Texts, few emails, 24 hrs connected to GPRS or Wi Fi whichever is available.
It is a suprise that Blue Angel reacts faster than athena to similar apps, and execution is very good and fast in devices like Hermes,Kaiser, Universal....all Running WM6, either official or cooked ones.
I really fail to understand, why such a thing with Athena.
Where do you install applications?
What does the sktools performance benchmark tells you about your card and MD.
How did you format your drives?
Do you regularly clear up the cache in opera?
How large is your contact database?
Sorry this seems like a so many questions, but there must be a cause of your problem which is not related to wm6. I say that because I've far far more applications than you, all running okay. I do avoid certain applications. Examples include the latest version of ilauncher.
No problems to me with your questions.Once I had decided to us a Virgin wm6..as it is, no apps, still the problem persists.You won't believe, but I wud have changed 5 Athenas so far..but the problem with the speed persists.
My contatcs data base is quite small, opera cache is by dafault is 2 mb, so it gets cleared whatever is more than 2 MB.
If same I use in the other devices as mentioned, I do not face any problems, so far BA and Univeresal has been the best performances, Hermes and Kaiser follow...and Athena is my primary phone, I do not use any other or second phone.
hdubli said:
No problems to me with your questions.Once I had decided to us a Virgin wm6..as it is, no apps, still the problem persists.You won't believe, but I wud have changed 5 Athenas so far..but the problem with the speed persists.
My contatcs data base is quite small, opera cache is by dafault is 2 mb, so it gets cleared whatever is more than 2 MB.
If same I use in the other devices as mentioned, I do not face any problems, so far BA and Univeresal has been the best performances, Hermes and Kaiser follow...and Athena is my primary phone, I do not use any other or second phone.
Click to expand...
Click to collapse
Then I guess it must be a question of expectation.
I've just looked up. BA is using WM2003, isn't it? Well, that explains why it is so fast. I have a very old WM2003 device that feels like a speed demon too. That brings us back to the old debate of whether or not microsoft made the right move by going int persistent memory, which if I ask me now, I'd still prefer the old approach.
Your Universal has been soldered with additional memory, has'nt it? Do you think this is the reason why it is so fast?
If you've used so many units of Athena and found speed problem with every one of them, when nothing has been loaded yet, it probably means you're expecting WM2003 speed on a WM5/WM6 machine. I'm doubtful that going back to WM5 will solve your problem, because from my experience, WM6 does seem faster.
Not sure where this leaves you and not sure how else to help though.
Hi,
I know that and understand your motive and respect that.If u check carefully, BA can b updated to wm6 aku 7.7
Also I hv uni with 128 ram, but 64 also runs quite well.
Can u imagine I am replying to this thread from Opera Running WM 5
Crispy and fast enough..and I feel the differrence.
Anyway I will try oncemore and report back
I still havent found a WM6 device that can surpass the BA in raw speed (also with WM6)
uni gets quite close tho!
Midget_1990 said:
I still havent found a WM6 device that can surpass the BA in raw speed (also with WM6)
uni gets quite close tho!
Click to expand...
Click to collapse
In your expert opinion, why is this so? What is special about BA that makes it fly? Does the faster speed also apply to internet surfing too?
3rd day with WM5
-Only one soft reset
-Memory lowers to 70 Mb from 81 MB,use SK tools and rever it again.
-pmsn works great and fster.Skype is also more responsive.
-I think we all here shd give it a try and also research why this is so.Really WM5 wins as far as Athena is concerned.
Guru Try Dopod
hi GURU try dopod wm6
or try aptouch dual Virgin

3 ROM SPB Benchmarks

Hello to all,
Here is a small contribution to our community, in a form of test od 3 different
WM6 ROMs:
HTC_WWE_2.21.405.2
AP3 Dual by PK
WM6_TMUK_2.35.110.4
All 3 ROMs are fast, and there is no itention to promote any of mentioned ROMs
as the fastest one, nor as the stablest one. Benchmarking is always a
double-edged axe, so use the benchmark results only as - numbers
Testing conditions:
Device: T-Mobile Ameo
- clean ROM install, basic device configuration
- no miniSD, no SIM inserted
- SPB Benchmark(tm) DEVICE install (SPB Benchmark is a trade mark of Spb Software House)
- every ROM tested with 18 tests, 3 times x 15 minutes
Total time for installation, testing and table calculation: 4 h.
Regards,
MDA3__CRO
Thanks for doing those benchmarks. I was in the midst of something similar when I was pulled away by work. Very interesting stuff, and a great contribution to this forum. Now we just need to line up AP4 variants.
thanks for Gr8 info
Hi mate,,,,,
Thats all gr8 information on this post..really wants to appriciate work.......
cheers...
*we should be working.!
Excellent work son, its interesting to see which rom is stronger in which arena.
MDA3__CRO said:
Hello to all,
Here is a small contribution to our community, in a form of test od 3 different
WM6 ROMs:
HTC_WWE_2.21.405.2
AP3 Dual by PK
WM6_TMUK_2.35.110.4
All 3 ROMs are fast, and there is no itention to promote any of mentioned ROMs
as the fastest one, nor as the stablest one. Benchmarking is always a
double-edged axe, so use the benchmark results only as - numbers
Testing conditions:
Device: T-Mobile Ameo
- clean ROM install, basic device configuration
- no miniSD, no SIM inserted
- SPB Benchmark(tm) DEVICE install (SPB Benchmark is a trade mark of Spb Software House)
- every ROM tested with 18 tests, 3 times x 15 minutes
Total time for installation, testing and table calculation: 4 h.
Regards,
MDA3__CRO
Click to expand...
Click to collapse
Curios what will be on the test compared with the ap4
vicinc said:
Curios what will be on the test compared with the ap4
Click to expand...
Click to collapse
Patiently waiting for possibility to test the speed of final AP4 ROM release.
Until that, let The AP Team to work hard unattended.
Regards,
MDA3__CRO

Just some comments on the New ROMs

I loaded DCD 4.1.2 and liked it. I was REALLY excited about the new 6.5 ROM. While I haven't built my own ROMs, My little mogul has been cooked more times than I can think of.
Here are my thoughts on these two ROMs
DCD
Pros:
GREAT memory and management: 26 mgs available at boot:
I can run Audio Manager, Live Search, Netfront browser, and send and receive text....with neither of them closing.
Cons:
See Pros below
Windows 6.5
Pros:
Integrated Touchflow.
IE8 with Flash
It really does seem faster for some things.
Cons:
Terrible memory and management. Even with Manilla NOT loaded, I only have about 19.5 megs at boot up (even with Hibernate). I can only run one program at once (basically).
Conclusion:
I would rather have the memory than IE8.
Thanks for the info. I love DCD roms, but I'm really wondering about this new WM6.5 rom. It would be nice to hear some more comments from others about each. Thanks!
Not so much an opinion as an educated comment...
I think that you are going to find that WM6.5 (and IE8) are just plain designed for devices with more RAM than the Titan's 64MB. It's a hardware limitation that is just going to be difficult to get past. Compare it to running Vista on an older desktop box with only 512MB of RAM... it will work, and look pretty, but it will be very limited. Vista (and WM6.5) were designed around hardware that is unfortunately higher horsepower than older machines like the desktop I used as an example above (in the case of Vista) and the Titan (in the case of WM6.5) have.
It'll be fun to play with (I haven't tried it yet) but expecting it to be a reliable daily driver on the Titan is probably asking a bit much. I found the same thing with Opera 9.5... it is beautiful, and the best mobile browser I have ever seen, but the Titan just can't run it effectively (without the low memory errors).
were getting pretty close on the memory but your right the 6800 got the shaft on the ram dept.
don't know why you have memory issues.. when I build WM6.5 without M2D
I get 25.6MB FREE ram .. without Hibernate..
and even with M2D loaded and 18.8MB free at bootup, I am still able to run
google map, sms\mms and IE plus Activesync running .. with no issues..
also runs my TomTom without any issues.. plus 6.5 runs faster as well overall..
granted as you keep loading more apps if you go to task mng, just by opening
task mng. it close some apps .. if you flip to and from your apps you'll see they
are still running .. well my experience anyways...
I use my phone just like if its a PC .. hell this post if from my phone.. the new IE is damm sweet...
sudermatt said:
I loaded DCD 4.1.2 and liked it. I was REALLY excited about the new 6.5 ROM. While I haven't built my own ROMs, My little mogul has been cooked more times than I can think of.
Here are my thoughts on these two ROMs
DCD
Pros:
GREAT memory and management: 26 mgs available at boot:
I can run Audio Manager, Live Search, Netfront browser, and send and receive text....with neither of them closing.
Cons:
See Pros below
Windows 6.5
Pros:
Integrated Touchflow.
IE8 with Flash
It really does seem faster for some things.
Cons:
Terrible memory and management. Even with Manilla NOT loaded, I only have about 19.5 megs at boot up (even with Hibernate). I can only run one program at once (basically).
Conclusion:
I would rather have the memory than IE8.
Click to expand...
Click to collapse
It might be better to compare WM 6.5 to Windows 7 instead of Vista.
Running Windows Vista on an old/slow computer is a horribly bad idea. However in beta testing Windows 7 I installed it on a Celeron M laptop with only 1gb of ram and it ran like a dream (without Aero). My boot up and loading times were equal to XP. So if WM 6.5 is designed correctly, it could work just fine on our devices.
The only thing that has me hesitating on 6.5 is that from reading the threads where this was first posted, this a very early release. Since it seems there will be a production version from MSFT floating around within another few weeks, maybe these memory issues will be more manageable, with perhaps some additional features? And no doubt there will be a DCD 6.5 eventually as well, either with this version or a later one.
Serious Props to those that are working hard to get it going now, but I have a feeling there will be better to work with in the near future.
mr-free said:
don't know why you have memory issues.. when I build WM6.5 without M2D I get 25.6MB FREE ram .. without Hibernate..
Click to expand...
Click to collapse
What do you mean without hibernate? I guess that might be a noob question sorry. 25.6 would be even better than DCD roms. Wow.
hibernate refers to oxios hibernate which releases memory to help make your phone run faster
sudermatt said:
I loaded DCD 4.1.2 and liked it. I was REALLY excited about the new 6.5 ROM. While I haven't built my own ROMs, My little mogul has been cooked more times than I can think of.
Here are my thoughts on these two ROMs
DCD
Pros:
GREAT memory and management: 26 mgs available at boot:
I can run Audio Manager, Live Search, Netfront browser, and send and receive text....with neither of them closing.
Cons:
See Pros below
Windows 6.5
Pros:
Integrated Touchflow.
IE8 with Flash
It really does seem faster for some things.
Cons:
Terrible memory and management. Even with Manilla NOT loaded, I only have about 19.5 megs at boot up (even with Hibernate). I can only run one program at once (basically).
Conclusion:
I would rather have the memory than IE8.
Click to expand...
Click to collapse
WM6.5 beta 4 has great memory management. I have been testing it for 17hrs now and am just blown away by its speed. IE8 is awesome. No more WM6.1, I have moved on, you will too, trust me.
ebb said:
The only thing that has me hesitating on 6.5 is that from reading the threads where this was first posted, this a very early release. Since it seems there will be a production version from MSFT floating around within another few weeks, maybe these memory issues will be more manageable, with perhaps some additional features? And no doubt there will be a DCD 6.5 eventually as well, either with this version or a later one.
Serious Props to those that are working hard to get it going now, but I have a feeling there will be better to work with in the near future.
Click to expand...
Click to collapse
the main part of 6.5 is done .. whats left is the interface, the build number
will may go up once the interface is added however there is no memory issues
I know of .. other than the first few beta 1-3 release that has the nueKernel
(a 3rd party programs that cause memory issues .. not the 6.5 kernel !!)
that add was removed from beta-4 and no more issues ..
Also note, after the new interface is added to WM6.5 I believe it will be strip out anyways
at it will be built for VGA or higher PDA's and even if there is a QVGA version
its going to require a ton of memory anyways!! what you will be left with is
whats out now anyways!! thus DCD 6.5 may end up being on this same built!!
vickylife007 said:
WM6.5 beta 4 has great memory management. I have been testing it for 17hrs now and am just blown away by its speed. IE8 is awesome. No more WM6.1, I have moved on, you will too, trust me.
Click to expand...
Click to collapse
x2 ..
check this thead http://forum.xda-developers.com/showthread.php?t=477525

Categories

Resources