so maybe this is a newbie question but I was wondering what everyone uses as a benchmark or if the modding community as a whole finds benchmarking archaic or silly. I downloaded cf-bench and passmark performance last night, any feedback on these two benchmarks, or recommendations on new ones, or even reasonable condemnation of benchmarking in general is welcome.
JohnnyKushi said:
so maybe this is a newbie question but I was wondering what everyone uses as a benchmark or if the modding community as a whole finds benchmarking archaic or silly. I downloaded cf-bench and passmark performance last night, any feedback on these two benchmarks, or recommendations on new ones, or even reasonable condemnation of benchmarking in general is welcome.
Click to expand...
Click to collapse
Benchmarks take the human factor out of the equation, and what we really want is a snappy response and smooth transitions (the human experience)... neither of which can be benchmarked.
I'm partial to Quadrant Standard myself.
I love the aesthetics of Quadrant more than most others but like the functionality of AnTuTu. I know the results really don't translate to everyday performance all the time with these apps but find myself using them nonetheless. Again, the cool graphics is probably why
All benchmarks are different, and none are completely indicative of real world performance
Related
Im going to apologize in advance for my newbness. But what exactly is a quadrant score, and why is it important to be high? I see posts where after the root and lag fix it goes up. What are the perks to a high score? Thanks.
Its a application that benchmarks all sectors of your phone.
Higher numbers don't actually reflect on your performance (since there are more factors involved), it's kind of a bragging rights thing. Some people argue that the lagfix doesn't do anything for them, some slower, some faster.. overall, its just placebo and results vary.
So high score doesnt mean better performance? So why all the hoopla then?
Noticed how I said "bragging rights?"
Edit: Read this article, it'll help explain things better than I can.
http://briefmobile.com/cyanogen-demonstrates-quadrants-flaws
Thanks for the info and link!!
Some brief impressions and a few benches from AnandTech.
http://www.anandtech.com/show/4416/...sm8x60-phones-htc-sensation-4g-and-htc-evo-3d
Any thoughts?
Finally a good thread
Sent from my HERO200 using XDA App
Good info. Nice find. I'm not surprised they are still working on the camera.
Dang whats up with the evo 3d benchmark scores(I know they aren't the same as real life performance) they were pretty off from the sensation,well those weird browser ones were anyway. When they actually used a benchmark app the evo 3d scores won by a little. I didn't know you could do benchmarks in a browser.
XxDjbluexX said:
Dang whats up with the evo 3d benchmark scores(I know they aren't the same as real life performance) they were pretty off from the sensation,well those weird browser ones were anyway. When they actually used a benchmark app the evo 3d scores won by a little. I didn't know you could do benchmarks in a browser.
Click to expand...
Click to collapse
You can run benchmarks on anything and through anything. This is the best illustration I can think of to underscore the fact that "benchmarks aren't the same as real life performance." If it is going through the browser (which is likely identical on both phones) then it is subject to the whims of the network connection, the medium being the most suspect. If it's WiFi that's sketchy enough, if it's 3G or "4g" then those scores are just about worthless. Sure, it could be a client-side benchmark downloaded and run within the browser but even then unless both devices were booted up at the same exact time, let sit for the same exact amount of time, browsers on both phones were launched at the same exact time, every single tap and scroll was duplicated on both phones, every app (or no app) was all launched (or not) in the same precise order...unless all of those conditions (and far more specific conditions) are all met the test is worthless..
...and the Evo has 256mb more memory, so, perhaps that's just a side effect of more aggressive garbage collection to compensate for that fact....and while the GSM and CDMA chipsets are identical except for that fact, who knows what minute--imperceptible but measurable--differences that might introduce. Not to you or I using it, but, to a benchmark program.
nothing is actually running "through" the browser, its a test of the java scripting language used in many browsers and applications, and websites. There are no other factors than how fast the phone can execute javascript.
bump
this is the only thread with useful information
Can someone explain the scores and basically what they mean. Also I am curious how this would affect cores that worked independently and ones that worked on each other. To me the indep cores may seem to have lower benchmark score because it may only be using 1 core to obtain the score being seen(again I have no idea what im talking about, I even forgot my name). Im coming from a HTC Fuze so I've been away from androids and well I never seen a thread on the Fuze page about benchmarks(so im a bit retardid ).
Thanks for this.. really
Can any one post some bencharks of roms? for example Stock Samsung ICS Rom and CM9? Really want to know if roms compared to stock Samsung and CM9 make diference in speed? Please
1) Benchmarks are meaningless. The only people who think benchmarks are useful are normally the people who fap off over their benchmark scores. They're simply not any indication of real world performance of the phone.
2) Why not flash each rom & run benchmarks yourself ? Easy to do.
MistahBungle said:
1) Benchmarks are meaningless. The only people who think benchmarks are useful are normally the people who fap off over their benchmark scores. They're simply not any indication of real world performance of the phone.
2) Why not flash each rom & run benchmarks yourself ? Easy to do.
Click to expand...
Click to collapse
This ^
I can easily manipulate the same ROM and Kernel to get whatever Benchmark scores I want without too much difficulty, it would also likely be impossible for anyone to tell I did it other than the fact that my scores would be unbelievably high/low.
Also, some ROMs run better than others on a ROM/kernel combo depending on their ability to handle OC/UV and GPU tweaks, not every handset can handle these things in the same way (I have 2 GT-I9100Ms, one can handle heavy UV while the other doesn't seem to be able to handle any, based on the serial numbers they were manufactured at roughly the same time, possibly the same batch) so what benchmarks well for one person may show awful results for another.
Thank you for your replies. the thing is i dont have S2 any more and waiting for S3. but curious about ROM well samsung rom should have better optimisation of drivers and so on because it's their rom well thats what i think but thats why i posted this to find out. ok so in real life what do you think witch is faster on browsing gaming and so on?
You mean between S2 and S3? Its obvious..
Bout benchmarks, always get higher quadrant on stock, and low on cm9/ aosp. But aosp runs as fast or faster in real life.
Sent from my GT-I9100 using Tapatalk 2
atifsh said:
You mean between S2 and S3? Its obvious..
Bout benchmarks, always get higher quadrant on stock, and low on cm9/ aosp. But aosp runs as fast or faster in real life.
Sent from my GT-I9100 using Tapatalk 2
Click to expand...
Click to collapse
I agree here, Touchwiz based ROMs seem to benchmark higher, while AOSP seems smoother in real world situations, I'm sure there are people out there who have the opposite results, so you aren't likely to get a consensus on whether one is better/faster/smoother than the other.
MistahBungle said:
1) Benchmarks are meaningless. The only people who think benchmarks are useful are normally the people who fap off over their benchmark scores. They're simply not any indication of real world performance of the phone.
2) Why not flash each rom & run benchmarks yourself ? Easy to do.
Click to expand...
Click to collapse
That's actually not true. Period.
fenjen said:
That's actually not true. Period.
Click to expand...
Click to collapse
Did you write that one-handed? Question mark. (why are we writing punctuation?)
oinkylicious said:
Did you write that one-handed? Question mark. (why are we writing punctuation?)
Click to expand...
Click to collapse
You do know it's to emphasise my point and it's a pretty common way to do it right?
Sent from my GT-I9300 using xda premium
Yeah it is true. You bumped a two month old thread simply to say "That's actually not true. Period.", so let's hear it champ. Tell us why that's the case. Or are you just another benchmark fapper who's FOS ?
I gave up porn a long time ago to masturbate furiously over benchmarks. This has actually had numerous positive effects on both my social life and my sex life.
First, using benchmarks instead of porn allows me to tailor exactly the intensity of fapping I want at that time in a easy, quick and efficient way. No longer do I have to wade through numerous porn videos trying to find that one attractive girl or that one interesting concept to fap to - now I can simply tweak my ROM and Kernel a little bit and get a score which reflects my horniness. Say I'd been camping with my trio of male friends for a week and having to share a tent the entire time, naturally fapping in such a situation would be frowned upon. When I finally get home I would be ready for a really special fap, so maybe I'd tune the scores upto a good 9000 and really crank one out. For everyday use, I use a steady 6000 score. This allows me to really optimize the amount of time I spend fapping per day.
Secondly, exchanging porn for benchmarks has had an extremely positive effect on my Sex life. No more am I staring at Pornstar's penises amazed at their size and wishing I had a similar prowess in bed. No longer am I insecure about sex or constantly wondering whether women actually like getting slapped. Now, when I have sex, I'm thinking one thing and one thing only - a score of 12000 in Quadrant. I am 12000, I am that score, I embody that score, that score is me and it drives me to hump like a God. Indeed, I can attest to the fact that fapping over benchmarks is far better than porn. So I say go OP go, I understand your plight, don't let these meth head unemployed porn addicts ever talk you out of your love of benchmarks, stay strong OP, stay fapping.
Hahahahahaha ;-) That could be the greatest post on XDA. Ever.
I used stock indian rom which was way more scoring than galaxy nexus f1 rom.
Mostly the difference was in i/o score.
Still will show you the stock score with speedmod kernel. :thumbup:
Sent from my GT-I9100 using Tapatalk 2
What do benchmarks actually measure? I always make allkinds of tests to the phones i have just for fun and to compare to others i have understood that a bigger score is always better..?
Benchmark test with antutu shows for me
10372
I have a s3 16gb and using the latest stock ics..
Sent from my GT-I9300 using xda app-developers app
CPU tests i guess is based on really long loops and depends on time that loop take you get result. RAM tests I think write big file direct to memory and depend of time get you speed of RAM memory in MBps or GBps...
On Antutu I have about 14,9K-15K with Paranoid and Siayah kernel. On Quadrant i have about 5,7K
Sent from my GT-I9300 using xda app-developers app
e-peen.
Seriously, different benchmarks measure different types of system performance by subjecting different elements of the device to different stress and performance tests. CPU calculstions, frames per second, javascript performance - they're genuinely useful in some situations, such as for devs to test out different approaches and ideas to see if one works fundamentally better than the other, and if done properly it can be useful to compare raw performance of one device to another, but they've cottoned on in the wider community because some people like to benchmark their phones and post those benchmarks proudly.
It's all a bit ridiculous, especially if - indeed - they don't know what they're benchmarking, or they're using out of date and largely useless benchmarks like quadrsnt, or they're just doing it for the bragging rights. It's relatively easy to push your phone and have it score well in assorted benchmarking tools if you really want to, it's just unlikely to be genuinely useful in that state - for example, setting the CPU governor to 'performance' had the effect of boosting it up to the highest available clock speed, and of raping your battery life. These are mobile devixes, not gaming PCs, and are designed to operate accordingly.
Personally, I ignore people's benchmark posts, because if they're posting benchmarks they're either brsgging, complaining about something absurd - "Your kernel doesn't perform as well as someone else's when in this unrealistic benchmarking scenario! It may best optimised for daily use, but now I can't hold my precious benchmarking score above everyone else's heads!" or "This new software update sucks because I don't get as high as score in Wankermark Extreme! [twenty sad faces]."
Hope that helps.
Sent from my GT-I9300 using xda premium
onslaught86 said:
e-peen.
Seriously, different benchmarks measure different types of system performance by subjecting different elements of the device to different stress and performance tests. CPU calculstions, frames per second, javascript performance - they're genuinely useful in some situations, such as for devs to test out different approaches and ideas to see if one works fundamentally better than the other, and if done properly it can be useful to compare raw performance of one device to another, but they've cottoned on in the wider community because some people like to benchmark their phones and post those benchmarks proudly.
It's all a bit ridiculous, especially if - indeed - they don't know what they're benchmarking, or they're using out of date and largely useless benchmarks like quadrsnt, or they're just doing it for the bragging rights. It's relatively easy to push your phone and have it score well in assorted benchmarking tools if you really want to, it's just unlikely to be genuinely useful in that state - for example, setting the CPU governor to 'performance' had the effect of boosting it up to the highest available clock speed, and of raping your battery life. These are mobile devixes, not gaming PCs, and are designed to operate accordingly.
Personally, I ignore people's benchmark posts, because if they're posting benchmarks they're either brsgging, complaining about something absurd - "Your kernel doesn't perform as well as someone else's when in this unrealistic benchmarking scenario! It may best optimised for daily use, but now I can't hold my precious benchmarking score above everyone else's heads!" or "This new software update sucks because I don't get as high as score in Wankermark Extreme! [twenty sad faces]."
Hope that helps.
Sent from my GT-I9300 using xda premium
Click to expand...
Click to collapse
200% agree but it wont stop the what is your quadrant score posts .
jje
it wont stop the what is your quadrant score posts .
Click to expand...
Click to collapse
Anyone good with Photoshop? Create a graph that reads 999'999'999'999'999'999 for your phone of choice and paste it under other people's claim.
It's neither more useful nor more useless than what they do
Benchmarks can be useful for yourself to check very basic performance before and after making changes (rom, kernel etc)
Sent via TCP/IP
gsw5700 said:
Benchmarks can be useful for yourself to check very basic performance before and after making changes (rom, kernel etc)
Sent via TCP/IP
Click to expand...
Click to collapse
Possible but run ten benchmarks one after the other and you get different results .
But as a method of a basic test to see if firmware has brought something extra to your phone yes .
Two areas of concern for users are always one use how the phone responds scrolls etc and that's subjective .Two is battery life and none of these benchmarks actually run a standard test that could be used to give a basic battery consumption figure over say a two hour period . But even that's not a good indicator of individuals battery usage .
jje
i am a bit of a benchmark nerd, and i was wondering what would be the best combination of rom/kernel overclock settings etc... to get the best benchmark scores i can get on our device?
Flash them. Use them. Judge for yourself. Benchmarks are useless and are only really for people who wanna compare how big their balls are. I've run some ROMS that scored low bench marks but ran really smooth.
Like Phalanx said, benchmarks are utterly useless. I've ran hd games at a smoother frame rate on lower-score benchmarked roms than on ridiculously high-scored roms.
I could make you a rom that scored over 9000 in benchmark but runs slow and crappy. As stated above benchmarks mean next to nothing.
Sent from Arkham