Machine Learning Inference Performance

AIMark 3

AIMark makes use of various vendor SDKs to implement the benchmarks. This means that the end-results really aren’t a proper apples-to-apples comparison, however it represents an approach that actually will be used by some vendors in their in-house applications or even some rare third-party app.

鲁大师 / Master Lu - AIMark 3 - InceptionV3 鲁大师 / Master Lu - AIMark 3 - ResNet34 鲁大师 / Master Lu - AIMark 3 - MobileNet-SSD 鲁大师 / Master Lu - AIMark 3 - DeepLabV3

In AIMark, the Red Magic 3 performs alongside the top Snapdragon 855 devices on the market, which is again a good sign of the software optimisations of the phone’s BSP.

AIBenchmark 3

AIBenchmark takes a different approach to benchmarking. Here the test uses the hardware agnostic NNAPI in order to accelerate inferencing, meaning it doesn’t use any proprietary aspects of a given hardware except for the drivers that actually enable the abstraction between software and hardware. This approach is more apples-to-apples, but also means that we can’t do cross-platform comparisons, like testing iPhones.

We’re publishing one-shot inference times. The difference here to sustained performance inference times is that these figures have more timing overhead on the part of the software stack from initialising the test to actually executing the computation.

AIBenchmark 3 - NNAPI CPU

We’re segregating the AIBenchmark scores by execution block, starting off with the regular CPU workloads that simply use TensorFlow libraries and do not attempt to run on specialized hardware blocks.

AIBenchmark 3 - 1 - The Life - CPU/FP AIBenchmark 3 - 2 - Zoo - CPU/FP AIBenchmark 3 - 3 - Pioneers - CPU/INT AIBenchmark 3 - 4 - Let's Play - CPU/FP AIBenchmark 3 - 7 - Ms. Universe - CPU/FP AIBenchmark 3 - 7 - Ms. Universe - CPU/INT AIBenchmark 3 - 8 - Blur iT! - CPU/FP

In AI Benchmark’s CPU workloads, the RM3 fares average amongst its S855 counterparts, but nothing too much out of line that it’d be an issue.

AIBenchmark 3 - NNAPI INT8

AIBenchmark 3 - 1 - The Life - INT8 AIBenchmark 3 - 2 - Zoo - Int8 AIBenchmark 3 - 3 - Pioneers - INT8 AIBenchmark 3 - 5 - Masterpiece - INT8 AIBenchmark 3 - 6 - Cartoons - INT8

AIBenchmark 3 - NNAPI FP16

AIBenchmark 3 - 1 - The Life - FP16 AIBenchmark 3 - 2 - Zoo - FP16 AIBenchmark 3 - 3 - Pioneers - FP16 AIBenchmark 3 - 5 - Masterpiece - FP16 AIBenchmark 3 - 6 - Cartoons - FP16 AIBenchmark 3 - 9 - Berlin Driving - FP16 AIBenchmark 3 - 10 - WESPE-dn - FP16

AIBenchmark 3 - NNAPI FP32

AIBenchmark 3 - 10 - WESPE-dn - FP32

On the INT8, FP16 and FP32 side, the RM3 performs very well and is amongst the top performing phones. This advantage should simply be due to the RM3 having the latest software stack employed.

System Performance GPU Performance
Comments Locked

31 Comments

View All Comments

  • abufrejoval - Friday, September 27, 2019 - link

    The OnePlus 7T has been announced: Basically a compromise between the 7 and 7 Pro with a 90Hz screen, tripple camera and somewhat bigger battery and *no curves* where dazzle isn't helping.
  • nerdydesi - Friday, September 27, 2019 - link

    Has the anandtech staff or any owners here been able to get Carrier Aggregation working? From what I've heard, it's disabled on all non-Chinese models which is very disappointing to hear since the SD855 and its modem are well capable of it.

    It's a bit of a dealbreaker and I'm thinking to sell my unit.
  • Lord of the Bored - Saturday, September 28, 2019 - link

    " volume rocket buttons"
    Best phone right there. Page one and I'm sold.
  • StevenJConnell - Saturday, September 28, 2019 - link

    biLAL98STEPS.COM
  • StevenJConnell - Saturday, September 28, 2019 - link

    THE LINK98STEPS.COM
  • isthisavailable - Saturday, September 28, 2019 - link

    In the GPU performance charts, is there any way that you can include the maximum skin temperature on the phone? (no need to retest old phones). It does not matter if OnePlus 7 Pro has higher sustained performance if it gets significantly hotter. (Actually, it's a negative imo as I really don't like holding a hot phone)
  • Steve Waugh - Sunday, September 29, 2019 - link

    Thanks for sharing this information is being very knowledgeable and interesting. This post is about the new smartphone and it's great features.
    <a href="https://www.alltopsite.com/top-300-high-da-classif... Submissions Sites</a>
  • factocert1 - Monday, September 30, 2019 - link

    This is one of the finest post i have ever seen. The information is genuine and relatable . We are really grateful for your article sir
  • zeeBomb - Tuesday, October 1, 2019 - link

    This was a good read! Great review, Andrei!
  • bestlaapzz - Sunday, October 13, 2019 - link

    These tablets additionally tap into Alexa's aptitudes. You'll have the option to control your home and https://laptopswhizz.com/best-laptop-for-medical-s... pose inquiries of Alexa through your tablet and find the solutions served up as cards, or by means of voice. On the Fire 7 you'll need to press and hold the home catch to trigger Alexa.

Log in

Don't have an account? Sign up now