Posted: September 5, 2013

Plotting, mapping and analysis of KPI’s and events using Diagnostics & Analytics.

Azimuth Systems, Inc. introduced the first integrated automation and analytics toolset purpose-built for LTE device profiling and benchmarking, to support mobile operators, device manufacturers and their ecosystem partners in measuring and analyzing device performance for pre-launch quality assurance and in-market troubleshooting. Device Automation & Control (DAC) enables unattended execution of user experience testing and logging on smartphones and other mobile devices. In its latest revision, DAC integrates with Azimuth’s new Diagnostics & Analytics (DnA) software, which processes and visualizes the user experience KPIs and device logs to compare performance between devices, generate pass-fail-warning alerts based on criteria set by the user, elegantly link performance KPIs to underlying conditions, and produce offline reports for further analysis and presentation.

The mobile user experience is driven by a complex series of interactions between networks, devices, services and applications, all of which are tested prior to products being introduced to the market. The industry is undertaking an unprecedented number of technology changes at each of these layers, forcing increases in the scope of testing, when industry participants are already faced with competitive pressure to reduce time to market. Mobile operators also need to ensure that new devices do not have adverse impacts on their networks. And budget constraints are being felt across the mobile ecosystem.

Sample test flow using Device Automation & Control (DAC), which is highly modular and configurable.

DAC and DnA provide streamlined, end-to-end testing and analysis of mobile performance, starting with user experience at the application level, through to network conditions as captured in comprehensive logs. In lab or field testing, a consistent test plan can be configured and saved, multiple devices can be tested under the same plan and conditions, post-processing can begin while testing is still in progress, and issues can be highlighted along with potential root causes. Reports containing analysis as well as supporting logs can be shared across organizations – including between lab and field teams, and between operators, manufacturers and their partners. By reducing the time it takes to conduct testing across a wide range of scenarios, to process results and pinpoint issues, and to share them across organizational boundaries, this automation and analytics toolset enables device test teams to address growing requirements with greater efficiency than existing solutions.

More About DAC

Device Automation & Control (DAC) is a software solution enabling unattended execution of application-specific user experience testing on smartphones and other mobile devices. DAC was developed to address the requirements of both lab- and field-based test organizations, providing a common tool set and methodology across test environments. DAC automates the operation, results capture and reporting of the device functions which are most important to operators, OEMs, chipset manufacturers and other mobile ecosystem partners.

Key features include:

  • Automation of voice calls, messaging, data and video streaming
  • Control of Azimuth and third-party test bed elements including diagnostic monitors, network emulators, analysis and reporting
  • Integration with Azimuth’s Test Builder automation suite, enabling drag-and-drop creation of test plans to fit customers’ unique requirements.

More About DnA

Diagnostics & Analytics (DnA) is a unique engine to analyze, visualize and correlate metrics from user experience to device performance and network conditions, including access, connectivity, mobility and PHY/MAC. DnA works seamlessly with DAC, accepting user experience and diagnostic logs for post processing. It is also modular enough to accept inputs from other sources as well.

The DnA tool, consisting of a visualization interface and a reporting engine, is designed such that the tester can get a quick clear understanding of the impact areas, and dig into detailed information if and as required. Visualization provides the most relevant snapshot to allow the user to pinpoint necessary information. Sophisticated reporting is organized into performance-impact areas, with a generic format to allow integration into back-end systems. While DnA is designed to specifically facilitate device benchmarking and profiling, it is flexible enough to adapt to users’ specific test requirements, such as enabling user setting of pass-fail-warning alerts for individual KPIs.

Key features include:

  • Collection and analysis of user experience KPIs and device-network interaction logs, facilitating device benchmarking and profiling
  • Detailed report generation for performance of different device functions tested using DAC
  • Easy visualization of KPIs and events using synchronized and non-synchronized plot options
  • Mapping functionality of drive route and events along the drive route
  • Customizable evaluation of pass/fail for each of the device-network interaction and user experience KPIs.

Post a Comment

Comments are closed