11
EXTERNAL NXP, THE NXP LOGO AND NXP SECURE CONNECTIONS FOR A SMARTER WORLD ARE TRADEMARKS OF NXP B.V. ALL OTHER PRODUCT OR SERVICE NAMES ARE THE PROPERTY OF THEIR RESPECTIVE OWNERS. © 2020 NXP B.V. MARCH 5, 2020 Brendon Slade NXP MCU Ecosystem Team Mike Vartanian Director of Strategic Partnerships, DSP Concepts Bringing Low Power, High Performance Audio and Voice to Market on the i.MX RT600 Crossover MCU

Bringing Low Power, High Performance Audio and Voice to

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

EXTERNAL

NXP, THE NXP LOGO AND NXP SECURE CONNECTIONS FOR A SMARTER WORLD ARE TRADEMARKS OF NXP B.V.

ALL OTHER PRODUCT OR SERVICE NAMES ARE THE PROPERTY OF THEIR RES PECTIVE OWNERS. © 2020 NXP B.V.

M A R C H 5 , 2 0 2 0

Brendon Slade

NXP MCU Ecosystem Team

Mike Vartanian

Director of Strategic Partnerships, DSP Concepts

Bringing Low Power, High

Performance Audio and Voice to

Market on the i.MX RT600

Crossover MCU

1EXTERNAL

i.MX RT600 MCU opens up new

possibilities in voice enabled audio

devices

How can I exploit this without a

ground-up software development

approach?

2EXTERNAL

Functional Integration

Pe

rfo

rma

nce

Software compatibility

Ease-of-use

Arm® Based

NXP SCALABLE EDGE PROCESSING CONTINUUM

3EXTERNAL2017 2018 2019

1MB

512KB

256KB

600MHz Cortex-M7, 32K/32K L18/16-bit EMI (SDRAM/SRAM)LCD / CSI / 2D accelerationStandard Security

i.MX RT1050

LQFP144 LQFP100

BGA196

40nm

ArmCM7

ArmCM33

VFBGA176

300 MHz Cortex-M33 with TrustZoneAdvanced Audio IntegrationAdvanced Security, SRAM PUF, root of trust4.5MB SRAM for IoT Stacks and Algorithms

2MB

3 – 5MB

Inte

grat

ed

SR

AM

NXP 32-BIT ARM BASED MCUS

i.MX RT SERIES MCU ROADMAP | HIGH PERFORMANCE

Execution

Production

Proposal

Product

Samples

Planning

i.MX RT600General-

purpose

MCUs

Perf

orm

an

ce

600MHz Cortex-M7, 32K/32K L11MB SRAM, 8/16-bit EMI (SDRAM/SRAM)LCD / CSI / 2D accelerationStandard Security

i.MX RT1060 i.MX RT1064

i.MX RT1020

500MHz Cortex-M7, 16K/16K L1256KB SRAM, 16-bit EMI (SDRAM/SRAM)Standard Security

LQFP100 LQFP80

BGA196

600MHz Cortex-M7, 32K/32K L11MB SRAM, 4MB Flash8/16-bit EMI (SDRAM/SRAM)LCD / CSI / 2D accelerationStandard Security

500MHz Cortex-M7, 16K/16K L1128KB SRAM, QSPIStandard Security

500MHz Cortex-M7, 16K/16K L1128KB SRAM, QSPIStandard Security

1GHz Cortex-M7, 32K/32K L18/16-bit EMI (SDRAM/SRAM)2D graphics acceleration, MIPI DSI/CSIAutomotive, TSN, Security

i.MX RT1170

BGA289

i.MX RT1015

.+ 600MHz DSP

i .MX RT SERIES | PORTFOLIO

2020

i.MX RT1010

4EXTERNAL

DSP CONCEPTS: INTRODUCTION & WHAT WE DO?

Engineering Services

• System Architecture

• System profiling & check (RTASC)

• Mic-array Design

• Loudspeaker tuning

• Audio Weaver Custom Modules

• Custom Audio Solutions

Audio Weaver Platform

• AWE Designer• Graphical Audio Development Tools

• AWE Core• Embedded Processing Engine

• Real Time Audio System Check• RTASC - System validation suite

Audio Weaver Solutions

• TalkTo - Voice Front End

• Mono/Stereo & Multichannel

• Nearfield / Low Power

• Voice Communication

• Audio Playback IP

• Smart Volume

• Perceptual Bass Enhancement

• Dialogue Enhancement

• Founded in 2003 as consultancy, transitioned to a product company in 2014

• We empower industry with a standardized audio processing platform & IP

5EXTERNAL

Audio Weaver DesignerConfiguration tools for AWE Core

• Integrate & Create advanced audio features

• Real-time Interface for design and debug

• Open APIs for external tools and scripting

Audio Weaver Core

All-in-one Audio Processing Engine

• Runtime-reconfigurable Audio-Pipeline

• 400+ Audio Building-blocks

• Runs on MIMXRT685-EVK Board

• Optimized for Cadence HiFi 4 DSP

AUDIO WEAVER: DESIGN, TUNE, AND DEPLOY

6EXTERNAL

TalkTo Features

• Exceptional far field performance

• Mono, Stereo, or multichannel AEC

• Adaptive Interference Canceller™

• 2, 4, or 6 mic geometries

• Custom mic-arrays supported

• Optional loudspeaker processing

• Optimized for i.MX RT685

Voice-Enabled Product

Wake Word

Engine

Speech to Intent(local or cloud)

AE

C R

efe

ren

ce

Room

Sound

Extracted Speech

Detected Command

Response

Source Speaker

Management

Targeted Applications

• IoT & Smart Home

• Appliances

• Smart Speakers

• TVs & Set-top boxes

• Multichannel Soundbars

TALKTO VOICE ON RT600

7EXTERNAL

NXP RT685

Source

AUDIO WEAVER DEMONSTRATION – QUICKLY DEPLOY YOUR AUDIO SOLUTION

Loudspeaker

Test Setup

• PC Laptop running Audio Weaver Designer

• Audio Weaver Core on both Arm® Cortex®

M33 and Cadence® Tensilica® HiFi 4 DSP

• PC sends configurations to cores

• PC reads profile information from cores

• MCU routes audio / DSP Processes in this

example

Read/Write Data

Arm® Cortex®

M33

Powered by Audio Weaver Core

Cadence®

Tensilica®

HiFi 4 DSP

Powered by Audio Weaver Core

8EXTERNAL

1. Free 30-day License for Audio Weaver Designer:

https://dspconcepts.com/awe-designer

2. MIMXRT685-EVK Development Board ($129 USD)

available from NXP and its distributors

i.MX RT600 Device family:

https://www.nxp.com/imxrt600

Follow-up Questions Mike Vartanian

[email protected]

NEXT STEPS: EVALUATE TALKTO & AUDIO WEAVER

3. Contact DSP Concepts for Audio Weaver

Core and/or TalkTo Development Licenses

9EXTERNAL9

EXTERNAL

NXP, THE NXP LOGO AND NXP SECURE CONNECTIONS FOR A SMARTER WORLD ARE TRADEMARKS OF NXP B.V.

ALL OTHER PRODUCT OR SERVICE NAMES ARE THE PROPERTY OF THEIR RES PECTIVE OWNERS. © 2020 NXP B.V.

Thank you for listening

9

1 0EXTERNAL