Gummadi-HP33-ConnectingtoNonStopSQL-Scale

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Ajaya Gummadi

WW NonStop Data & Cloud Product Manager

November 18, 2014

HP33: Building your Connectivity App for Scale


This is a rolling (up to three year) Roadmap and is subject to change without notice.

Forward-looking statements

– This document contains forward looking statements regarding future operations, product development, product capabilities and availability dates. This information is subject to substantial uncertainties and is subject to change at any time without prior notification. Statements contained in this document concerning these matters only reflect Hewlett Packard's predictions and / or expectations as of the date of this document and actual results and future plans of Hewlett-Packard may differ significantly as a result of, among other things, changes in product strategy resulting from technological, internal corporate, market and other changes. This is not a commitment to deliver any material, code or functionality and should not be relied upon in making purchasing decisions.


Database Connectivity

• NonStop SQL/MX uses industry standards such ODBC and JDBC for off-platform connectivity

• Enables transparent use of 3rd Party or Open Source software based on these standards

• Standard, published APIs used for communication with NonStop SQL database

• Clients can access both native MP and MX tables


Application Architecture

C/C++ app Perl app PHP app Java appPython app

ODBC API ODBC API ODBC API JDBC APIODBC API

ODBC Driver ODBC Driver ODBC Driver JDBC DriverODBC Driver

NonStop SQL/MX DatabaseSupports both MP and MX tables

MXCS Subsystem

ODBC Drivers available for

NonStop OSS, Microsoft Windows, Linux, HP-UX, IBM AIX, Oracle Solaris

(Restricted availability)

32 and 64 bit

JDBC Drivers available for

NonStop (T2) and for all other platforms

(T4)

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5

MXCS Connectivity Services Architecture

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

MXCS Connectivity Architecture

CLI zclidll

Executor zclipdll

Filesystem

MXOSRVR

MXOASCLI zclidll

Executor zclipdll

Filesystem

CatmanSQL

Compile

r

Compiler mxcmp

JDBC

T4/ODBC

Applications

MFC Module

files


2

3

On-platform, OSS ODBC/MX driver gives the best performance

Supports multi-threaded applications, work on increasing number of supported threads

Handles multiple concurrent requests from different connections using nowait, asynchronous processing

1

On-platform OSS ODBC/MX Apps

4New revision of driver under test does data movement optimizations


2

3

Off-platform, JDBC Apps port as-isNot much prior knowledge of NonStop platform requiredMulti-threaded apps supportedEach app can have multiple db connections

Type 4 driver connects to the MXCS subsystemUses socket communication

Each JDBC T4 connection has a dedicated MXOSRVR process

1

Off-platform Java JDBC T4 Apps

4

MXOSRVR communicates with the SQL Executor using a waited interfaceExecutor CLI call returns control to MXOSRVR only after the operation completes


2

3

On-platform, offers a no-waited call-level interface (CLI) to SQL Executor

An app can support multiple database connectionsT2 driver can switch between connections using nowait CLI, with minimal switching overheads

With NSASJ and NSMQ, JDBC T2 apps are now commonly being used

1

On-platform Java JDBC T2 Apps

4Memory limitations could be hit when there is a high number of connections per JVM instance, with each connection executing a high number of SQL statements


HP NonStop Connectivity apps for scale

• For a very high number of concurrent connections (few thousands), consider distributing your

metadata tables

• Typically SQL/MX metadata tables reside on one volume

• A volume has a limit of 65,000 opens

• Each mxosrvr process has an associated mxcmp process

• For example, if you are trying to spawn 4000 concurrent connections,

• 4000 mxosrvr processes, 4000 mxcmp processes

• Every instance of mxosrvr, has 5 opens on the metadata

• Every instance of mxcmp has 16 opens on the metadata

• MXOSRVR will close these opens after metadata operations are complete

(upcoming TCF)

• Distribute metadata tables is an option (CQDs required)

• Metadata access management is under architecture discussion

This is a rolling (up to three year) Statement of Direction and is subject to change without notice.


HP NonStop Connectivity enhancements in CY13-14

• Any JDBC T4 application in cloud can access NonStop SQL instance over an

encrypted SSL connection

• 64-bit JDBC T2 driver

• 64-bit ODBC driver for Linux 6.2

• ODBC Applications running on HP-UX IA64, Solaris (Restricted) can access

NonStop SQL database instance in a 2-Tier application architecture

• ODBC Applications running on Windows can insert/select UTF-16 encoded

Unicode data

• IPv6 support in MXCS


HP NonStop Connectivity Enhancements

• Unicode support in T2 and T4 driver

• Improve MFC capability in T2 driver, OSS ODBC/MX driver, and all other *NIX

drivers

• Provide EXEC DIRECT support for MFC in T2 driver

• SSL across all off-platform drivers

• Ability to link data source to a specific Association server

• Recognize username/password in T2 driver

• Provide Transaction AutoAbort

• Mxcmp timeout and cleanup


© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.… 2015 would see more innovations

HP NonStop SQL: 2014 was a year focused on quality and stability


HP NonStop SQL Roadmap

14 This is a rolling (up to three year) Statement of Direction and is subject to change without notice.

SQL/MX 3.0

H06.22/J06.11

Feb ‘11

SQL/MX 3.1

H06.23/J06.12

Oct ‘11

SQL/MX 3.2

H06.25/J06.14

Sep’12

SQL/MX 3.2.1

H06.26/J06.15

Feb ‘13

Connectivity

H06.26/J06.15

Aug’13

SQL/MX 3.3

H06.29/J06.18

Feb’15

SQL/MX 2.1.1 – G06.27 September 2005, mature and supported

SQL/MX 2.3.4

H06.20 / J06.09

Feb’10

SQL/MX AQL

Bundle

H06.28/J06.17

April’14

Annual cadence of feature/function

releases

2011 2014 2012 20132010 2015

SQL/MX ARA

H06.28/J06.17

September’14


HP NonStop SQL – next release candidates

• Online mxci help

• PAK2/UNPAK2 to archive/un-archive MX files in OSS

• MXDM support for create/alter database objects

• Safeguard Delete User protection and respect Volume ACLs and Display

Object permissions

• BR2 enhancements – schema and table names could differ, no need to pre-

create Catalogs for a Restore operation

• Query Plan Quality Improvements

• Executor performance enhancements – 64 bit EID

• Currently planned for 1QCY2015



HP NonStop – future release candidates

• EBCDIC collation of Ascii data

• Configurable ESP placement

• T2 driver should not ignore username/pwd

• Support for External Sequence in Triggers

• User Defined Functions

• DDL and DML support for Materialized Views

• Oracle Migration features: TO_DATE, TO_TIMESTAMP, LAST_DAY, MONTHS_BETWEEN

• MXDM – close the gap with NSM/Web

• Improved MDAM selection

• Reduce memory footprint of mxcmp, resource cleanup

• Currently planned for 1QCY2016



HP NonStop SQL Future Revision Candidates

• Table Maintain

• SQL Statement Logging

• SPJ Debug and Profiling

• Customer requests

• Interop within 3.x releases

• JDBC 4.0 standard

• ODBC 3.8 standard

• Optimizer hints

• MXDM integration with VQA,

NSKBUSY, Listlocks, Design

Advisor…

• Parallelism in Utilities like

Fastcopy, DUP, Import

• Shared memory for query

plans

Annual cadence of feature/function releases



In summary,

• We have pushed Connectivity apps – 3000 tps, 12,000 tps, 20,000 tps …

• Concurrent connections – 2000++

• Projects identified on Roadmap would further push MXCS limits and throughput

rates



Resources

Contacts & Resources

Contacts

www.hp.com/go/NonStopDatabase(Customer accessible web portal)

www.hp.com/go/NonStop-Docs (All NonStop publications available for customers)

Worldwide NonStop Product Manager:

[email protected]

Performance specialists: Talk to your

Nonstop Sales Rep; ask for NonStop ATC

resources

http://www.hp.com/go/NonStopDatabase

http://www.hp.com/go/NonStop-Docs

mailto:[email protected]

Thank [email protected]

WW NonStop Product Management

Documents

Gummadi-HP33-ConnectingtoNonStopSQL-Scale