Upload
hosea
View
36
Download
0
Tags:
Embed Size (px)
DESCRIPTION
Moab Accounting Manager Scott Jackson SC11 – Nov 12-18, 2011. Accounting. Charging. Allocation Management. Accounting. 4. 2. 1. 3. Usage Tracking. Usage Record. Moab Accounting Manager. 1 A job is submitted. 2 The job is started. Moab Workload Manager. 3 The j ob completes. - PowerPoint PPT Presentation
Citation preview
Moab Accounting ManagerScott Jackson
SC11 – Nov 12-18, 2011
Accounting
Charging
Allocation Management
Accounting
© 2011 Adaptive Computing
Usage Tracking
Moab Accounting Manager
1
2
3
4
1 A job is submitted
Moab Workload Manager
2 The job is started
3 The job completes
Resource or Service
Manager(i.e. Torque)
4 Usage is recorded
UsageRecord
© 2011 Adaptive Computing5
Customizable Usage Records
© 2011 Adaptive Computing6
Organizational Hierarchy
Project
Department
College Arts and Sciences
Sciences
biology chemistry
Arts
music film
Charging
ChargeRates
Fees
Multipliers
Usage
Resources
ValueE
Name
Type Name Instance RateVBR Processors 1VBR Memory 0.001NBR License Matlab 5VBU Power 0.001VBU CpuTime 1NBU Feature GPU 200VBM Discount 0.9NBM QualityOfService Premium 2NBM QualityOfService BottomFeeder 0.5VBF Shipping 25NBF Zone Asia 200
Example Charge Rates
Charge CalculationTotal = (S Resources + S Usage) x P Multipliers + S
FeesVBR NBR VBU NBU
VBM NBM
VBF NBF
VBRNBR VBU
NBU
VBMNBM
VBF NBF
VBRNBR VBUNBU
VBM NBM
VBFNBF
VBM NBM
NBFVBF
Resource Charges Usage Charges
Multipliers
Fees
+x
+
Resource & Usage Charges
© 2011 Adaptive Computing
Account of Charges
Chargeback Accounting
Moab Accounting Manager
0
1
2
3
40 Ample accounts are established
1 A job is submitted
Moab Workload Manager
2 The job is started
Account of Charges
3 The job completes
Resource or Service
Manager(i.e. Torque)
4 A charge is assessed
and usage is recorded
UsageRecord
© 2011 Adaptive Computing12
Charge Rates
© 2011 Adaptive Computing13
Accounts
© 2011 Adaptive Computing14
Account Statement
AllocationManagement
Engineering
Chemistry
Computer Science
Bioinformatics
Physics
25 %
15 %
25 %
30 %
5 %
Cutting the “Pie”
Chemistry
Physics
Bioinformatics
Engineering
Computer Science
Total System
Resources
Total System
Resources
© 2011 Adaptive Computing
Enforcing Allocations
Moab Accounting Manager
0
2
1
4
3
5
6
DepositQuote
3 A reservation is placed against the account
Moab Workload Manager
Reservation
5 The job completes
Resource or Service
Manager(i.e. Torque)
6 The reservation is removed
Reservation
a charge is assessed
Charge
UsageRecord
and usage is recorded
0 Deposits are made in accounts
1 A job is submitted
2 A quote or balance check is performed
4 The job is permitted to start
h Pre-Pay gAccount
Job Timeline
End-UserMoabMoab
5-CreditJob
h Post-Pay gAccount
Job Timeline
End-UserMoabMoab
5-CreditJob
Credit LimitLien
h Installments gAccount
Job Timeline
End-UserMoabMoab
5-CreditJob
© 2011 Adaptive Computing22
Debit Account Balance
© 2011 Adaptive Computing23
Credit Account Balance
© 2011 Adaptive Computing
Year-end Resource Exhaustion
It is common to see projects get off to a slow start and then have a surge of activity at the end when results are due.
Without careful management of expectations, this can be a cause of considerable anxiety.
100% Machine Capacity
Project A’s Allotment
Project A’s Demand
Project Period
© 2011 Adaptive Computing
Capacity & Workload Planning:The Brick Approach Controlling project usage is key to capacity and workload
planning. The use of regularly expiring allocations allows you to
establish a project cycle and use the brick approach to allocation management.
Now- 1 Qtr + 3 Qtr+ 2 Qtr+ 1 Qtr- 3 Qtr - 2 Qtr + 4 Qtr
100 % Capacity
10,000
10,000
10,000
10,000
Staggered Allocations
10,00010,00010,00010,000-0-Active Allocations:
expired
10,000
10,000
10,000
expired
expired
expired
Allocation1
Allocation 2
Allocation 3
Allocation 4
Jan Feb Mar Apr May Jun Jul NovOctSepAug JanDec
© 2011 Adaptive Computing27
Expiring Allocations
Interaction Methods
GUI
API
CLI
© 2011 Adaptive Computing
Other Gold Features
Guaranteed Quotes
Powerful QueryingRoles and Authentication
Historical Journaling
© 2011 Adaptive Computing
What’s NewMoab Accounting Manager 6.0
In this major release of Moab Accounting Manager, many HPC-centric limitations were generalized for application in the cloud space.
Account design was overhauled to allow accounts to be associated with arbitrary constraints instead of being tied specifically to users, projects and machines.
The usage record is now more generic for more general applicability in cloud. Better filtering can be applied to the results of bank object queries. These filters
also enable more refined role privilege filtering. Command-line clients have been added to better manage roles and charge rates. Object defaults and auto-generation have been generalized to custom objects. Arbitrary organizational relationships can be established and applied to the
usage dynamics. Quotes, reservations and charges may use independently negotiated prices for
resource and usage rates. A priority can be associated with accounts to influence account precedence
when charging.
© 2011 Adaptive Computing
What’s NextMoab Accounting Manager 7.0?
Adds support for infinite allocations. Deposits can be made with infinite amounts or infinite credit limits.
Adds support for resetting of allocations and better tracking of total allocation amounts as well as percent used and remaining.
A new charge table stores an itemized breakdown of charges. Adds support for conditional charge rates, charge rate defaults and enhanced
charge rate value ranges. Includes a new event scheduler that can be used to schedule periodic or future
Moab Accounting Manager commands. A new payment scheduling capability allows Moab Accounting Manager to
manage periodic charges during the lifetime of a workflow or long-running job as well as apply setup and teardown charges.
Moab Accounting Manager now will install the Perl module dependencies from CPAN and will allow the designation of separate directories for the installation.
© 2011 Adaptive Computing
60,000
Lump Sum
Active Allocations: 60,000-0-
expiredAllocation
Jan Feb Mar Apr May Jun Jul
© 2011 Adaptive Computing
10,000
10,000
10,000
10,000
10,000
10,000
60,000
Allocation 1
Allocation 2
Allocation 3
Allocation 4
Allocation 5
Allocation 6
Jan Feb Mar Apr May Jun Jul
Stepped
50,00040,00030,00020,00010,000-0-
expired
expired
expired
expired
expired
expired
Active Allocations:
© 2011 Adaptive Computing
10,000
10,000
10,000
10,000
10,000
10,000
Inverted Steps
10,00020,00030,00040,00050,00060,000-0-Active Allocations:
expired
10,000
10,000
10,000
10,000
10,000
expired
expired
expired
expired
expired
Allocation 1
Allocation 2
Allocation 3
Allocation 4
Allocation 5
Allocation 6
Jan Feb Mar Apr May Jun Jul
© 2011 Adaptive Computing
5,000
5,000
5,000
5,000
5,000
5,000
Overlapping-Staggered
10,00010,00010,00010,00010,00010,000
5,000
-0-Active Allocations:
expired
5,000
5,000
5,000
5,000
expired
expired
expired
expired
5,000expired
Allocation 6
5,000expired
Allocation 1
Allocation 2
Allocation 3
Allocation 4
Allocation 5
Allocation 7
Jan Feb Mar Apr May Jun Jul