Upload
finitsolutions
View
77
Download
2
Tags:
Embed Size (px)
Citation preview
The Finit Solutions Series
Getting the most out of FDM: Fully Automating Your DataFully Automating Your Data Loads
April 14 2010April 14, 2010
Presented by Jay Hampton
www.finitsolutions.com
The Finit Solutions Series
About Finit Solutions
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Finit IntroductionThe Finit Solutions Series
Finit Solutions specializes in consulting services in the Oracle Hyperion Enterprise Performance Management Solutions suite of products:
Financial Consolidation– Financial Management (HFM)
Hyperion Enterprise
Planning and Business Intelligence– Planning
Essbase– Hyperion Enterprise
Integration– Financial Data Quality Management
– Essbase
BI+ Reporting ToolsFinancial ReportingFinancial Data Quality Management
(FDM)
– Oracle Data Integrator (ODI)
– Data Integration Management (DIM)
– Financial Reporting
– Smartview
– Web Analysis
Essbase Excel Add ing g ( )
– Other (EPMA, ERPi, etc)– Essbase Excel Add‐in
www.finitsolutions.com‐ 3 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Finit’s HFM and FDM ExpertiseThe Finit Solutions Series
• Finit has one of the largest practices of HFM certified consultants on staff in the country. We have experience back to the early versions of
p
y p yHFM and have assisted clients with all aspects of HFM deployments from full lifecycle implementations to application optimization / redesign activitiesredesign activities.
•Finit has a long history with Hyperion FDM having started with the g y yp glegacy product, UpStream WebLink. Finit became UpStream Software’s first consulting partner in 2002. Collectively, Finit has designed and implemented UpStream / Hyperion FDM that havedesigned and implemented UpStream / Hyperion FDM that have sourced data from over 4,800 source systems and are used by over 5,000 end users.
www.finitsolutions.com‐ 4 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Finit’s Client ServiceThe Finit Solutions Series
W t k li t i i lWe take client service very seriously.
Our client service approach has led to 100% customer satisfaction for every Finit client f y
(119 and counting).
www.finitsolutions.com‐ 5 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Some Finit ClientsThe Finit Solutions Series
•
www.finitsolutions.com‐ 6 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
About the PresenterThe Finit Solutions Series
Jay Hampton([email protected])
• Partner with Finit Solutions• More than 5 years of experience implementing Hyperion products• More than 5 years of experience implementing Hyperion products
– Hyperion Financial Data Quality Management (FDM)– Hyperion Enterprise– Hyperion Financial Management (HFM)
• Frequent presenter at Hyperion conferences• Serves as the FDM Domain Lead on the OAUG Hyperion Special Interest Group
(SIG)
www.finitsolutions.com‐ 7 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
How to Ask a QuestionThe Finit Solutions Series
Q
www.finitsolutions.com‐ 8 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
AgendaThe Finit Solutions Series
• What is FDM Batch Loader?
H d th B t h L d k?
g
• How does the Batch Loader work?– File Location and Naming Conventions
• AutoMap Correct Feature
• Running the Batch Loader ‐ Demonstration– Manual with Interface in Workbench
– Via a script and FDM Task Flow
i i d k– Via a script and FDM Task Manager
• FDM Batch Reports
www.finitsolutions.com‐ 9 ‐
• Real World FDM Batch Solutions
The Finit Solutions Series
What is the FDM Batch Loader?
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
What is FDM Batch Loader?The Finit Solutions Series
• The FDM Batch Loading process allows users to automate as much or as little of the FDM process as they requirep y q
• Automate some or all of the Import, Validate, Export and Check steps
• The FDM Batch Loader can be initiated in the following ways
– Manually via the Batch Loader Interface in the FDM Workbenchy
– Manually via an FDM Script / Task Flow in the FDM web interface
– Automatically via an FDM Script using the FDM Task Manager
www.finitsolutions.com‐ 11 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
What is FDM Batch Loader?The Finit Solutions Series
• Gives you the ability to load same types of files as you would manually in FDMy
– Standard Text Files
– Multi‐Load Files (Excel or Text)
– FDM Excel Based Journals
• Auto‐Map Functionality
bili i ll ‘ d’ i i h l d– Ability to automatically map any ‘unmapped’ items in the load file
– These ‘unmapped’ accounts will be logged and can be reportedThese unmapped accounts will be logged and can be reported on
www.finitsolutions.com‐ 12 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
What is FDM Batch LoaderThe Finit Solutions Series
• Full logging of completed batch processes along with logging of any errors that occur during thewith logging of any errors that occur during the batch process
Thi ll b i d i h B h R f– This can all be viewed in the Batch Reports from within FDM’s Reports Screen.
• Ability for “Lights Out” Processing– When combined with the FDM Task Manager, the Batch Loader can be set up to run automatically
– No user needs to log into FDM to begin the process or
www.finitsolutions.com‐ 13 ‐
execute any tasks
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Cost of FDM Batch LoaderThe Finit Solutions Series
• Batch Loader is a separately licensed component of FDM
• You already own Batch Loader if you purchased the• You already own Batch Loader if you purchased the ‘Adapter Suite’ which contains the adapters for Essbase, Strategic Finance, Tax Stream and Data MartStrategic Finance, Tax Stream and Data Mart
• If you only bought FDM with the HFM or Hyperion Enterprise adapters you do not yet own the Batch Loaderp p y y
• Please send a note to [email protected] with questions about Batch Loader licensing and whether you q g yhave already purchased it
www.finitsolutions.com‐ 14 ‐
The Finit Solutions Series
How does the Batch Loader work?
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
How does Batch Loader work?The Finit Solutions Series
• Two Main Components
d d l d b– Standard File Naming Convention – used by FDM to identify the Point of View for the file to b l d dbe loaded
– Standard File Location – used by FDM to know the location of the files to be processed
www.finitsolutions.com‐ 16 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
File Naming ConventionThe Finit Solutions Series
g• Files to be loaded via the batch loader must be created with an
FDM specific file name formatp
• The file name is used by FDM to determine the point of view to process the file for (i.e. what location, period and category is
t i d i th fil )contained in the file)
• The file name is parsed into five different segments and can be delimited by (‘~’, ‘ ’, ‘@’)y ( , _ , @ )
• Sample Formatted File Name:
A1000~Texas~Actual~Jan‐2010~RR.txt
www.finitsolutions.com‐ 17 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
File Naming ConventionThe Finit Solutions Series
g
A1000~Texas~Actual~Jan‐2010~RR.txt• What are the segments?• What are the segments?
– File ID (ex. A1000)— a free form field. This field can be used to control the order in which the batch files will load. It can also store variables (i.e. username date of run job # etc )username, date of run, job #, etc.).
– Location (ex. Texas) — FDM location name to be loaded
– Category (ex. Actual)— FDM category name
– Period (ex. Jan‐2010)— FDM period name
• Must match FDM Period
– Load Method (ex RR)— Load Method is a two‐character switch. ( )
• Character 1 = Method when importing into FDM Append/Replace (Valid values A or R)
• Character 2 = Method when exporting to Target Append/Replace (Valid
www.finitsolutions.com‐ 18 ‐
Character 2 Method when exporting to Target Append/Replace (Valid values R,M,A,etc.)
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch File LocationThe Finit Solutions Series
• All files to be loaded through the batch loader must be placed in the appropriate batch foldermust be placed in the appropriate batch folder – Standard batch files (one month, one location) need to be placed in the OpenBatch folderbe placed in the OpenBatch folder
– Multi‐Load files need to be placed
i th O B t hML f ldin the OpenBatchML folder
– Excel Based Journal Templates
d b l d hneed to be placed in the
OpenBatchML folder
www.finitsolutions.com‐ 19 ‐
The Finit Solutions Series
Auto Map Correct
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Auto Map CorrectThe Finit Solutions Series
‐ Automap Correct will allow the FDM process to continue in the event a mapping error is
p
continue in the event a mapping error is encountered
‐ The system will look to a specified location to obtain a map in the event the original maps do not cover all accounts in the source file
‐ This will add that new map to the maps for this location for further instances of this source account
www.finitsolutions.com‐ 21 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Auto Map CorrectThe Finit Solutions Series
‐ To set up the suspense account a new location called “AutomapCorrect” must be added to the FDM
p
AutomapCorrect must be added to the FDM application
After adding this location a new map entry needs to be‐ After adding this location a new map entry needs to be made in the explicit map for each dimension‐ Source value for this mapping must be called AutoCorrectSource value for this mapping must be called AutoCorrect
‐ Target value can be any valid member for the dimension
‐ These mapping entries will be the basis for the autoThese mapping entries will be the basis for the auto mapping for any un‐mapped members from a batch load
www.finitsolutions.com‐ 22 ‐
The Finit Solutions Series
Running the Batch Loader
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via ClientThe Finit Solutions Series
• In the FDM Workbench click on Tools Batch Processing to open the batch processing interface
• This will allow you toThis will allow you to “manually” configure the settings for an FDM batchsettings for an FDM batch and execute it
www.finitsolutions.com‐ 24 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via ClientThe Finit Solutions Series
• Below is the Batch Loader Interface in the Workbench
www.finitsolutions.com‐ 25 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via ClientThe Finit Solutions Series
• The following settings for the Batch Loader are set up in the interface and are outlined below
atc oade a ua a C e t
the interface and are outlined below
– Batch Type – Standard or Multi‐Load
– Process Level – Can process anywhere from Import Only to aProcess Level Can process anywhere from Import Only to a Full Process or a Consolidation Only
– Process Method – Serial or Parallel (If Parallel, can specify the number of processes to run)
– Load Balance Server – FDM Load Balance Server
File Name Delimiter The delimiter for the different– File Name Delimiter – The delimiter for the different components of the Batch File Name (‘~’, ‘_’, or ‘@’)
• Usually a Best Practice to use ‘~’ as FDM locations or categories may
www.finitsolutions.com‐ 26 ‐
y g ycontain an ‘_’
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via ClientThe Finit Solutions Series
• To process a file using the Manual Batch Loader
atc oade a ua a C e t
– First place a file in the OpenBatch folder
– Select the Parameters in the Interface
– Select Execute
• You will see the status of the job processing and• You will see the status of the job processing and will see when it is complete
www.finitsolutions.com‐ 27 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via WebThe Finit Solutions Series
• Batch Loader can also be run via the web by setting up an FDM Task Flow
atc oade a ua a eb
setting up an FDM Task Flow
• This allows users who do not have access to the kb h ( l h kb hWorkbench (only Power users have Workbench
access) the ability to run the batch loader script.
www.finitsolutions.com‐ 28 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via WebThe Finit Solutions Series
• The Batch Loader interface also allows the easy creation of a Batch Script that will be used to run the
atc oade a ua a eb
creation of a Batch Script that will be used to run the Batch Process via an FDM Task Flow
• Simply set the parameters for how you would like theSimply set the parameters for how you would like the script to operate and select “Create Script”
• This will create a Custom Script that can be run to pinitialize the FDM Batch Process
• Just like other FDM scripts the Batch script can be p penhanced to perform additional tasks:
– Email Alerts
Addi i l E L i
www.finitsolutions.com‐ 29 ‐
– Additional Error Logging
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Manual via WebThe Finit Solutions Series
Steps to set up an FDM Batch Task Flow1 C C G l S i i h B h L d
atc oade a ua a eb
1. Create Custom General Script via the Batch Loader interface.
2 C t C t W b S i t2. Create Custom Web Script.
3. Copy the Custom General script that you created from the Batch Loader Interface to the CustomWeb Scriptthe Batch Loader Interface to the Custom Web Script.
4. Add item in Menu Maker (under Tools).
5 Cli k T k Fl t i t5. Click on Task Flows to see your script.
6. Click on the Task Flow to run it.
www.finitsolutions.com‐ 30 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Task ManagerThe Finit Solutions Series
• Task Manager installs a Windows service that runs scheduled tasks (FDM scripts) at specified
atc oade as a age
scheduled tasks (FDM scripts) at specified intervals
k b h d l d dl d l• Tasks can be scheduled to run repeatedly, daily, weekly, or monthly
• Task Manager can be installed on any server that can access the FDM application (the Web server, the application server, or the data server where FDM data resides)
www.finitsolutions.com‐ 31 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – AutomaticThe Finit Solutions Series
• The Task Manager will run specified FDM scripts as certain intervals
atc oade uto at c
as certain intervals
• This allows the Batch Loader Scripts that we d k l hcreated to run via a Task Flow without any user
initiation
www.finitsolutions.com‐ 32 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – AutomaticThe Finit Solutions Series
Creating Tasks in the Task Manager1 O h T k M Thi i ll i ll d
atc oade uto at c
1. Open up the Task Manager. This is usually installed on the FDM Application server
2 Cli k T k N T k2. Click on Task New Task
3. Click on the General Tab and Enter in the following informationinformation
– Task Name – Any Name for the Task
– FDM Application – Select from available applicationsFDM Application Select from available applications
– Action Script – The Script that you wish to run (Any Custom General or Custom Web script)
www.finitsolutions.com‐ 33 ‐
– User Information
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – AutomaticThe Finit Solutions Series
atc oade uto at c
www.finitsolutions.com‐ 34 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – AutomaticThe Finit Solutions Series
Creating Tasks in the Task Manager (cont)4 Cli k h S h d l T b d h h f h
atc oade uto at c
4. Click on the Schedule Tab and choose how often the script should run
Frequency Repeat Weekly Monthly– Frequency – Repeat, Weekly, Monthly
– Repeat – This is only for repeat
– Schedule – If Weekly or Monthly, select scheduleSchedule If Weekly or Monthly, select schedule
www.finitsolutions.com‐ 35 ‐
The Finit Solutions Series
Batch Loader Reports
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – FDM ReportsThe Finit Solutions Series
• There are several standard FDM reports that can be used to monitor and track the batch loading process
atc oade epo ts
used to monitor and track the batch loading process
• They are all listed in the Batch Reports Group– Batch Listing – A simple listing of all of the batches that haveBatch Listing A simple listing of all of the batches that have
been run– Batch File Listing – Details the actual filenames involved in all
of the batchesof the batches– Batch Error Listing – shows errors in the batch process
(would display the same type of errors as a manual run)– Batch Processing Status – Shows the details of a batch that is
currently processing– Batch Auto Map Changes – Will show the details of records
www.finitsolutions.com‐ 37 ‐
Batch Auto Map Changes Will show the details of records that have been mapped using the auto map feature
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – FDM ReportsThe Finit Solutions Series
• Batch Listing – A simple listing of all of the batches that have been run
atc oade epo ts
• Batch File Listing – Details the actual filenames involved in all of• Batch File Listing Details the actual filenames involved in all of the batches
www.finitsolutions.com‐ 38 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – FDM ReportsThe Finit Solutions Series
• Batch Error Listing – shows errors in the batch process (would display the same type of errors as a manual run)
atc oade epo ts
p y yp )
www.finitsolutions.com‐ 39 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Batch Loader – Real SolutionsThe Finit Solutions Series
• We have had many clients use the FDM Batch Loader in many different ways
atc oade ea So ut o s
Loader in many different ways– Loading Historical Data
l l– Excel Templates
– Lights out automation into Hyperion Enterprise
– Lights out automation to pull data from source systems and load through to HFM
www.finitsolutions.com‐ 40 ‐
Finit Solutions Series
Future Webinars and Contact InfoInfo
www.finitsolutions.com
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Upcoming WebinarsThe Finit Solutions Series
Getting the Most out of EPM: Introduction to Financial Close Management and Disclosure Management
p g
On May 12, you will learn about two new tools recently released by Oracle Hyperion: Financial Close Management and Disclosure Management. These new tools provide functionality that streamline and provide better insight into the ‘last mile of the close’; tasks typically performed outside the consolidation system that are related to items such as external reporting, footnoting, and xbrl tagging. We will review some of the main features and functionality in these new tools, including task management, document life‐cycle management, financial calendar tracking, and account reconciliations .
Getting the Most out of EPM:New Features and Functionality in Fusion Edition 11.1.2 (TalleyRand)
Date TBD in June pending product release.
To register, go to www.finitsolutions.com/Insights_Webcast.html
www.finitsolutions.com‐ 42 ‐
Th Fi it S l ti S i
Getting the most out of FDM: Fully Automating Your Data Loads
Finit ContactsThe Finit Solutions Series
Q ti ?Questions? Jay Hampton
216‐870‐3657
Email us for a
216 870 3657
Ed DeLise (VP of Sales)
d li @fi i l i
copy of the slides or
l k h d
678‐296‐3611
link to the [email protected]
www.finitsolutions.com‐ 43 ‐