The Modeling Agency logo

Analytics Transformed™
  • This field is for validation purposes and should be left unchanged.

Building the Analytics-Driven Operation


Machine Learning at Scale with

Productionalized Foresight

Classroom: Five Days
Online: Ten Half-Day Live Sessions
$3,995 USD
INFORMS Professional Development Units: 45


This comprehensive active exposure to the full Modeling Practice Framework™ (see illustration) provides leaders and practitioners with an integrated strategic and tactical orientation to predictive analytics, AI and machine learning.

Participants will build an AI-driven operation in stages to experience the natural messiness of AI and predictive analytics. No other training in the market provides such an immersive, skill-reinforcing and complete view of the practice –particularly with a real-world focus and vendor-neutral perspective.

If you are a business or public-sector leader or practitioner looking to accelerate your organization’s digital transformation and put data science to work for measurable gain, then this course is designed for you. You do not need to know how code or have stats experience to track and benefit.


      • IT EXECUTIVES AND BIG DATA DIRECTORS: CIOs, CAOs, CTOs, Stakeholders, Functional Officers, Technical Directors and Project Managers who desire to transform their deluge of inert data to actionable assets
      • LINE-OF-BUSINESS EXECUTIVES AND FUNCTIONAL MANAGERS: Risk Managers, Customer Relationship Managers, Business Forecasters, Inventory Flow Analysts, Financial Forecasters, Direct Marketing Analysts, Medical Diagnostic Analysts, eCommerce Company Executives
      • DATA SCIENTISTS: Who recognize the importance of complementing their tactical proficiency with a strategic planning and design approach to advanced analytics
      • TECHNOLOGY PLANNERS: Who survey emerging technologies in order to prioritize corporate investment
      • CONSULTANTS: Whose competitive environment is intensifying and whose success requires competency with data science, AI, machine learning and related emerging information technologies


      • Plan and manage your AI projects effectively from the start
      • Identify, qualify and prioritize viable and actionable opportunities
      • Shift from a limited technology mindset to one of organizational transformation
      • Avoid approaches that waste time and expense on doomed AI projects
      • Construct a valid data set and transform data for superior machine learning model performance
      • Select appropriate methods for each of the four core analytic project types
      • Assess the degree to which a decision model meets a predefined performance objective
      • Take a low-risk / high-impact approach to model development with vendor-neutral tool exposure
      • Apply a formal roadmap for data preparation, model development and validation of results
      • Build an analytics sandbox for rapid model development and reduced IT dependency
      • Develop the rare leadership skills to identify assess, design and oversee viable projects
      • Leave with the resources, contacts and plans to reduce preparation time, costs and risks


Traditionally, organizations use data retrospectively – to view what has already happened. Leading organizations use data strategically to anticipate behavior to maximize returns and minimize risk. The mining of data for predictive indicators with machine learning creates invaluable information assets.

Predictive analytics differs from traditional analytics because it produces models —models that capture and represent hidden patterns and interactions in the data. The models that result from such a proactive approach address both why things happened and what is likely to happen next. A user can pose “what-if” questions to an analytic model that cannot be queried directly from a data store. Examples include:

      • What is the expected lifetime value of every customer account?
      • How can we better target the allocation of organizational resources?
      • Which cases should be audited first for the highest propensity of fraud?
      • How will production quality be affected if resources and controls change?

The organizations that transform their data into information assets and automate decision-making for measurable gains will realize substantial returns on their data science and big data investments.


This course provides a methodical, holistic and strategic approach to predictive analytics. Most organizations jump directly into data and tools that tend to produce good models… and their projects fail. They fail because they have not anticipated how to integrate the project in the organization.

Those who make the investment to fully assess their environment, situation, resources and objectives across all team members will produce project results that are measurable, accountable, actionable and impactful. Unlike any other course on the market, the Comprehensive course steps through the full build of a predictive modeling operation within the realistic environment of a large organization.

Leaders who take this course will interact more effectively with their teams at the tactical level, while analytic practitioners will complement their existing algorithmic background with a more strategic goal-driven focus.In the end, the organization will be greatly strengthened with team members who operate within a common platform that makes AI, predictive analytics and machine learning purposeful and impactful.

This course is intended for those willing to invest in developing skills for superior project design and incremental decision modeling platform development. Those who complete this course will be capable of guiding their organization to stand up a thriving internal AI-driven decisioning practice with measurable and residual gains.


Registrants will be required to view a three-hour online video “Core Concepts” orientation prior to attending this event. Access details to the Core Concepts video modules will be shared with participants prior to the start of the course.Modules are easily consumable in 10 to 15-minute blocks of instruction.

Prior education or experience in data analytics or statistics is helpful, but not required. Instructions on how to download exercise data and any analytic tools will be provided in the preparatory email. The instructor can assist participants with any preparation during breaks, and before or after class.


Core Concepts
Assess Phase
    • Assemble Team
    • Leadership, Analysts, Subject Experts, Data Support, Stakeholders, etc
    • Determine Whether External Talent is Needed
        • Examine Culture & Mindset
        • List Candidate Projects
    • Place Projects on a Benefits / Challenges Quadrant Plot
    • Guided Discussion Breakout Session
        • Define Performance Benchmarks
        • Identify Data Sources
        • Itemize Existing Analytic Resources
        • Describe Operational Environments
        • Initial Report of Overall Practice Readiness
    • What Should an Assess Phase Report Contain?
    • Exercise Breakout Session
Plan Phase
    • Pull & Recon Data
    • Explore Data & Verify Quality
    • Do We Have Enough Data?
    • Which Data are Relevant?
    • Make a First Look at Data Quality
    • Exercise Breakout Session
        • Design Analytic Sandbox
        • Qualify Team
        • Qualify Tools
        • Define Operational Environment(s)
        • Establish Performance Benchmarks & Targets
    • What are the current metrics (KPIs)?
    • What is the Role of Technical Metrics vs. KPIs?
    • Benchmark Demonstration
        • Consider Deployment Options
        • Prioritize Viable Projects
Prepare Phase
      • Initiate Culture & Mindset Shift
      • Refine Team Roles & Responsibilities
      • Build Analytic Sandbox
      • The Importance of the “Data Recon”
      • Effective Collaboration Between Analysts and IT
      • Exercise Breakout Session
        • Define Performance Benchmarks
        • Explore Final Data
      • Comparing Data Requirements to Actual Data
      • Looking for Potential Problems
      • Data Exploration Demonstration
        • Prepare Data
      • Data Integration
      • Data Cleaning
      • Data Construction
      • Exercise Breakout Session
        • Select Candidate Modeling Techniques
        • Develop Roll-out Plan for Go-Live
Model Phase
    • Current Trends in Data Science, AI and Machine Learning
        • Algorithms in the News: Deep Learning
        • The Modeling Software Landscape
        • The Rise of R and Python: The Impact on Modeling and Deployment
        • Do I Need to Know About Statistics to Build Predictive Models?
    • Strategic and Tactical Considerations in Choosing a Modeling Algorithm
        • What is an Algorithm?
        • Is a “Black Box” Algorithm an Option for Me?
    • The Tasks of the Model Phase
        • Generate Test Design
            • Train-Test Validation
            • Accept or Reject Modeling Parameters
            • Test / Test / Validate
    • Optimizing Data for Different Algorithms
    • Build Models
        • Classification
            • Issues Unique to Classification Problems
            • Why Classification Projects are So Common
            • An Overview of Classification Algorithms
                • Logistic Regression
                • Neural Networks
                • Naïve Bayes Classification
                • Support Vector Machines
                • Decision Trees
                • Ensemble Methods
            • Value Estimation and Regression
            • Clustering
            • Association Rules
            • Other Modeling Techniques
                • Times Series
                • Text Mining
                • Factor Analysis
            • Model Assessment
                • Evaluate Model Results
                    • Check Plausibility
                    • Check Reliability
                • Model Accuracy and Stability
                • Lift and Gains Charts
            • Modeling Demonstration
                • Assess Model Viability
                • Select Final Models
            • Why Accuracy and Stability are Not Enough
            • What to Look for in Model Performance
            • Exercise Breakout Session
                • Create & Document Modeling Plan
                • Determine Readiness for Deployment
            • What are Potential Deployment Challenges for Each Candidate Model?
            • Exercise Breakout Session and Guided Project Discussion
Validate Phase
    • Select the Most Strategic Model Option(s)
    • Validate Finalist Models
    • Prepare Data for Test Deployment
    • Data Preparation Steps for Production
    • Data Preparation Demonstration
        • Measure Lift / ROI / Impact
    • The Potential Challenges of Estimating ROI
    • Designing an Effective “Dress Rehearsal”
    • The Basics of A/B testing
    • Exercise Breakout Session
        • Test Deployment
        • Document Validation Process
Deploy Phase
      • Change Management for New Decision Process
      • Streamline Data Preparation for Deployment
      • Revisiting Data Prep with an Eye toward Deployment
      • Considering Deployment Options
      • Data Preparation Demonstration
        • Review All Project Functions
        • Go Live
        • Prepare Final Report
        • Conduct Knowledge Transfer
Monitor Phase
        • Create Maintenance Schedule
        • Assign Monitoring Responsibilities
        • Build Performance Dashboard
        • Who Will be in Charge of Monitoring?
        • How with the Monitoring Information be Updated?
        • Exercise Breakout Session
            • Define Criteria for Model Refresh or Replace
            • Develop Monitoring & Maintenance Plan
        • Putting a Proper Plan and Schedule into Place
        • Monitoring Demonstration
          • Identify New Data Sources
          • Record Changes to Environment and Organization
Wrap-up and Next Steps
          • Supplementary Materials and Resources
          • Conferences and Communities
          • Get Started on a Project!
          • Options for Strategic Oversight and Collaborative Implementation

The Modeling Agency, LLC, is registered with INFORMS (the INstitute For Operations Research and the Management Sciences) as a Recognized Analytics Continuing Educational Provider for the CAP® (Certified Analytics Professional) program. The CAP® credential provides analytics professionals with a means to distinguish themselves and demonstrate to employers, colleagues, and the public that they are knowledgeable analytics professionals. Courses provided by The Modeling Agency, LLC, are automatically accepted by INFORMS when claimed by credential holders as evidence of continuing education. For more information about the CAP® program, including requirements, eligibility, benefits, preparation, and exam dates, please visit the INFORMS website at

On-Site Available

Inquire by Phone or Email

Why Train With TMA?

Determine whether TMA training is right for you, and learn why TMA is truly the best option for live classroom analytics training.

Attendee Comments

“This course is extremely helpful and should be attended by any and all new Data Analysts. It outlines the process completely and thoroughly.”

Gagan Sekhon
Data Scientist
Xoom Corporation

“This course gave me just what I needed: a clear conceptual idea of how a data mining project is designed and implemented, and the hands-on to gain confidence in the process.”

Dotty Korsey
Market Information Manager
Bank of Hawaii

“This course opened my eyes to the big picture in a practical way. The content of the Project Implementation course was very clear and responsive to my needs. My questions were answered directly and clearly. Exceeded my expectations!”

Bill Scharffenberg
ITS – Business Solutions
Surewest Communications

“I would recommend TMA’s Project Implementation course to executives weighing the costs and benefits of such projects within their organizations. Tony approaches the course from a business management perspective and presents the concepts in real-world cases making the task of visualizing use of the process in one’s own business a snap!”

Kelli R. Schultz
AVP, Information Technology
iPay, LLC

“The course was very efficient. It imparts new perspectives in the strategic implementation of predictive analysis projects. The instructor was supportive and has extensive experience in this field. I recommend that all data scientists get this course.”

Maher Alsharfan
Statistical Researcher
Saudi Credit & Savings Bank

“The ‘Project Implementation’ course successfully takes the broad and complex subject of data mining and organizes and explains it in a very logical and understandable way. The training provides real-life examples of the various aspects of data mining and a proven approach to successfully achieving desired results. I can highly recommend TMA’s Data Mining courses to anyone interested in understanding the broad landscape of data mining and predictive analytics.”

Dillon Ridguard
Principal, Technology Services Group
Computer Sciences Corporation

“For a person with no prior predictive analytics knowledge, TMA’s course series is the way to go for comprehensive insights about true predictive analytics implementation. The course details with all phases of a project right from planning to implementation to the deployment stage. The course transforms from a reactive reporting environment to a prescriptive operation.”

Kiran Rachamadugu
Service Delivery Manager, BI/EDW

“As a BI executive and workshop-leader veteran of 40+ years educating over a thousand participants from more than 200 high-profile organizations in the US and abroad, I can attest to the quality, depth and clarity of the presented material and fascinated by The Modeling Agency and the presenters’ experience not found elsewhere.”

Dr. Sam Arafeh
eSEAM International

“This course was excellent. It was technical and practical. The instructors were just amazing with their knowledge experience and their ability to answer all our inquires, also the resources they provided us with were very helpful. Well done TMA!”

Sana Al Hajri
Planning and Program Analyst
Saudi Aramco

“This course gave me a new perspective on techniques and applications software that our federal agency had not previously seen. The course content was great, and the very knowledgeable instructor kept the students attention by using real-life examples and discussion of additional resources. I highly recommend this course!”

Larry P. Taylor
US Department of Education

“I was a bit apprehensive about attending and how I could apply data mining concepts to my particular industry, but the instructor put those fears to rest.  Highly recommended!  Thanks TMA!”

Lewis Kohnle
Planner / Analyst
The Mitchell Gold Company