Section: Evaluation Framework • Reference: ACR-2026-Q2-MTH

Evaluation Framework

Complete Documentation of the AUS Casino Index Scoring Methodology

Prepared by: Michael Stewart, Lead Analyst
Framework Version: 3.2 (updated Q2 2026)
Total Metrics: 78 per platform • Categories: 8

Methodology Overview

The AUS Casino Index employs a weighted scoring framework that converts 78 discrete performance metrics into a single composite score on a 1000-point scale. The framework is designed to prioritise factors with demonstrated correlation to player satisfaction and platform reliability, as determined through player survey data and longitudinal outcome analysis. This section documents the complete methodology, including category definitions, weighting rationale, data collection protocols, and quality assurance procedures.

1.0 Scoring Category Weights

The eight evaluation categories and their respective weights in the AUS Casino Index are presented below. Weights were calibrated using regression analysis against player satisfaction survey data (n=2,400) collected during the 2025 assessment cycle, identifying the factors most strongly correlated with sustained platform engagement and positive player outcomes.

Withdrawal Reliability
20%
Game Portfolio
18%
Bonus Economics
15%
Security Standards
15%
Mobile Performance
12%
Customer Support
8%
Licensing & Compliance
7%
Responsible Gambling
5%

2.0 Category Definitions and Metrics

2.1 Withdrawal Reliability (20%)

This category evaluates the speed, consistency, and transparency of withdrawal processing. Metrics include median processing time across payment methods (30% of category), accuracy of stated processing estimates (25%), withdrawal limit adequacy (15%), fee transparency (15%), and KYC verification efficiency (15%). Data is collected through 12 controlled withdrawal tests per platform, distributed across payment methods and temporal conditions.

2.2 Game Portfolio (18%)

Game portfolio assessment encompasses catalogue volume (20% of category), software provider diversity (25%), RTP distribution quality (20%), live dealer coverage (15%), exclusive content availability (10%), and new title release frequency (10%). Data is collected through direct catalogue analysis, provider partnership verification, and a stratified RTP sampling programme.

2.3 Bonus Economics (15%)

Bonus evaluation applies expected value modelling to welcome packages (30% of category), ongoing promotional programmes (25%), loyalty programme design (25%), wagering requirement competitiveness (10%), and terms transparency (10%). Mathematical models assume optimal play strategy and average portfolio RTP to calculate expected withdrawable value per deposit dollar.

2.4 Security Standards (15%)

Security assessment examines encryption protocol quality (20% of category), RNG certification status (25%), two-factor authentication availability (15%), payment data security (PCI DSS compliance) (15%), provably fair system availability (10%), and vulnerability management (penetration testing) (15%). Technical testing is supplemented by certification verification and public disclosure analysis.

2.5 Mobile Performance (12%)

Mobile evaluation follows a standardised testing protocol conducted across three devices and three network conditions. Metrics include page load speed (25% of category), game loading time (20%), feature parity with desktop (20%), responsive design quality (20%), and navigation user experience (15%). Each platform is tested 30 times (10 per device) to establish statistical reliability.

2.6 Customer Support (8%)

Support evaluation measures response time across available channels (30% of category), resolution quality (25%), channel breadth (20%), operating hours (15%), and language support (10%). Testing involves submitting standardised enquiries at varied times and evaluating response accuracy and helpfulness.

2.7 Licensing and Compliance (7%)

This category assesses the regulatory framework under which each platform operates, including licence jurisdiction quality (40% of category), operational history length (20%), documented compliance incidents (20%), and transparency of corporate structure (20%).

2.8 Responsible Gambling (5%)

Responsible gambling evaluation examines the availability and implementation quality of player protection tools: deposit limits (20% of category), self-exclusion options (20%), session time controls (15%), activity statements (15%), reality checks (15%), and problem gambling resource visibility (15%).

3.0 Data Collection Protocols

Data Type Collection Method Frequency Sample Size
Withdrawal SpeedControlled test transactionsMonthly12 per platform
Game CatalogueAutomated platform scrapingWeeklyComplete catalogue
RTP VerificationStratified random samplingQuarterly500 titles across cohort
Mobile PerformanceStandardised device testingQuarterly30 tests per platform
Support QualityMystery enquiry submissionMonthly4 per platform per month
Security PostureTechnical scanning + verificationQuarterly24 parameters per platform
Bonus TermsManual monitoring + documentationWeeklyAll active promotions
Player SatisfactionSurvey instrumentAnnualn=2,400 Australian players

4.0 Quality Assurance Procedures

All collected data undergoes a three-stage quality assurance process prior to incorporation into index calculations:

  1. Automated Validation: Data points are checked against established ranges and flagged for review if they exceed two standard deviations from historical norms.
  2. Peer Review: Each analyst's assessments are reviewed by a second team member with domain expertise in the relevant evaluation category.
  3. Editorial Verification: The lead analyst conducts a final review of all scoring outputs, cross-referencing category scores against qualitative observations to identify any inconsistencies.

5.0 Score Calculation Process

The AUS Casino Index score for each platform is calculated as follows:

  1. Each metric within a category is scored on a normalised 0-100 scale based on its performance relative to the full cohort of 47 evaluated platforms.
  2. Category scores are calculated as the weighted average of constituent metric scores.
  3. The composite AUS Casino Index score is the weighted sum of all eight category scores, scaled to a 1000-point maximum.
  4. Final scores are rounded to the nearest integer.

Score Interpretation Guide

900-1000: Exceptional — outstanding performance across all categories with no significant limitations.

800-899: Excellent — strong performance across most categories with minor limitations in one or two areas.

700-799: Good — solid overall performance with specific strengths that compensate for identifiable weaknesses.

600-699: Adequate — meets baseline standards but with notable limitations in multiple categories.

Below 600: Below Standard — significant deficiencies that preclude recommendation. Platforms scoring below 600 are excluded from the published top-ten rankings.

6.0 Methodology Versioning

The evaluation framework is subject to periodic revision as new assessment dimensions become relevant and as player priorities evolve. Version changes are documented with effective dates and impact assessments. Where feasible, significant methodology changes are applied retrospectively to enable longitudinal comparisons across assessment periods.

Version Date Key Changes
1.0July 2024Initial framework — 6 categories, 45 metrics
2.0January 2025Added mobile performance and responsible gambling categories
2.5April 2025Introduced expected value modelling for bonus assessment
3.0October 2025Expanded to 78 metrics; recalibrated weights using survey data
3.2April 2026Added KYC verification speed metric; updated mobile testing protocol

The evaluation framework documented in this section represents version 3.2, effective from April 2026. Questions regarding methodology should reference this section (ACR-2026-Q2-MTH) and the specific subsection of interest. Framework refinements for version 3.3 are under development for the Q3 2026 edition.